Skip to main content
Skip to content
AI Consulting

Solution Architecture

The design of an AI system before it is built: model, runtime, connectors, data paths and permissions. Written down, with the reason for each choice.

01 / 04

The pilot was built to demo

One model, one data source, one team, hard-wired. The second use case starts over. Real load finds the parts nobody sized, and every integration is bespoke.

CH.01 · The problem

The pilot was built to demo. Production needs a design.

  1. Slow to ship anything after the first

    The pilot hard-wired one model, one data source and one team. The second use case means starting over, and the third waits for the second.

  2. It falls over at real load

    What served ten people in a demo queues at a hundred. Nobody sized it, because nobody designed it.

  3. Every integration is bespoke

    The CRM connector was written for the pilot. The ERP one for the next project. Neither shares a line, and both break when the API changes.

Our answer

An architecture the next three projects can use

We design the system: which model runs where, how data moves and where it may not go, how systems connect, who may see what. One document, reviewed with your engineers, that the build follows.

CH.02 · What we build

How we build it

Three views of the same system, each one reviewed with your team.

Fits the systems you haveOne way to connect, reusedPermissions and data paths by designParts you can replace
01

System architecture

The parts and how they talk.

  • Map the components: model, retrieval, agents, connectors, UI
  • Define the interfaces between them
  • Choose runtime per component: local, assistant, cloud
  • Size each part for the expected load
  • Document failure modes and what happens in each
02

Data architecture

Where data lives, moves and stops.

  • Inventory sources and their access rules
  • Draw the data paths and where each one ends
  • Classify what may leave the perimeter and what may not
  • Design retrieval, indexing and refresh
  • Plan retention and deletion
03

Technology stack

Chosen for the constraint, with the alternative named.

  • Select models and the policy for changing them
  • Select the inference route: local or no-retention cloud
  • Select stores, queues and orchestration
  • Prefer what your engineers already run
  • Record each choice with its reason and its alternative
CH.03 · How it runs

How it runs

Four phases, from what you have to a design the build follows.

  1. 01Phase 1

    Discovery

    Systems, data, rules and the projects ahead.

    • Review the systems and how they connect today
    • Inventory data sources and access rules
    • Collect the constraints: compliance, budget, skills
  2. 02Phase 2

    Design

    The three views, drafted and reviewed.

    • Draft the system view
    • Draft the data view with paths and stops
    • Choose the stack with reasons and alternatives
  3. 03Phase 3

    Build plan

    How the design becomes a system.

    • Split the build into phases with deliverables
    • Order by what the first use case needs
    • Estimate effort and cost per phase
  4. 04Phase 4

    Build support

    The design in the room while it is built.

    • Review implementation against the design
    • Settle the questions the design did not foresee
    • Update the document when reality wins
CH.04 · What changes

What changes

Faster second projects, a system that holds at load, and a design an auditor can read.

The second project starts on the first one's plumbing

Connectors, authentication and logging are shared. Each new use case adds its logic and reuses the rest.

Sized before it is built

Load, latency and cost estimated in the design and checked in the build. The queue at 9 a.m. is a design question answered early.

The compliance answer is the diagram

Data paths and permissions are drawn and enforced. When legal or the auditor asks where the data goes, the design is the answer.

Side by sideProject by projectOn a design
Second projectStarts overReuses connectors, auth, logging
LoadDiscovered in productionSized in the design, checked in the build
MaintenanceOne bespoke integration per projectShared parts, fixed once
IntegrationWritten for the demoUnder the rules your systems already enforce
Changing a model or vendorA rewriteA swap behind an interface
CH.05 · Questions

Questions

Architecture decides what the system is before code decides it by accident. The output is a document: components, interfaces, data paths, permissions, the stack and the reasons. The build follows it, and the engineers who build it have reviewed it. Without that step, the first implementation becomes the design, whether it was a good one or not.

For a first AI system in a mid-sized company, discovery and design typically fit in a few weeks, with the review cycles depending on how quickly your engineers and security can meet. We fix the timeline and the price after the first discovery week, when the scope is known.

That is the point. The design starts from your ERP, CRM, identity provider and data platform, and prefers tools your engineers already operate. New components are added where the existing ones cannot do the job, and each addition is written down with the reason.

Your engineers review every draft and sign off the final one, so the design is theirs before the build starts. During the build we review implementation against it together, and the document is updated when reality changes it. At handover they own the system and the document that describes it.

More in AI Consulting

The map of the practice

Back to AI Consulting
Start

Bring us the problem nobody has cracked yet.

We are a small team of senior specialists. We pick the right model and the right layer, and we build the least machinery that does the job. You get a call with an engineer, not a sales deck.