System architecture
The parts and how they talk.
- Map the components: model, retrieval, agents, connectors, UI
- Define the interfaces between them
- Choose runtime per component: local, assistant, cloud
- Size each part for the expected load
- Document failure modes and what happens in each