Runtime
Runtime is the core local service responsible for translating authorized product intent into AI execution. Applications access Runtime through the public SDK surface without needing to manage low-level model dispatch; sensitive credentials and model connections remain securely held by Runtime.
What Runtime Manages
Runtime is responsible for:
- AI Execution & Scheduling: Routing between local models and cloud providers, managing token budgets and quotas, and securely storing provider credentials;
- Runtime Content Checks: On-device format checks on the
text.generatepath for model inputs, outputs, and complete tool arguments; see current rules and match handling. - LocalAgent Lifecycle: Instantiating and managing local agent instances based on Realm-issued character specifications (Character Source);
- Interaction & Presentation: Maintaining conversation streams, memory mediation, internal state, voice playback, and UI event projections;
- Local Processes & Audit: Managing local worker processes, model loading, streaming transport, and audit logs;
- Identity & Authorization: Resolving application identity and permissions derived from the active desktop session;
- Ecosystem Bridges: Providing controlled communication bridges to Realm services and external tools.
These core responsibilities stay with Runtime regardless of whether the consumer is Nimi Home, Desktop, Avatar, or a third-party app.
Ownership Boundaries
- Realm: Maintains persistent character identity, world context, and ecosystem social data. Runtime consumes this context without redefining canonical identity.
- Cognition & Memory Boundaries: Long-term memory is managed privately by Cognition on a per-agent basis; Runtime serves only as an authorized delivery and recall mediator. Knowledge V1 currently provides no active read, write, or public client path.
- Applications & UI Surfaces: Own their product UI, user interactions, and ephemeral state. Applications do not bypass Runtime to manage raw credentials or override permissions.
- Progressive Capabilities: External integrations and workflow tools are optional extensions; an unavailable extension will not disrupt core conversations or fundamental AI capabilities.
Read paths
- Integrations
- Streaming
- Runtime Content Checks
- Multimodal
- Agent Execution
- Memory And Knowledge
- Connectors And Providers
- Local Models
- Account And Session
- Delegated Capability
- Local Audit