System Requirements & Availability
- Self-hosted: Supported (single-user and multi-user modes)
- Desktop: v1.13.0 or higher
Routing Mechanism
The Model Router acts as a virtual LLM Provider. Rules are evaluated sequentially from top to bottom. The first matching rule executes. If no rules match, the traffic falls back to the primary provider and model.
Rule Types
- Calculated Rules: Evaluated locally (no LLM call required). Matches on:
- Prompt keywords
- Conversation token count
- Time of day
- Presence of image attachments
- LLM-classified Rules: Evaluated by the fallback LLM using natural language descriptions. The fallback model evaluates the conversation history and the new message to determine if the rule conditions are met.
Configuration
- Access the LLM Provider picker.
- Select Model Router.
- Choose the target router configuration.