← Back to glossary

Model Router

A component that selects the model or execution path for each request. It can use task type, language, sensitivity, budget, expected latency, or a classification result. A router is justified only when its decision beats a simple baseline on quality or cost; adding models without observability makes incidents harder to explain.