Monitor Usage, Latency, Provider Health, And Spending

A self-hosted Python gateway for OpenAI- and Anthropic-compatible requests. It routes across cloud and local model providers with failover, key rotation, caching, budgets, and a monitoring dashboard.

AI Tools | Python · LLM router · API proxy