Fail Over Automatically When A Provider Is Unavailable Or Rate-limited

Published projects tagged with this use case.

1 project

Hermes-router

★ 110

A self-hosted Python gateway for OpenAI- and Anthropic-compatible requests. It routes across cloud and local model providers with failover, key rotation, caching, budgets, and a monitoring dashboard.

AI Tools | Python · LLM router · API proxy

View Project →