free-router-proxy
View on GitHubA local OpenAI-compatible gateway that ranks free models across configurable providers and fails over when a provider is unavailable, rate-limited, or returns no results. Includes a web UI for provider configuration and usage monitoring.
Use Cases
Route OpenAI-compatible client requests across configured model providersFail over when a provider is rate-limited or unavailableCompare and select currently free modelsTrack provider usage and quotas
Built With
- Language
- JavaScript
Tags
LLM gateway · model routing · OpenAI-compatible API · provider failover · free models · local proxy · quota tracking