gpt-load
View on GitHubSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
A self-hosted gateway that unifies AI provider APIs and subscription accounts behind one endpoint. It provides credential scheduling, retries and failover, request logs, usage tracking, and a web management UI.
Use Cases
Provide one API endpoint for multiple AI providersRoute requests across API keys and subscription accountsBalance traffic and fail over unhealthy credentialsMonitor request logs, usage, and estimated costs
Built With
- Language
- Go
- Frameworks
- Gin · Bifrost · CLIProxyAPI
Tags
AI gateway · LLM gateway · self-hosted · API routing · load balancing · failover · credential management · usage tracking · OpenAI-compatible · Anthropic · Gemini