Semantic Caching To Cut Llm Cost And Latency

Bifrost is a high-performance Go AI gateway exposing one OpenAI-compatible API over 23+ providers, with automatic failover, key load balancing, semantic caching, MCP tool support, guardrails and budget governance at low overhead.

AI Tools | Go · ai-gateway · llm-gateway

RedisVL is the AI-native Python client for using Redis as a vector database. It covers index/schema management, vector, hybrid and filtered search, embedders, rerankers, semantic caching, LLM memory, semantic routing, plus a bundled MCP server.

RAG | Python · vector-search · redis