Run AI Inference Close To End Users

Rust framework for building AI agents with function calling and serverless LLM tools. It provides QUIC-based tool routing, an OpenAI-compatible API, and infrastructure for geo-distributed inference.

AI Frameworks | Rust · AI agents · function calling