Run Local Models Through Ollama, Vllm, Or Transformers

A lightweight Python library with a consistent API for LLMs, embeddings, rerankers, transcription, and speech generation across 15+ hosted and local providers. Includes async and streaming support, structured outputs, and optional LangChain integration.

AI Frameworks | Python · LLM · multi-provider