haystack
View on GitHubOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Haystack is deepset's open-source Python framework for building production LLM apps: modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Model- and vendor-agnostic, with built-in components for RAG, semantic search, evaluation, and async streaming.
Use Cases
Built With
- Language
- Python
- Frameworks
- OpenAI · Anthropic · Mistral · Cohere · Hugging Face · Google Gemini · Azure OpenAI · AWS Bedrock · Ollama · Pydantic · NetworkX · Jinja2 · Hayhooks · MCP
Tags
llm-orchestration · rag · agents · pipelines · retrieval · semantic-search · context-engineering · python · tool-calling · memory · multimodal · evaluation · async · vector-search · multi-agent · mcp