Category
AI Frameworks
Core frameworks for building LLM applications.
| Project name | Stars | Category | Language | Tags | Summary | View Project |
|---|---|---|---|---|---|---|
| agent-kernel | ★ 191 | AI Frameworks | Python | ai-agents · multi-agent · agent-orchestration · mcp · a2a · ag-ui · enterprise · guardrails · observability · session-management · serverless · kubernetes · terraform · multi-cloud · rag · skills | Agent Kernel is a Python platform layer for running, orchestrating and deploying production AI agents. It runs OpenAI Agents SDK, LangGraph, CrewAI and Google ADK side by side, adds guardrails, sessions, RAG, sandboxing, channels and MCP/A2A/AG-UI, and deploys to AWS, Azure, GCP or Kubernetes via Terraform and Helm. | View Project → |
| yoagent | ★ 179 | AI Frameworks | Rust | Rust · agent loop · tool calling · streaming · coding agents · multi-agent · MCP · OpenAPI · local models · session branching · middleware · LLM providers | A Rust framework for building tool-using LLM agents, with streaming support across seven protocols, built-in tools, MCP and OpenAPI integrations, sub-agents, and session management. Includes a terminal coding-agent example. | View Project → |
| self-hosted-ai-stack | ★ 156 | AI Frameworks | Shell | self-hosted · docker-compose · ollama · litellm · mcp · rag · local-llm · whisper · text-to-speech · embeddings · docling · cuda · privacy · multi-arch · openai-compatible · infrastructure | Docker Compose bundle that deploys a full local AI stack: Ollama for LLMs, LiteLLM gateway, AnythingLLM chat UI, embeddings/RAG, Whisper STT, Kokoro TTS, Docling parsing, and an MCP Gateway. Includes lightweight stack variants, optional HTTPS and CUDA GPU acceleration. | View Project → |
| swift-ai-sdk | ★ 154 | AI Frameworks | Swift | swift · sdk · llm · streaming · tool-calling · structured-outputs · mcp · multi-provider · apple-platforms · ios · macos · vercel-ai-sdk · middleware · text-generation · function-calling · provider-agnostic | Swift port of the Vercel AI SDK offering one provider-agnostic API for streaming text, structured outputs, tool calling, MCP tools, and middleware across 38 providers via SwiftPM. Built for iOS/macOS apps needing OpenAI, Anthropic, Google and others from Swift. | View Project → |
| neurolink | ★ 144 | AI Frameworks | TypeScript | typescript · llm · multi-provider · mcp · rag · voice · agents · memory · sdk · cli · streaming · embeddings · tts · stt · model-routing · failover | TypeScript AI SDK unifying 30+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Ollama) behind one streaming API. MCP-native with built-in RAG, memory, voice TTS/STT, agents, and provider failover. Extracted from Juspay production systems. | View Project → |
| llm | ★ 141 | AI Frameworks | Ruby | ruby · llm-runtime · agents · tool-calling · mcp-client · a2a · rag · skills · streaming · multi-provider · concurrency · persistence · zero-dependencies · active-record · sequel · console | llm.rb is a zero-dependency Ruby runtime for building agentic LLM apps: a single API across 14+ providers, managed tool loops, tools, skills, MCP/A2A clients, streaming callbacks, concurrency strategies and ActiveRecord/Sequel persistence, plus an interactive agent console. | View Project → |
| model-compose | ★ 113 | AI Frameworks | Python | yaml · declarative · orchestration · llmops · agents · rag · mcp · multi-provider · docker · streaming · workflow · self-hosted · human-in-the-loop · vector-database · local-models · docker-compose-alternative | model-compose is a declarative YAML orchestrator (docker-compose for AI) that deploys chat APIs, ReAct agents, RAG pipelines, and MCP servers from one file. It bridges local and cloud models and runs on Docker, native, or distributed Redis-queued runtimes. | View Project → |
| ai-microcore | ★ 108 | AI Frameworks | Python | llm · python · mcp · rag · vector-database · prompt-templates · provider-agnostic · embeddings · semantic-search · streaming · jinja2 · llm-adapters · chat-completion · tool-calling · minimalist | MicroCore is a minimalist Python library of LLM and vector-DB adapters that makes providers switchable via config while keeping app code unchanged. It includes prompt templating, streaming, embeddings search (Chroma/Qdrant) and LLM-agnostic MCP tool integration. | View Project → |
| quarkus-workshop-langchain4j | ★ 107 | AI Frameworks | Java | workshop · Quarkus · LangChain4j · LLM · chatbot · AI services · agent orchestration · MCP | A step-by-step Java workshop for building AI applications with Quarkus and LangChain4j, covering single AI services and agentic orchestration. Each lesson has a runnable project state. | View Project → |
| HOMER | ★ 45 | AI Frameworks | Python | long-context · kv-cache · context-extension · llm-inference · llama-2 · memory-efficiency · attention · transformers · pytorch · research-implementation · hierarchical-merging · passkey-retrieval · perplexity-evaluation · training-free · flash-attention · iclr-2024 | Official ICLR 2024 implementation of HOMER, a training-free hierarchical KV-cache merging method that extends pre-trained LLM context limits (e.g. Llama-2) with lower memory. Ships patched LlamaForCausalLM, plus passkey-retrieval and PG19 perplexity scripts. | View Project → |