Serve Local Models Through Openai-compatible Apis

FreeToken is a local MoE inference and serving engine that runs large open-weight models across GPU, CPU, and host memory. It provides OpenAI- and Anthropic-compatible APIs, plus a desktop app and CLI.

AI Frameworks | Python · LLM inference · MoE serving