Serve Local Models Through An Openai-compatible Api

Published projects tagged with this use case.

1 project

jan

★ 45K

Jan is a cross-platform desktop app for downloading and chatting with local LLMs, with optional cloud model providers, custom assistants, MCP integrations, and an OpenAI-compatible local API.

AI Tools | Rust · local LLM · offline AI

View Project →