Switch Between Local Inference Engines And Cloud Providers

A cross-platform desktop app and inference engine for running open-weight LLMs locally. It exposes an OpenAI-compatible API for agents and other clients, supports MCP servers, and includes llama.cpp and MLX-based backends.

AI Frameworks | TypeScript · local LLM · inference engine