Optimize Inference For Apple Silicon, Nvidia, Amd, Or Cpu Hardware

A local inference engine that compiles and tunes kernels for the host hardware to run open models. Includes a desktop app and CLI, and connects to agents such as Pi, OpenCode, Hermes, and Codex.

AI Frameworks | Rust · LLM inference · local AI