Run Quantized Language Models Locally

Scripts and setup files for running Bonsai, Ternary-Bonsai, and Bonsai 2 models locally with llama.cpp or MLX. Includes Open WebUI integration, vision support, tool calling, and MCP connections.

AI Tools | Shell · local LLM · small models