Monitor Gpu And Inference Statistics

Cross-platform browser-based GUI for installing, configuring, and launching llama.cpp. Includes local model chat, GGUF downloads, launch presets, benchmarking, monitoring, and OpenAI-compatible API support.

AI Tools | JavaScript · llama.cpp · local inference