TensorSharp
★ 509A native .NET inference engine for running GGUF language and multimodal models on CPU or GPU. Includes CLI, web chat, mobile and desktop apps, OpenAI- and Ollama-compatible APIs, embeddings, and an optional tool-using agent runtime.
AI Frameworks | C# · LLM inference · GGUF
View Project →