Offline Or Air-gapped Inference

Needle is an 8-29 MB 2-bit foundation model and Python toolkit for on-device tool calling, structured JSON extraction and text embeddings. It ships inference, LoRA fine-tuning and per-platform builds for phones, wearables, robots, cars and microcontrollers.

AI Frameworks | Python · on-device-ai · edge-ai