Vibe Coding Discoverllama_ros
View on GitHubllama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
ROS 2 packages that wrap llama.cpp and llava.cpp, exposing GGUF LLMs and VLMs as ROS 2 nodes with launch files, behavior-tree nodes, LangChain/RAG integration and LoRA/grammar support for local robotics inference.
Use Cases
Run GGUF LLMs/VLMs as native ROS 2 nodesVision-language reasoning on robot camera feedsRAG over robot logs and documentationLLM-driven behavior tree decision nodesBuild voice chatbots on robots (with whisper_ros)Generate constrained LLM output with GBNF grammarsSwap LoRA adapters at runtimeLocal embeddings and reranking for semantic search on robots
Built With
- Language
- C++
- Frameworks
- llama.cpp · llava.cpp · ROS 2 · LangChain · LangChain Chroma · LangChain OpenAI · Chroma · OpenCV · ggml · CUDA · colcon/ament
Tags
ros2 · llama.cpp · gguf · llm · vlm · robotics · local-inference · on-device · embeddings · rerank · langchain · behavior-trees · multimodal · llava · lora · cuda