Vibe Coding DiscoverInteractive-LLM-Powered-NPCs
View on GitHubInteractive LLM Powered NPCs, is an open-source project that completely transforms your interaction with non-player characters (NPCs) in any game! 🎮🤖🚀
Windows-first runtime that lets you speak to NPCs in unmodified games: speech-to-text, LLM dialogue with vector-store memory, TTS plus SadTalker lip-sync injected back into the game, and webcam emotion awareness.
Use Cases
Talk out loud to any NPC in Cyberpunk 2077Conversing with NPCs in GTA 5 and Assassin's CreedGenerating personalities and names for background NPCsVector-store backed NPC memory and world knowledgeLip-synced facial animation driven by TTS audioWebcam emotion recognition to adapt NPC responsesVoice interaction with NPCs when their face is off-screenPer-game character packs with pre-conversation dialogue filesPlaying games without modding source code
Built With
- Language
- Rust
- Frameworks
- LangChain · SadTalker · Tauri · Rust · Node.js · pnpm · Playwright · WebView2 · CMake
Tags
llm · npc · gaming · voice-interaction · speech-to-text · text-to-speech · facial-animation · computer-vision · emotion-recognition · vector-store · langchain · tauri · desktop-app · rust · mod-free · memory