Unity project for a 3D conversational avatar with STT, chat, TTS, lip sync, latency telemetry, and a world-space debug panel. The goal is to keep clear architecture, observable flow, and credentials out of the code.
Real-time AI Conversation with Lip-Sync.
It’s a system for Unity that allows for real-time conversations with a 3D (VR enabled) avatar, syncing its lip movements with AI-generated audio.
The code integrates:
- Voice processing and audio streaming.
- Lip-sync animation synchronization.
- A foundation for anyone looking to experiment with conversational avatars in VR.
The goal was to explore how to make VR interactions feel a bit more natural.
The repository is public, so if you’re interested, feel free to check out the code, use it, or suggest improvements. All feedback is welcome.
https://github.com/decea89/RealTimeAIConversationWithLipSync/tree/main
