Transform conversations with LiveCaptionsXR - the world's first spatially-aware AR captioning app powered entirely by on-device AI.
🎯 Built for the 466 million people with hearing loss worldwide
LiveCaptionsXR goes beyond traditional captioning by anchoring speech in 3D space. Instead of flat text, experience conversations with captions that appear exactly where the speaker is located - like having AI-enhanced spatial hearing.
✨ Revolutionary Features:
Spatial AR Captions - Captions float in 3D space at the speaker's exact location using ARCore
On-Device Privacy - All processing happens on your device. No data ever leaves your phone
Real-Time Hybrid Localization - Advanced AI fuses stereo audio, camera vision, and motion sensors to track speakers with pinpoint accuracy
Powered by Google's Gemma 3n - State-of-the-art on-device AI for intelligent, context-aware transcription
Offline-First Design - Works without internet using Whisper GGML for private speech recognition
🔬 Cutting-Edge Technology:
Built by a deaf developer who understands the challenges firsthand, LiveCaptionsXR combines:
Stereo Audio Direction Estimation using RMS and GCC-PHAT algorithms
Visual Speaker Detection with ML Kit face recognition
Kalman Filter Fusion for rock-solid 3D speaker tracking
Cross-Platform Flutter Architecture for seamless iOS/Android experience
🎮 Perfect For:
XR/AR headset users needing spatial awareness
Conference participants wanting to know who's speaking
Students and professionals in group settings
Anyone seeking private, on-device accessibility solutions
��️ Privacy-First:
Your conversations stay private. All AI processing happens locally on your device using advanced on-device models. No cloud processing, no data collection, no privacy concerns.
🚀 Experience the Future of Accessibility:
Download LiveCaptionsXR today and discover a new way of experiencing conversations - where captions don't just tell you what was said, but show you exactly where and who said it.
Built with ❤️ for the deaf and hard of hearing community