Encourage the use of non-visual sensory cues (touch, sound).
: Integrated with commercial smart glasses, Vid2Coach uses a wearable camera to monitor the user's progress. It provides proactive feedback, ensuring the user stays on track and safely completes the task. Real-World Impact vid2coach top
is an innovative AI system that transforms standard how-to videos into interactive, wearable task assistants. Developed by researchers at organizations like the University of Texas at Austin , it primarily aids blind and low-vision (BLV) individuals by providing real-time, context-aware guidance through smart glasses. Encourage the use of non-visual sensory cues (touch, sound)
: Select a "how-to" video. The system automatically processes it to generate instructions and completion criteria. Real-World Impact is an innovative AI system that
In clinical studies, participants using Vid2Coach to complete complex cooking tasks made 58.5% fewer errors
This isn't just about replacing vision—it's about strengthening independence with AI that truly understands the task at hand.