Prototypes Demo

Express · Just Look, Don't Type

For ALS users: a glance becomes meaning

Just Look lets people with ALS communicate by looking at the world instead of spelling on a gaze keyboard. It reads what you look at, uses the surrounding context to understand what you mean, and confirms with a single glance only when it needs to, so a look becomes a message.

Structured VLM · context-aware reasoning · two-stage confirmation

Act · EnAct

For Vision impaired users: guiding a vision-impaired hand to its target

EnAct helps a vision-impaired person reach and grasp everyday objects on their own. It reads the scene in 3D, plans a safe path to the target, and guides the hand turn by turn until it makes contact, keeping clear of obstacles the whole way.

Multi-agent VLMs · YOLO-World · Depth Pro

Sense · Feel the Ball

For Vision impaired users: live ball motion, turned into touch

Feel the Ball lets fans who can't see or hear the game feel the action in real time. It tracks the ball through live broadcast video and drives a force-feedback joystick, turning the ball's speed and direction into motion you feel in your hand.

Swin Transformer · DeconvNet · LSTM · psychology-guided haptics