Feel the Ball
Beyond captions and audio
Commentary and audio can describe a match, but they don't convey the ball's continuous spatial movement, which is an essential part of how play unfolds and where its excitement lives.
From broadcast motion to touch
A Swin Transformer combined with DeconvNet and Long Short-Term Memory tracks small, blurred, fast-moving balls. A psychology-guided haptic method then translates that motion into force feedback through a joystick.
Working prototype
Small, fast ball motion tracked from broadcast video and translated into dynamic force feedback through a joystick.
Explore the Feel the Ball product →ISEF record · SOFT009
Research poster: 93% / 94% tracking precision & recall · ~100 ms haptic latency ↗
View the Feel the Ball ISEF record
Next steps toward deployment
- Recruit fans to test the deployed system live and expand on our validated results.
- Harden tracking reliability and end-to-end latency across more sports, broadcasts, and difficult motion.
- Line up venue and broadcast partners for a production pilot.