Friday, June 15, 2012

Spotted: Small window on a large world -- gyro and face tracking for viewing large imagery on mobile devices


Looking at you: fused gyro and face tracking for viewing large imagery on mobile devices

Neel Joshi, Abhishek Kar, Michael Cohen

We present a touch-free interface for viewing large imagery on mobile devices. In particular, we focus on viewing paradigms for 360 degree panoramas, parallax image sequences, and long multi-perspective panoramas. We describe a sensor fusion methodology that combines face tracking using a front-facing camera with gyroscope data to produce a robust signal that defines the viewer's 3D position relative to the display. The gyroscopic data provides both low-latency feedback and allows extrapolation of the face position beyond the the field-of-view of the front-facing camera. We also demonstrate a hybrid position and rate control that uses the viewer's 3D position to drive exploration of very large image spaces.

No comments:

Post a Comment