HyperSight: Boosting Distant 3D Vision on a Single Dual-camera Smartphone

Zifan Liu, Hongzi Zhu, Junchi Chen, Shan Chang and Lili Qiu

in Proceedings of ACM SenSys 2019, New York, NY, USA.

Smartphones with dual cameras are increasingly popular due to the need of supporting 3D vision. The depth information is critical for 3D vision. However, the two cameras on a smartphone are too close to accurately estimate the depth information especially for objects beyond two meters. In this paper, we propose an innovative system, called HyperSight, to estimate the depth information of objects using a dual camera smartphone. HyperSight realizes a virtual long-baseline stereo vision rig by having a user to move the phone in the air. The phone movement is continuously tracked and estimated using the short-baseline dual camera seeing nearby objects. We implement HyperSight as software on a Commercial-Off-The-Shelf (COTS) smartphone and conduct real-world experiments. The results show that when measuring objects at a distance of five meters, HyperSight achieves a mean depth error of 6cm, which is 10× and 18× improvement in the accuracy compared with the stereo vision system using the native dual cameras and the state-of-the-art Simultaneous Localization and Mapping (SLAM) technique on mobile devices, respectively.


Page View: 1578