Authors: Yang Zhao, Ziyun Li, Yonggan Fu, Yongan Zhang, Chaojian Li, Cheng Wan, Haoran You, Shang Wu, Xu Ouyang, Vivek Boominathan, Ashok Veeraraghavan, Yingyan Lin

Published on: June 15, 2022

Impact Score: 7.8

Arxiv code: Arxiv:2206.08141

Summary

• What is new: The introduction of i-FlatCam, the first ultra-compact, lensless intelligent camera system with a dedicated eye tracking pipeline.
• Why this is important: The need for more compact and efficient camera systems for augmented reality (AR) and virtual reality (VR) applications without sacrificing accuracy.
• What the research proposes: i-FlatCam solves this by integrating a lensless camera with a computational chip, employing a predict-then-focus eye tracking pipeline and a unified compression scheme.
• Results: Achieved 3.16 degrees of accuracy, 253 FPS, 91.49 μJ/Frame, and an extremely compact form factor (6.7mm x 8.9mm x 1.2mm).

Technical Details

Technological frameworks used: nan

Models used: Predict-then-focus pipeline, unified compression scheme, intra-channel reuse design for DW-CONV.

Data used: nan

Potential Impact

Augmented Reality (AR), Virtual Reality (VR) device manufacturers, and possibly broader mobile and wearable device markets.

Want to implement this idea in a business?

We have generated a startup concept here: Visionary Tracking.