Abstract
Over the last few years, depth cameras have become increasingly popular for a range of applications, including human-computer interaction and gaming, augmented reality, machine vision, and medical imaging. Many of the commercially-available devices use the time-of-flight principle, where active illumination is temporally coded and analyzed in the camera to estimate a per-pixel depth map of the scene. In this paper, we propose a fundamentally new imaging modality for all time-of-flight (ToF) cameras: per-pixel radial velocity measurement. The proposed technique exploits the Doppler effect of objects in motion, which shifts the temporal illumination frequency before it reaches the camera. Using carefully coded illumination and modulation frequencies of the ToF camera, object velocities directly map to measured pixel intensities. We show that a slight modification of our imaging system allows for color, depth, and velocity information to be captured simultaneously. Combining the optical flow computed on the RGB frames with the measured metric radial velocity allows us to further estimate the full 3D metric velocity field of the scene. The proposed technique has applications in many computer graphics and vision problems, for example motion tracking, segmentation, recognition, and motion deblurring. Copyright is held by the owner/author(s).
Original language | English (US) |
---|---|
Title of host publication | Proceedings of ACM SIGGRAPH 2015 |
Publisher | Association for Computing Machinery |
Volume | 34 |
Edition | 4 |
ISBN (Electronic) | 9781450333313 |
DOIs | |
State | Published - Jul 27 2015 |
Externally published | Yes |
Event | ACM Special Interest Group on Computer Graphics and Interactive Techniques Conference, SIGGRAPH 2015 - Los Angeles, United States Duration: Aug 9 2015 → Aug 13 2015 |
Other
Other | ACM Special Interest Group on Computer Graphics and Interactive Techniques Conference, SIGGRAPH 2015 |
---|---|
Country/Territory | United States |
City | Los Angeles |
Period | 8/9/15 → 8/13/15 |
All Science Journal Classification (ASJC) codes
- Computer Graphics and Computer-Aided Design
Keywords
- Computational photography
- Time-of-flight