TY - JOUR
T1 - Computational imaging with multi-camera time-of-flight systems
AU - Shrestha, Shikhar
AU - Heide, Felix
AU - Heidrich, Wolfgang
AU - Wetzstein, Gordon
N1 - Funding Information:
This work was generously supported by the National Science Foundation under grant IIS 1553333, by the NSF/Intel Partnership on Visual and Experiential Computing (NSF IIS 1539120), by the KAUST Office of Sponsored Research through the Visual Computing Center CCF grant, and by Intuitive Surgica
Publisher Copyright:
© 2016 ACM.
PY - 2016/7/11
Y1 - 2016/7/11
N2 - Depth cameras are a ubiquitous technology used in a wide range of applications, including robotic and machine vision, human computer interaction, autonomous vehicles as well as augmented and virtual reality. In this paper, we explore the design and applications of phased multi-camera time-of-flight (ToF) systems. We develop a reproducible hardware system that allows for the exposure times and waveforms of up to three cameras to be synchronized. Using this system, we analyze waveform interference between multiple light sources in ToF applications and propose simple solutions to this problem. Building on the concept of orthogonal frequency design, we demonstrate state-of-the-art results for instantaneous radial velocity capture via Doppler time-of-flight imaging and we explore new directions for optically probing global illumination, for example by de-scattering dynamic scenes and by non-line-of-sight motion detection via frequency gating.
AB - Depth cameras are a ubiquitous technology used in a wide range of applications, including robotic and machine vision, human computer interaction, autonomous vehicles as well as augmented and virtual reality. In this paper, we explore the design and applications of phased multi-camera time-of-flight (ToF) systems. We develop a reproducible hardware system that allows for the exposure times and waveforms of up to three cameras to be synchronized. Using this system, we analyze waveform interference between multiple light sources in ToF applications and propose simple solutions to this problem. Building on the concept of orthogonal frequency design, we demonstrate state-of-the-art results for instantaneous radial velocity capture via Doppler time-of-flight imaging and we explore new directions for optically probing global illumination, for example by de-scattering dynamic scenes and by non-line-of-sight motion detection via frequency gating.
KW - Computational photography
KW - Light fields
KW - Time-of-flight
UR - http://www.scopus.com/inward/record.url?scp=84980019064&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84980019064&partnerID=8YFLogxK
U2 - 10.1145/2897824.2925928
DO - 10.1145/2897824.2925928
M3 - Conference article
AN - SCOPUS:84980019064
SN - 0730-0301
VL - 35
JO - ACM Transactions on Computer Systems
JF - ACM Transactions on Computer Systems
IS - 4
M1 - a33
T2 - ACM SIGGRAPH 2016
Y2 - 24 July 2016 through 28 July 2016
ER -