Non-line-of-sight imaging with partial occluders and surface normals

Felix Heide, Matthew O'Toole, Kai Zang, David B. Lindell, Steven Diamond, Gordon Wetzstein

Research output: Contribution to journalArticle

14 Scopus citations

Abstract

Imaging objects obscured by occluders is a significant challenge for many applications. A camera that could “see around corners” could help improve navigation and mapping capabilities of autonomous vehicles or make search and rescue missions more effective. Time-resolved single-photon imaging systems have recently been demonstrated to record optical information of a scene that can lead to an estimation of the shape and reflectance of objects hidden from the line of sight of a camera. However, existing non-line-of-sight (NLOS) reconstruction algorithms have been constrained in the types of light transport effects they model for the hidden scene parts. We introduce a factored NLOS light transport representation that accounts for partial occlusions and surface normals. Based on this model, we develop a factorization approach for inverse time-resolved light transport and demonstrate high-fidelity NLOS reconstructions for challenging scenes both in simulation and with an experimental NLOS imaging system.

Original languageEnglish (US)
Article number22
JournalACM Transactions on Graphics
Volume38
Issue number3
DOIs
StatePublished - Jan 1 2019
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design

Keywords

  • Computational photography
  • Non-line-of-sight imaging

Fingerprint Dive into the research topics of 'Non-line-of-sight imaging with partial occluders and surface normals'. Together they form a unique fingerprint.

  • Cite this

    Heide, F., O'Toole, M., Zang, K., Lindell, D. B., Diamond, S., & Wetzstein, G. (2019). Non-line-of-sight imaging with partial occluders and surface normals. ACM Transactions on Graphics, 38(3), [22]. https://doi.org/10.1145/3269977