TY - JOUR
T1 - Time-Lapse Photometric Stereo and Applications
AU - Shen, Fangyang
AU - Sunkavalli, Kalyan
AU - Bonneel, Nicolas
AU - Rusinkiewicz, Szymon
AU - Pfister, Hanspeter
AU - Tong, Xin
N1 - Publisher Copyright:
© 2014 The Author(s) Computer Graphics Forum © 2014 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd.
PY - 2014/10/1
Y1 - 2014/10/1
N2 - This paper presents a technique to recover geometry from time-lapse sequences of outdoor scenes. We build upon photometric stereo techniques to recover approximate shadowing, shading and normal components allowing us to alter the material and normals of the scene. Previous work in analyzing such images has faced two fundamental difficulties: 1. The illumination in outdoor images consists of time-varying sunlight and skylight, and 2. The motion of the sun is restricted to a near-planar arc through the sky, making surface normal recovery unstable. We develop methods to estimate the reflection component due to skylight illumination. We also show that sunlight directions are usually non-planar, thus making surface normal recovery possible. This allows us to estimate approximate surface normals for outdoor scenes using a single day of data. We demonstrate the use of these surface normals for a number of image editing applications including reflectance, lighting, and normal editing.
AB - This paper presents a technique to recover geometry from time-lapse sequences of outdoor scenes. We build upon photometric stereo techniques to recover approximate shadowing, shading and normal components allowing us to alter the material and normals of the scene. Previous work in analyzing such images has faced two fundamental difficulties: 1. The illumination in outdoor images consists of time-varying sunlight and skylight, and 2. The motion of the sun is restricted to a near-planar arc through the sky, making surface normal recovery unstable. We develop methods to estimate the reflection component due to skylight illumination. We also show that sunlight directions are usually non-planar, thus making surface normal recovery possible. This allows us to estimate approximate surface normals for outdoor scenes using a single day of data. We demonstrate the use of these surface normals for a number of image editing applications including reflectance, lighting, and normal editing.
UR - http://www.scopus.com/inward/record.url?scp=84939453666&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84939453666&partnerID=8YFLogxK
U2 - 10.1111/cgf.12504
DO - 10.1111/cgf.12504
M3 - Article
AN - SCOPUS:84939453666
SN - 0167-7055
VL - 33
SP - 359
EP - 367
JO - Computer Graphics Forum
JF - Computer Graphics Forum
IS - 7
ER -