TY - GEN
T1 - A Precomputed Atmosphere Differentiable Renderer for Estimating Outdoor Illumination
AU - Cen, Yunchi
AU - Yan, Xianglong
AU - Jin, Song
AU - Liang, Xiaohui
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Estimating outdoor illumination from images requires modeling the complex phenomena of atmospheric scattering. Existing methods either depend on known scene geometry or multi-view images, limiting their applicability. This work presents a differentiable renderer tailored for atmospheric scattering to recover outdoor illumination from a single image. We first construct a physics-based atmospheric scattering model to establish the analytical mapping from the sun's zenith angle to sky appearances. We propose a pre-computation scheme to cache intermediate atmospheric transmittance, scattered radiance, and ground-reflected radiance for efficient gradient-based optimization. Their gradients of the sun's zenith angle can also be precomputed and stored in derivative tables. The desired gradients can be quickly retrieved at render time to guide the optimization. Experiments on sky image rendering and illumination estimation demonstrate that our method can recover plausible outdoor illumination from a single photograph. Without the need for scene geometry or multi-view inputs, the proposed differentiable rendering framework provides an efficient way to estimate outdoor illumination.
AB - Estimating outdoor illumination from images requires modeling the complex phenomena of atmospheric scattering. Existing methods either depend on known scene geometry or multi-view images, limiting their applicability. This work presents a differentiable renderer tailored for atmospheric scattering to recover outdoor illumination from a single image. We first construct a physics-based atmospheric scattering model to establish the analytical mapping from the sun's zenith angle to sky appearances. We propose a pre-computation scheme to cache intermediate atmospheric transmittance, scattered radiance, and ground-reflected radiance for efficient gradient-based optimization. Their gradients of the sun's zenith angle can also be precomputed and stored in derivative tables. The desired gradients can be quickly retrieved at render time to guide the optimization. Experiments on sky image rendering and illumination estimation demonstrate that our method can recover plausible outdoor illumination from a single photograph. Without the need for scene geometry or multi-view inputs, the proposed differentiable rendering framework provides an efficient way to estimate outdoor illumination.
KW - atmospheric scattering
KW - differentiable rendering
KW - illumination estimation
UR - https://www.scopus.com/pages/publications/85186768850
U2 - 10.1109/CSECS60003.2023.10428177
DO - 10.1109/CSECS60003.2023.10428177
M3 - 会议稿件
AN - SCOPUS:85186768850
T3 - 2023 6th International Conference on Software Engineering and Computer Science, CSECS 2023
BT - 2023 6th International Conference on Software Engineering and Computer Science, CSECS 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 6th International Conference on Software Engineering and Computer Science, CSECS 2023
Y2 - 22 December 2023 through 24 December 2023
ER -