TY - GEN
T1 - Bidirectional shadow rendering for interactive mixed 360° videos
AU - Wang, Lili
AU - Wang, Hao
AU - Dai, Danqing
AU - Leng, Jiaye
AU - Han, Xiaoguang
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/3
Y1 - 2021/3
N2 - In this paper, we provide a bidirectional shadow rendering method to render shadows between real and virtual objects in the 360° videos in real time. We construct a 3D scene approximation from the current output viewpoint to approximate the real scene geometry nearby in the video. Then, we propose a ray casting based algorithm to determine the shadow regions on the virtual objects cast by the real objects. After that, we introduce an object-aware shadow mapping method to cast shadows from virtual objects to real objects. Finally, we use a shadow intensity estimation algorithm to determine the shadow intensity of virtual objects and real objects to obtain shadows consistent with the input 360° video. The experiment results prove the effectiveness of our bidirectional shadow rendering method for mixed 360° videos. Our method can generate visually realistic shadows for virtual objects and real objects in 360° video in realtime, and make virtual objects more natural to integrate with real scenes in 360° videos of the mixed reality applications.
AB - In this paper, we provide a bidirectional shadow rendering method to render shadows between real and virtual objects in the 360° videos in real time. We construct a 3D scene approximation from the current output viewpoint to approximate the real scene geometry nearby in the video. Then, we propose a ray casting based algorithm to determine the shadow regions on the virtual objects cast by the real objects. After that, we introduce an object-aware shadow mapping method to cast shadows from virtual objects to real objects. Finally, we use a shadow intensity estimation algorithm to determine the shadow intensity of virtual objects and real objects to obtain shadows consistent with the input 360° video. The experiment results prove the effectiveness of our bidirectional shadow rendering method for mixed 360° videos. Our method can generate visually realistic shadows for virtual objects and real objects in 360° video in realtime, and make virtual objects more natural to integrate with real scenes in 360° videos of the mixed reality applications.
KW - Mixed reality-360°
KW - Videos-Shadow rendering
UR - https://www.scopus.com/pages/publications/85106488187
U2 - 10.1109/VR50410.2021.00038
DO - 10.1109/VR50410.2021.00038
M3 - 会议稿件
AN - SCOPUS:85106488187
T3 - Proceedings - 2021 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2021
SP - 170
EP - 178
BT - Proceedings - 2021 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 28th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2021
Y2 - 27 March 2021 through 3 April 2021
ER -