Skip to main navigation Skip to search Skip to main content

Towards Unbiased Volume Rendering of Neural Implicit Surfaces with Geometry Priors

  • Yongqiang Zhang
  • , Zhipeng Hu
  • , Haoqian Wu
  • , Minda Zhao
  • , Lincheng Li*
  • , Zhengxia Zou
  • , Changjie Fan
  • *Corresponding author for this work
  • NetEase Fuxi AI Lab

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Learning surface by neural implicit rendering has been a promising way for multi-view reconstruction in recent years. Existing neural surface reconstruction methods, such as NeuS [24] and VolSDF [32], can produce reliable meshes from multi-view posed images. Although they build a bridge between volume rendering and Signed Distance Function (SDF), the accuracy is still limited. In this paper, we argue that this limited accuracy is due to the bias of their volume rendering strategies, especially when the viewing direction is close to be tangent to the surface. We revise and provide an additional condition for the unbiased volume rendering. Following this analysis, we propose a new rendering method by scaling the SDF field with the angle between the viewing direction and the surface normal vector. Experiments on simulated data indicate that our rendering method reduces the bias of SDF-based volume rendering. Moreover, there still exists non-negligible bias when the learnable standard deviation of SDF is large at early stage, which means that it is hard to supervise the rendered depth with depth priors. Alternatively we supervise zero-level set with surface points obtained from a pre-trained Multi-View Stereo network. We evaluate our method on the DTU dataset and show that it outperforms the state-of-the-arts neural implicit surface methods without mask supervision.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023
PublisherIEEE Computer Society
Pages4359-4368
Number of pages10
ISBN (Electronic)9798350301298
ISBN (Print)9798350301298
DOIs
StatePublished - 2023
Event2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023 - Vancouver, Canada
Duration: 18 Jun 202322 Jun 2023

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume2023-June
ISSN (Print)1063-6919

Conference

Conference2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023
Country/TerritoryCanada
CityVancouver
Period18/06/2322/06/23

Keywords

  • 3D from multi-view and sensors

Fingerprint

Dive into the research topics of 'Towards Unbiased Volume Rendering of Neural Implicit Surfaces with Geometry Priors'. Together they form a unique fingerprint.

Cite this