Skip to main navigation Skip to search Skip to main content

Novel View Synthesis Under Large-Deviation Viewpoint for Autonomous Driving

  • Xin Ma
  • , Jiguang Zhang
  • , Peng Lu*
  • , Shibiao Xu
  • , Chengwei Pan
  • *Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

Novel view synthesis is a critical task in autonomous driving. Although 3D Gaussian Splatting (3D-GS) has shown success in generating novel views, it faces challenges in maintaining high-quality rendering when viewpoints deviate significantly from the training set. This difficulty primarily stems from complex lighting conditions and geometric inconsistencies in texture-less regions. To address these issues, we propose an attention-based illumination model that leverages light fields from neighboring views, enhancing the realism of synthesized images. Additionally, we propose a geometry optimization method using planar homography to improve geometric consistency in texture-less regions. Our experiments demonstrate substantial improvements in synthesis quality for large-deviation viewpoints, validating the effectiveness of our approach.

Original languageEnglish
Pages (from-to)6000-6008
Number of pages9
JournalProceedings of the AAAI Conference on Artificial Intelligence
Volume39
Issue number6
DOIs
StatePublished - 11 Apr 2025
Event39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025 - Philadelphia, United States
Duration: 25 Feb 20254 Mar 2025

Fingerprint

Dive into the research topics of 'Novel View Synthesis Under Large-Deviation Viewpoint for Autonomous Driving'. Together they form a unique fingerprint.

Cite this