Skip to main navigation Skip to search Skip to main content

Occlusion-aware depth estimation for light field using multi-orientation EPIs

  • Hao Sheng
  • , Pan Zhao
  • , Shuo Zhang*
  • , Jun Zhang
  • , Da Yang
  • *Corresponding author for this work
  • Beihang University
  • University of Wisconsin-Milwaukee

Research output: Contribution to journalArticlepeer-review

Abstract

Epipolar plane images (EPIs) contain special linear structures that reflect the disparity of a 3D point and are widely used in light field depth estimation. However, previous EPI-based approaches only utilize horizontal and vertical EPIs to estimate local disparities and ignore diagonal directions. In order to make full use of the regular grid light field images, we develop a strategy to extract epipolar plane images in all available directions. Based on the multi-orientation EPIs, a specific EPI in which the point is not occluded is found and used to calculate robust depth estimation. We also design a novel framework to estimate the depth information which combines the local depth with edge orientation. The multi-orientation EPIs and optimal orientation selection are proved to be effective in detecting and excluding occlusions. Experimental results show that the proposed method outperforms state-of-the-art depth estimation methods, especially near occlusion boundaries.

Original languageEnglish
Pages (from-to)587-599
Number of pages13
JournalPattern Recognition
Volume74
DOIs
StatePublished - Feb 2018

Keywords

  • Depth estimation
  • Light field
  • Multi-orientation EPIs
  • Occlusion analysis

Fingerprint

Dive into the research topics of 'Occlusion-aware depth estimation for light field using multi-orientation EPIs'. Together they form a unique fingerprint.

Cite this