Depth estimation using an improved stereo network

  • Wanpeng Xu
  • , Ling Zou*
  • , Lingda Wu
  • , Yue Qi
  • , Zhaoyong Qian
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Self-supervised depth estimation approaches present excellent results that are comparable to those of the fully supervised approaches, by employing view synthesis between the target and reference images in the training data. ResNet, which serves as a backbone network, has some structural deficiencies when applied to downstream fields, because its original purpose was to cope with classification problems. The low-texture area also deteriorates the performance. To address these problems, we propose a set of improvements that lead to superior predictions. First, we boost the information flow in the network and improve the ability to learn spatial structures by improving the network structures. Second, we use a binary mask to remove the pixels in low-texture areas between the target and reference images to more accurately reconstruct the image. Finally, we input the target and reference images randomly to expand the dataset and pre-train it on ImageNet, so that the model obtains a favorable general feature representation. We demonstrate state-of-the-art performance on an Eigen split of the KITTI driving dataset using stereo pairs.

Translated title of the contribution基于改进立体网络的深度估计
Original languageEnglish
Pages (from-to)777-789
Number of pages13
JournalFrontiers of Information Technology and Electronic Engineering
Volume23
Issue number5
DOIs
StatePublished - May 2022
Externally publishedYes

Keywords

  • Image reconstruction
  • Monocular depth estimation
  • Self-supervised
  • TP391.4

Fingerprint

Dive into the research topics of 'Depth estimation using an improved stereo network'. Together they form a unique fingerprint.

Cite this