Object Detection Based on Hierarchical Multi-view Proposal Network for Autonomous Driving

  • Jianhui Zhao
  • , Xinyu Newman Zhang
  • , Hongbo Gao
  • , Jialun Yin
  • , Mo Zhou
  • , Chuanqi Tan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

To achieve better results on object detection for autonomous vehicle under complex outdoor conditions, we attempt to integrated the sensor-fusion, hierarchical multi-view networks and traditional heuristical method together. The most significant environmental perception sensors for autonomous vehicles are camera and LIDAR. The 2D RGB image and 3D point cloud from camera and LIDAR respectively are utilized. The hierarchical multi-view proposal network (HMVPN) is proposed in this paper, which can effectively fuse the multi-modal information of the camera with LIDAR. As there are several hierarchical network layers in HMVPN, image becomes the input of the primary network for object detection. Moreover, LIDAR data is divided into four projection image (HBV, IBV, HCV, DCV), and then combines its original 3D point cloud into hierarchical second network to generate candidate proposals using machine learning and heuristic methods. Several simulations on the famous autonomous vehicle benchmark of KITTI show that our approach obtains about 20% higher AP than the state-of-the-art methods.

Original languageEnglish
Title of host publication2018 International Joint Conference on Neural Networks, IJCNN 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509060146
DOIs
StatePublished - 10 Oct 2018
Externally publishedYes
Event2018 International Joint Conference on Neural Networks, IJCNN 2018 - Rio de Janeiro, Brazil
Duration: 8 Jul 201813 Jul 2018

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2018-July

Conference

Conference2018 International Joint Conference on Neural Networks, IJCNN 2018
Country/TerritoryBrazil
CityRio de Janeiro
Period8/07/1813/07/18

Keywords

  • Autonomous driving
  • Deep learning
  • Multiview network
  • Sensor fusion

Fingerprint

Dive into the research topics of 'Object Detection Based on Hierarchical Multi-view Proposal Network for Autonomous Driving'. Together they form a unique fingerprint.

Cite this