Skip to main navigation Skip to search Skip to main content

VIPS: Real-Time Perception Fusion for Infrastructure-Assisted Autonomous Driving

  • Chinese University of Hong Kong
  • Beihang University
  • Beihang Hangzhou Innovation Institute

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Infrastructure-Assisted autonomous driving is an emerging paradigm that expects to significantly improve the driving safety of autonomous vehicles. The key enabling technology for this vision is to fuse LiDAR results from the roadside infrastructure and the vehicle to improve the vehicle's perception in real time. In this work, we propose VIPS, a novel lightweight system that can achieve decimeter-level and real-Time (up to 100 ms) perception fusion between driving vehicles and roadside infrastructure. The key idea of VIPS is to exploit highly efficient matching of graph structures that encode objects' lean representations as well as their relationships, such as locations, semantics, sizes, and spatial distribution. Moreover, by leveraging the tracked motion trajectories, VIPS can maintain the spatial and temporal consistency of the scene, which effectively mitigates the impact of asynchronous data frames and unpredictable communication/compute delays. We implement VIPS end-To-end based on a campus smart lamppost testbed. To evaluate the performance of VIPS under diverse situations, we also collect two new multi-view point cloud datasets using the smart lamppost testbed and an autonomous driving simulator, respectively. Experiment results show that VIPS can extend the vehicle's perception range by 140% within 58 ms on average, and delivers a 4X improvement in perception fusion accuracy and 47X data transmission saving over existing approaches.

Original languageEnglish
Title of host publicationACM MobiCom 2022 - Proceedings of the 2022 28th Annual International Conference on Mobile Computing and Networking
PublisherAssociation for Computing Machinery
Pages133-146
Number of pages14
ISBN (Electronic)9781450391818
DOIs
StatePublished - 14 Oct 2022
Event28th ACM Annual International Conference on Mobile Computing and Networking, MobiCom 2022 - Sydney, Australia
Duration: 17 Oct 220221 Oct 2202

Publication series

NameProceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM
ISSN (Print)1543-5679

Conference

Conference28th ACM Annual International Conference on Mobile Computing and Networking, MobiCom 2022
Country/TerritoryAustralia
CitySydney
Period17/10/0221/10/02

Keywords

  • infrastructure-Assisted autonomous driving
  • perception fusion
  • vehicle mobility
  • vehicle-infrastructure information fusion

Fingerprint

Dive into the research topics of 'VIPS: Real-Time Perception Fusion for Infrastructure-Assisted Autonomous Driving'. Together they form a unique fingerprint.

Cite this