Skip to main navigation Skip to search Skip to main content

YOLOv8-Pointcloud-SLAM3: Visual Dense Point Cloud SLAM for Robot Navigation in Dynamic Environments

  • Xuehui Wang
  • , Junbo Dong
  • , Fengyi Zhang
  • , Yongjun Xie*
  • , Pei Jia
  • , Peiyu Wu
  • *Corresponding author for this work
  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Simultaneous Localization and Mapping (SLAM) has received widespread attention in fields such as intelligent robots and autonomous driving. However, many current SLAM systems fail to achieve high positioning accuracy when dealing with moving objects in dynamic environments. Furthermore, many SLAM systems still rely on sparse point clouds, which hinder robots from fully comprehending their surroundings and completing advanced tasks. To address these challenges, this paper proposes YOLOv8-Pointcloud-SLAM3, a visual dense point cloud SLAM approach for robot navigation in dynamic environments. Building upon the ORB-SLAM3 system, the current high-recognition-accuracy deep learning network YOLOv8s is introduced, combined with geometric movement consistency check. Semantic segmentation threads are added to remove dynamic objects, and a 3D dense point cloud thread is also employed, which utilizes dilation masks to eliminate the 'ghosting shadow' effect caused by the edges of dynamic object mask edges. Extensive tests on the TUM dataset demonstrates that our proposed YOLOv8-Pointcloud-SLAM3 outperforms current mainstream SLAM systems in both trajectory error and position estimation accuracy.

Original languageEnglish
Title of host publication2024 5th International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages556-562
Number of pages7
ISBN (Electronic)9798331518677
DOIs
StatePublished - 2024
Event5th International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2024 - Wuhan, China
Duration: 8 Nov 202410 Nov 2024

Publication series

Name2024 5th International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2024

Conference

Conference5th International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2024
Country/TerritoryChina
CityWuhan
Period8/11/2410/11/24

Keywords

  • Dynamic environments
  • ORB-SLAM3
  • SLAM
  • Semantic Segmentation
  • YOLOv8

Fingerprint

Dive into the research topics of 'YOLOv8-Pointcloud-SLAM3: Visual Dense Point Cloud SLAM for Robot Navigation in Dynamic Environments'. Together they form a unique fingerprint.

Cite this