Skip to main navigation Skip to search Skip to main content

Automatic Control of Unmanned Vehicles Based on Deep Reinforcement Learning and YOLO Algorithm Using Airsim Simulation

  • Xiulin Zhang
  • , Xiaolei Qu
  • , Shuting Yang
  • , Junbiao Dong
  • , Jingcheng Zhang
  • , Ke Li*
  • *Corresponding author for this work
  • Avic Shenyang Aircraft Design and Research Institute
  • Northwestern Polytechnical University Xian
  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Through the comparative investigation of the existing research on the UAV distribution center these years, our group selected unmanned vehicles as the carrier for the UAV distribution, used to collect and transport the UAV, and at the same time carried out functional splitting for the application workflow, realized the autonomous navigation and obstacle avoidance of the UAV, the UAV mobile object landed, the unmanned vehicle autonomous navigation, the obstacle avoidance, mobile object recognition, tracking and gesture recognition a total of five main functional modules. In this paper, the two modules of autonomous navigation, obstacle avoidance, and object detection of unmanned vehicles in a simulation environment are introduced. In particular, the paper focuses on the experimental methods and results of AirSim-based autonomous vehicle self-driving simulation through Deep Reinforcement Learning under the UE4 engine, analyzes the simulation results and puts forward the corresponding optimization ideas, and introduces the object detection method and concrete implementation details based on YOLO algorithm. A more complete solution is provided for the unmanned vehicle part of the UAV distribution center management dilemma. From the simulation results, the Deep Q Network itself and simulation environment used in this paper are suitable for verification of unmanned vehicle control, through a certain period of training, the neural network could make stable decisions for unmanned vehicles reaching the destination in a specific indoor simulation environment. The verification of the unmanned vehicle provides a solid foundation for the implementation of the technologies in the UAV distribution center.

Original languageEnglish
Title of host publicationMan-Machine-Environment System Engineering - Proceedings of the 24th Conference on MMESE
EditorsShengzhao Long, Balbir S. Dhillon, Long Ye
PublisherSpringer Science and Business Media Deutschland GmbH
Pages548-554
Number of pages7
ISBN (Print)9789819771387
DOIs
StatePublished - 2024
Event24th Conference on Man-Machine-Environment System Engineering, MMESE 2024 - Beijing, China
Duration: 18 Oct 202420 Oct 2024

Publication series

NameLecture Notes in Electrical Engineering
Volume1256 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference24th Conference on Man-Machine-Environment System Engineering, MMESE 2024
Country/TerritoryChina
CityBeijing
Period18/10/2420/10/24

Keywords

  • Autonomous Driving
  • Deep Reinforcement Learning
  • Distribution Centers
  • Object Detection
  • UAV
  • YOLO

Fingerprint

Dive into the research topics of 'Automatic Control of Unmanned Vehicles Based on Deep Reinforcement Learning and YOLO Algorithm Using Airsim Simulation'. Together they form a unique fingerprint.

Cite this