TY - GEN
T1 - Automatic Control of Unmanned Vehicles Based on Deep Reinforcement Learning and YOLO Algorithm Using Airsim Simulation
AU - Zhang, Xiulin
AU - Qu, Xiaolei
AU - Yang, Shuting
AU - Dong, Junbiao
AU - Zhang, Jingcheng
AU - Li, Ke
N1 - Publisher Copyright:
© Beijing KeCui Man-Machine-Environment System Engineering Technology Research Academy 2024.
PY - 2024
Y1 - 2024
N2 - Through the comparative investigation of the existing research on the UAV distribution center these years, our group selected unmanned vehicles as the carrier for the UAV distribution, used to collect and transport the UAV, and at the same time carried out functional splitting for the application workflow, realized the autonomous navigation and obstacle avoidance of the UAV, the UAV mobile object landed, the unmanned vehicle autonomous navigation, the obstacle avoidance, mobile object recognition, tracking and gesture recognition a total of five main functional modules. In this paper, the two modules of autonomous navigation, obstacle avoidance, and object detection of unmanned vehicles in a simulation environment are introduced. In particular, the paper focuses on the experimental methods and results of AirSim-based autonomous vehicle self-driving simulation through Deep Reinforcement Learning under the UE4 engine, analyzes the simulation results and puts forward the corresponding optimization ideas, and introduces the object detection method and concrete implementation details based on YOLO algorithm. A more complete solution is provided for the unmanned vehicle part of the UAV distribution center management dilemma. From the simulation results, the Deep Q Network itself and simulation environment used in this paper are suitable for verification of unmanned vehicle control, through a certain period of training, the neural network could make stable decisions for unmanned vehicles reaching the destination in a specific indoor simulation environment. The verification of the unmanned vehicle provides a solid foundation for the implementation of the technologies in the UAV distribution center.
AB - Through the comparative investigation of the existing research on the UAV distribution center these years, our group selected unmanned vehicles as the carrier for the UAV distribution, used to collect and transport the UAV, and at the same time carried out functional splitting for the application workflow, realized the autonomous navigation and obstacle avoidance of the UAV, the UAV mobile object landed, the unmanned vehicle autonomous navigation, the obstacle avoidance, mobile object recognition, tracking and gesture recognition a total of five main functional modules. In this paper, the two modules of autonomous navigation, obstacle avoidance, and object detection of unmanned vehicles in a simulation environment are introduced. In particular, the paper focuses on the experimental methods and results of AirSim-based autonomous vehicle self-driving simulation through Deep Reinforcement Learning under the UE4 engine, analyzes the simulation results and puts forward the corresponding optimization ideas, and introduces the object detection method and concrete implementation details based on YOLO algorithm. A more complete solution is provided for the unmanned vehicle part of the UAV distribution center management dilemma. From the simulation results, the Deep Q Network itself and simulation environment used in this paper are suitable for verification of unmanned vehicle control, through a certain period of training, the neural network could make stable decisions for unmanned vehicles reaching the destination in a specific indoor simulation environment. The verification of the unmanned vehicle provides a solid foundation for the implementation of the technologies in the UAV distribution center.
KW - Autonomous Driving
KW - Deep Reinforcement Learning
KW - Distribution Centers
KW - Object Detection
KW - UAV
KW - YOLO
UR - https://www.scopus.com/pages/publications/85206181251
U2 - 10.1007/978-981-97-7139-4_76
DO - 10.1007/978-981-97-7139-4_76
M3 - 会议稿件
AN - SCOPUS:85206181251
SN - 9789819771387
T3 - Lecture Notes in Electrical Engineering
SP - 548
EP - 554
BT - Man-Machine-Environment System Engineering - Proceedings of the 24th Conference on MMESE
A2 - Long, Shengzhao
A2 - Dhillon, Balbir S.
A2 - Ye, Long
PB - Springer Science and Business Media Deutschland GmbH
T2 - 24th Conference on Man-Machine-Environment System Engineering, MMESE 2024
Y2 - 18 October 2024 through 20 October 2024
ER -