Skip to main navigation Skip to search Skip to main content

基于DQN的海战场舰船路径规划及仿真

Translated title of the contribution: DQN-based Path Planning Method and Simulation for Submarine and Warship in Naval Battlefield
  • Xiaodong Huang
  • , Haitao Yuan
  • , Jing Bi*
  • , Tao Liu
  • *Corresponding author for this work
  • Naval Aeronautical University
  • Beijing University of Technology
  • Beijing Jiaotong University

Research output: Contribution to journalArticlepeer-review

Abstract

To realize multi-agent intelligent planning and target tracking in complex naval battlefield environment, the work focuses on agents (submarine or warship), and proposes a simulation method based on reinforcement learning algorithm called Deep Q Network (DQN). Two neural networks with the same structure and different parameters are designed to update real and predicted Q values for the convergence of value functions. An ε-greedy algorithm is proposed to design an action selection mechanism, and a reward function is designed for the naval battlefield environment to increase the update velocity and generalization ability of Learning with Experience Replay (LER). Simulation results show that compared with existing path routing algorithms and multi-agent path routing algorithms, each agent can effectively avoid obstacles in unfamiliar environments and achieve more intelligent path planning and target tracking through a certain number of steps of learning.

Translated title of the contributionDQN-based Path Planning Method and Simulation for Submarine and Warship in Naval Battlefield
Original languageChinese (Traditional)
Pages (from-to)2440-2448
Number of pages9
JournalXitong Fangzhen Xuebao / Journal of System Simulation
Volume33
Issue number10
DOIs
StatePublished - 18 Oct 2021

Fingerprint

Dive into the research topics of 'DQN-based Path Planning Method and Simulation for Submarine and Warship in Naval Battlefield'. Together they form a unique fingerprint.

Cite this