Skip to main navigation Skip to search Skip to main content

Maneuver Decision Making for Multi-aircraft Air Combat Based on Reinforcement Learning with Attention Mechanism

  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper studies the problem of maneuver decision-making for multi-aircraft air combat. First, considering pertinent air combat scenarios, the aircraft model and the air combat attack zone are established. Then, the Attention Mechanism (AM) is introduced to improve the convergence speed of the Proximal Policy Optimization (PPO) algorithm. Moreover, we design a maneuver decision-making model for multi-aircraft air combat based on the proposed AM-PPO algorithm. Finally, through 3v3 air combat simulation experiments, this paper validates the AM-PPO algorithm against the classical PPO algorithm in terms of convergence speed and stability. The simulation results further illustrate that the proposed algorithm can effectively control the aircraft to execute strategic maneuvers against opponents while avoiding friendly aircraft.

Original languageEnglish
Title of host publicationAdvances in Guidance, Navigation and Control - Proceedings of 2024 International Conference on Guidance, Navigation and Control Volume 11
EditorsLiang Yan, Haibin Duan, Yimin Deng
PublisherSpringer Science and Business Media Deutschland GmbH
Pages585-594
Number of pages10
ISBN (Print)9789819622399
DOIs
StatePublished - 2025
EventInternational Conference on Guidance, Navigation and Control, ICGNC 2024 - Changsha, China
Duration: 9 Aug 202411 Aug 2024

Publication series

NameLecture Notes in Electrical Engineering
Volume1347 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

ConferenceInternational Conference on Guidance, Navigation and Control, ICGNC 2024
Country/TerritoryChina
CityChangsha
Period9/08/2411/08/24

Keywords

  • Attention Mechanism
  • Deep reinforcement learning
  • maneuver decision

Fingerprint

Dive into the research topics of 'Maneuver Decision Making for Multi-aircraft Air Combat Based on Reinforcement Learning with Attention Mechanism'. Together they form a unique fingerprint.

Cite this