TY - GEN
T1 - Counter-Encirclement of UAV in Pursuit-Evasion Environment via Improved RL
AU - Niu, Yafei
AU - Tian, Yongxiao
AU - Wang, Qing
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - This paper proposes a counter-encirclement method for evasive Unmanned Aerial Vehicle (UAV) within a successful capture environment via reinforcement learning. An improved Deep Deterministic Policy Gradient (DDPG) algorithm was utilized to train the actions of the evasive UAV, enabling it to successfully evade capture while simultaneously avoiding collisions. Additionally, adversarial modeling and the design of reward functions are conducted for both the pursuing UAVs and the evasive UAV. Finally, the improved DDPG algorithm was evaluated through simulations for its effectiveness in enhancing the escape performance of evading UAVs, demonstrating its efficacy in evasion scenarios within encirclement contexts.
AB - This paper proposes a counter-encirclement method for evasive Unmanned Aerial Vehicle (UAV) within a successful capture environment via reinforcement learning. An improved Deep Deterministic Policy Gradient (DDPG) algorithm was utilized to train the actions of the evasive UAV, enabling it to successfully evade capture while simultaneously avoiding collisions. Additionally, adversarial modeling and the design of reward functions are conducted for both the pursuing UAVs and the evasive UAV. Finally, the improved DDPG algorithm was evaluated through simulations for its effectiveness in enhancing the escape performance of evading UAVs, demonstrating its efficacy in evasion scenarios within encirclement contexts.
KW - UAV swarm
KW - adversarial modeling
KW - counter-encirclement
KW - reinforcement learning
UR - https://www.scopus.com/pages/publications/85218060382
U2 - 10.1109/ICUS61736.2024.10840004
DO - 10.1109/ICUS61736.2024.10840004
M3 - 会议稿件
AN - SCOPUS:85218060382
T3 - Proceedings of 2024 IEEE International Conference on Unmanned Systems, ICUS 2024
SP - 266
EP - 271
BT - Proceedings of 2024 IEEE International Conference on Unmanned Systems, ICUS 2024
A2 - Song, Rong
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2024 IEEE International Conference on Unmanned Systems, ICUS 2024
Y2 - 18 October 2024 through 20 October 2024
ER -