TY - JOUR
T1 - Manned and Unmanned Aerial Vehicles Cooperative Combat Framework Based on Large Language Models
AU - Shi, Hanyue
AU - Li, Shaowei
AU - Huang, Zian
AU - Li, Shida
AU - Li, Ang
AU - Zhou, Yaoming
N1 - Publisher Copyright:
© 2024, International Council of the Aeronautical Sciences. All rights reserved.
PY - 2024
Y1 - 2024
N2 - The collaborative combat of manned and unmanned aerial vehicles is one of the principal directions for the future development of aerial combat systems, facing the challenge of excessive decision-making and operational burdens on pilots during UAV control. This paper proposes a novel framework for the collaborative combat of manned and unmanned aerial vehicles, incorporating large language model(LLM) into the process of aircraft pilots commanding and controlling multiple unmanned aerial vehicles (UAVs). The framework utilizes LLM for complex semantic understanding and monitoring of task instruction execution. It allows pilots to issue task instructions to UAVs using non-standard natural language. The received natural language task instructions are matched with the preloaded policy library of the designed task executor in UAVs, and an appropriate policy is selected for execution. During task execution, UAVs provide feedback on the task execution status to manned aircraft at key nodes, and continue task execution upon confirmation by manned aircraft until task completion or receipt of new task instructions. The framework is tested in typical beyond-visual-range combat scenarios of manned and unmanned aerial vehicle collaboration. It exhibits good human-machine interaction, robustness, trustworthiness, explainability, and effectively reducing the decision-making and operational burdens on pilots. The research findings of this paper can be widely applied to various task scenarios where humans and robots collaborate to accomplish tasks, providing a feasible technical route for the collaborative combat of manned and unmanned aerial vehicles.
AB - The collaborative combat of manned and unmanned aerial vehicles is one of the principal directions for the future development of aerial combat systems, facing the challenge of excessive decision-making and operational burdens on pilots during UAV control. This paper proposes a novel framework for the collaborative combat of manned and unmanned aerial vehicles, incorporating large language model(LLM) into the process of aircraft pilots commanding and controlling multiple unmanned aerial vehicles (UAVs). The framework utilizes LLM for complex semantic understanding and monitoring of task instruction execution. It allows pilots to issue task instructions to UAVs using non-standard natural language. The received natural language task instructions are matched with the preloaded policy library of the designed task executor in UAVs, and an appropriate policy is selected for execution. During task execution, UAVs provide feedback on the task execution status to manned aircraft at key nodes, and continue task execution upon confirmation by manned aircraft until task completion or receipt of new task instructions. The framework is tested in typical beyond-visual-range combat scenarios of manned and unmanned aerial vehicle collaboration. It exhibits good human-machine interaction, robustness, trustworthiness, explainability, and effectively reducing the decision-making and operational burdens on pilots. The research findings of this paper can be widely applied to various task scenarios where humans and robots collaborate to accomplish tasks, providing a feasible technical route for the collaborative combat of manned and unmanned aerial vehicles.
KW - Human- machine cooperation
KW - Large language model agent
KW - Large language model control
KW - Manned and unmanned aerial vehicles cooperative
KW - Natural language contro
UR - https://www.scopus.com/pages/publications/85208791772
M3 - 会议文章
AN - SCOPUS:85208791772
SN - 1025-9090
JO - ICAS Proceedings
JF - ICAS Proceedings
T2 - 34th Congress of the International Council of the Aeronautical Sciences, ICAS 2024
Y2 - 9 September 2024 through 13 September 2024
ER -