Skip to main navigation Skip to search Skip to main content

Zero-Sum Game-Based Controller Design Using Reinforcement Learning for Formation Tracking of Multi-agent Systems

  • Beihang University
  • China Aviation Industry Corporation

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper proposes a hierarchical distributed formation tracking controller for continuous multi-agent systems (MASs). Firstly, a zero-sum game-based regulation controller is designed according to a min-max game cost function with respect to the control-player and a disturbance-player using reinforcement learning (RL). The H robust property against perturbations is equivalently guaranteed. Secondly, the Q-learning based iteration method is implemented to continuous system to generate a stable controller. This regulator can be obtained using operational data associated with the original system. Thirdly, the distributed formation tracking controller with feedforward terms and feasible condition is further proposed based on the previous learning results to realize time-varying formation tracking while a brief stability analysis is given. Finally, simulation results are provided to illustrate the effectiveness of the proposed learning and control frame.

Original languageEnglish
Title of host publicationProceedings of 2021 5th Chinese Conference on Swarm Intelligence and Cooperative Control
EditorsZhang Ren, Yongzhao Hua, Mengyi Wang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages1487-1497
Number of pages11
ISBN (Print)9789811939976
DOIs
StatePublished - 2023
Event5th Chinese Conference on Swarm Intelligence and Cooperative Control, CCSICC 2021 - Shenzhen, China
Duration: 19 Jan 202222 Jan 2022

Publication series

NameLecture Notes in Electrical Engineering
Volume934 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference5th Chinese Conference on Swarm Intelligence and Cooperative Control, CCSICC 2021
Country/TerritoryChina
CityShenzhen
Period19/01/2222/01/22

Keywords

  • Distributed formation tracking
  • Multi-agent systems
  • Reinforcement learning
  • Robust control
  • Zero-sum game

Fingerprint

Dive into the research topics of 'Zero-Sum Game-Based Controller Design Using Reinforcement Learning for Formation Tracking of Multi-agent Systems'. Together they form a unique fingerprint.

Cite this