Blockchain-Based Distributed Multiagent Reinforcement Learning for Collaborative Multiobject Tracking Framework

  • Jiahao Shen
  • , Hao Sheng*
  • , Shuai Wang
  • , Ruixuan Cong
  • , Da Yang
  • , Yang Zhang
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

With the development of smart cities, video surveillance has become more prevalent in urban areas. The rapid growth of data brings challenges to video processing and analysis. Multi-object tracking (MOT), one of the most fundamental tasks in computer vision, has a wide range of applications and development prospects. MOT aims to locate multiple objects and maintain their unique identities by analyzing the video frame by frame. Most existing MOT frameworks are deployed in centralized systems, which are convenient for management but have problems such as weak algorithm adaptability, limited system scalability, and poor data security. In this paper, we propose a distributed MOT algorithm based on multi-agent reinforcement learning (DMARL-Tracker), which formulates MOT as a Markov decision process (MDP). Each object adjusts its tracking strategy during interactions with the environment. The benchmark results on MOT17 and MOT20 prove that our proposed algorithm achieves state-of-the-art (SOTA) performance. Based on this, we further integrate DMARL-Tracker into the blockchain and propose a blockchain-based collaborative MOT framework. All nodes collaborate and share information through the blockchain, achieving adaptation in different complex scenarios while ensuring data security. The simulation results show that our framework achieves good performance in terms of tracking and resource consumption.

Original languageEnglish
Pages (from-to)778-788
Number of pages11
JournalIEEE Transactions on Computers
Volume73
Issue number3
DOIs
StatePublished - 1 Mar 2024

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 11 - Sustainable Cities and Communities
    SDG 11 Sustainable Cities and Communities

Keywords

  • Computer vision
  • blockchain
  • multi-object tracking
  • reinforcement learning

Fingerprint

Dive into the research topics of 'Blockchain-Based Distributed Multiagent Reinforcement Learning for Collaborative Multiobject Tracking Framework'. Together they form a unique fingerprint.

Cite this