Skip to main navigation Skip to search Skip to main content

Attention-Guided Collaborative Counting

  • Hong Mo
  • , Wenqi Ren
  • , Xiong Zhang
  • , Feihu Yan
  • , Zhong Zhou*
  • , Xiaochun Cao
  • , Wei Wu
  • *Corresponding author for this work
  • Beihang University
  • Sun Yat-Sen University
  • Neolix Autonomous Vehicle
  • Beijing University of Civil Engineering and Architecture

Research output: Contribution to journalArticlepeer-review

Abstract

Existing crowd counting designs usually exploit multi-branch structures to address the scale diversity problem. However, branches in these structures work in a competitive rather than collaborative way. In this paper, we focus on promoting collaboration between branches. Specifically, we propose an attention-guided collaborative counting module (AGCCM) comprising an attention-guided module (AGM) and a collaborative counting module (CCM). The CCM promotes collaboration among branches by recombining each branch's output into an independent count and joint counts with other branches. The AGM capturing the global attention map through a transformer structure with a pair of foreground-background related loss functions can distinguish the advantages of different branches. The loss functions do not require additional labels and crowd division. In addition, we design two kinds of bidirectional transformers (Bi-Transformers) to decouple the global attention to row attention and column attention. The proposed Bi-Transformers are able to reduce the computational complexity and handle images in any resolution without cropping the image into small patches. Extensive experiments on several public datasets demonstrate that the proposed algorithm performs favorably against the state-of-the-art crowd counting methods.

Original languageEnglish
Pages (from-to)6306-6319
Number of pages14
JournalIEEE Transactions on Image Processing
Volume31
DOIs
StatePublished - 2022

Keywords

  • Crowd counting
  • attention-guided collaborative counting model
  • bi-directional transformer

Fingerprint

Dive into the research topics of 'Attention-Guided Collaborative Counting'. Together they form a unique fingerprint.

Cite this