Skip to main navigation Skip to search Skip to main content

Hierarchical Graph Interaction Transformer With Dynamic Token Clustering for Camouflaged Object Detection

  • Siyuan Yao
  • , Hao Sun
  • , Tian Zhu Xiang
  • , Xiao Wang
  • , Xiaochun Cao*
  • *Corresponding author for this work
  • Beijing University of Posts and Telecommunications
  • Inception Institute of Artificial Intelligence
  • G42 Bayanat
  • Sun Yat-Sen University

Research output: Contribution to journalArticlepeer-review

Abstract

Camouflaged object detection (COD) aims to identify the objects that seamlessly blend into the surrounding backgrounds. Due to the intrinsic similarity between the camouflaged objects and the background region, it is extremely challenging to precisely distinguish the camouflaged objects by existing approaches. In this paper, we propose a hierarchical graph interaction network termed HGINet for camouflaged object detection, which is capable of discovering imperceptible objects via effective graph interaction among the hierarchical tokenized features. Specifically, we first design a region-aware token focusing attention (RTFA) with dynamic token clustering to excavate the potentially distinguishable tokens in the local region. Afterwards, a hierarchical graph interaction transformer (HGIT) is proposed to construct bi-directional aligned communication between hierarchical features in the latent interaction space for visual semantics enhancement. Furthermore, we propose a decoder network with confidence aggregated feature fusion (CAFF) modules, which progressively fuses the hierarchical interacted features to refine the local detail in ambiguous regions. Extensive experiments conducted on the prevalent datasets, i.e. COD10K, CAMO, NC4K and CHAMELEON demonstrate the superior performance of HGINet compared to existing state-of-the-art methods. Our code is available at https://github.com/Garyson1204/HGINet.

Original languageEnglish
Pages (from-to)5936-5948
Number of pages13
JournalIEEE Transactions on Image Processing
Volume33
DOIs
StatePublished - 2024

Keywords

  • Camouflaged object detection
  • dynamic token clustering
  • graph interaction transformer

Fingerprint

Dive into the research topics of 'Hierarchical Graph Interaction Transformer With Dynamic Token Clustering for Camouflaged Object Detection'. Together they form a unique fingerprint.

Cite this