Skip to main navigation Skip to search Skip to main content

Dual-Path Consistency Learning via Hierarchical Neighborhood Perturbation for Scribble-Supervised Semantic Segmentation

  • Su Yan
  • , Liping Zhang
  • , Xin Ning*
  • , Yugui Zhang
  • , Xiao Bai
  • , Jungong Han
  • *Corresponding author for this work
  • AnnLab
  • CAS - Institute of Semiconductors
  • School of Integrated Circuits
  • University of Chinese Academy of Sciences
  • Beijing Key Laboratory of Semiconductor Neural Network Intelligent Sensing and Computing Technology
  • Department of Computer Science
  • University of Sheffield

Research output: Contribution to journal › Article › peer-review

Abstract

Scribble-supervised semantic segmentation is a weakly supervised paradigm based on sparse annotations, which has attracted increasing attention due to its low labeling cost, high annotation flexibility, and promising performance. Existing methods primarily employ perturbation techniques such as noise injection, feature mixing, or channel dropout to foster diverse feature representations through consistency learning. However, they often overlook perturbation of hierarchical semantic-aware, which are vital for ensuring robust consistency learning. To address these issues, we propose a dual-path mutual guidance consistency learning framework with hierarchical neighborhood perturbation, termed DCNP. First, the hierarchical neighborhood random perturbation (HNRP) module implements pixel-level semantic-aware feature perturbation through locally-constrained neighborhood sampling around each target position. This hierarchical design aligns with the multi-scale structure of the encoder, enhancing feature stability under semantic-varying perturbation. In conjunction with HNRP, the dual-path mutual guidance consistency learning (DPMG) module incorporates a consistency loss that enforces bidirectional prediction consistency between the perturbed features branch and the original features branch through cross-branch pseudo-label supervision, effectively alleviating the problem of insufficient supervision caused by sparse annotations. Experimental results show that the proposed method achieves outstanding performance on five scribble-annotated datasets, offering meaningful insights into the design of efficient and architecturally simple frameworks for sparse annotation. The source code is available at https://github.com/chenller/ScribbleDCNP

Original languageEnglish
Pages (from-to)14267-14282
Number of pages16
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume36
Issue number9
DOIs
StatePublished - 1 Sep 2026

Keywords

  • Scribble annotation
  • consistency learning
  • neighborhood perturbation
  • semantic segmentation

Fingerprint

Dive into the research topics of 'Dual-Path Consistency Learning via Hierarchical Neighborhood Perturbation for Scribble-Supervised Semantic Segmentation'. Together they form a unique fingerprint.

Cite this