Skip to main navigation Skip to search Skip to main content

VLCIM: A Vision-Language Cyclic Interaction Model for Industrial Defect Detection

  • Xiangkai Shen
  • , Lei Li*
  • , Yushan Ma
  • , Shaofeng Xu
  • , Jinhai Liu
  • , Zhiguo Yang
  • , Yan Shi*
  • *Corresponding author for this work
  • Beihang University
  • Liupanshan Laboratory
  • Ningxia University
  • Northeastern University China

Research output: Contribution to journal › Article › peer-review

Abstract

Accurate defect detection is an important element in ensuring product quality and safe equipment operation. However, due to the lack of deep cross-modal interactions (CMIs) during vision feature extraction, existing methods often suffer from attention bias, which ultimately limits detection accuracy. To address this issue, this article proposes a vision-language cyclic interaction model (VLCIM), which progressively optimizes vision feature extraction by integrating domain prior knowledge and generic large model, effectively bridging the dual-domain barrier between “generic-specific” and “vision-language.” Specifically, progressive cyclic interaction learning is proposed for the first time, which integrates a recursive guidance module (RGM) and CMI strategy to realize bidirectional dynamic fusion and collaborative optimization of vision and language features. Furthermore, the proposed dual-view synergistic detection mechanism (DSDM) enhances discriminative decision responses, significantly improving the model’s boundary perception ability and decision-making accuracy in complex scenarios. VLCIM achieves high-precision defect detection by establishing a cyclic interaction mechanism between domain-specific language features and vision representations. The experimental results on three industrial datasets demonstrate that VLCIM achieves improvements of 5.9%, 5.6%, and 4.1% in mean intersection over union (mIoU) over the state-of-the-art (SOTA) methods, indicating its validity and generalization in different scenarios.

Original languageEnglish
Article number2538713
JournalIEEE Transactions on Instrumentation and Measurement
Volume74
DOIs
StatePublished - 2025

Keywords

  • Defect detection
  • dual-view synergistic detection (DSD)
  • industrial safety
  • large language model
  • progressive cyclic interactive learning (PCIL)

Fingerprint

Dive into the research topics of 'VLCIM: A Vision-Language Cyclic Interaction Model for Industrial Defect Detection'. Together they form a unique fingerprint.

Cite this