Skip to main navigation Skip to search Skip to main content

A Multi-Class Anomaly Detection Method Based on Reverse Distillation and Mixed-Attention

  • Jiacheng Yun
  • , Mi Liu*
  • , Yang Li
  • *Corresponding author for this work
  • Beihang University
  • Guizhou Space Appliance Co., Ltd
  • Peking University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Reverse distillation is an efficient unsupervised anomaly detection framework that localizes anomalies by exploiting representation discrepancies between the teacher and student networks. However, despite being trained only on normal images, the student network can often reconstruct anomalous regions accurately - a phenomenon termed over-generalization, which degrades anomaly detection performance, especially in the multi-class setting. To enhance the reverse distillation framework's ability in the multi-class setting, we propose a Mixed-Attention Feature Selection (MAFS) module. By fusing spatial attention, channel attention, and self-attention, MAFS guides the model to select the most discriminative features for reconstruction while blocking potential anomalous information propagation to the student network, thereby alleviating over-generalization. Additionally, we design a more effective Multi-Scale Feature Fusion (MSFF) module, which leverages multi-scale features from the teacher network to enhance the reconstruction of normal regions. Following the unsupervised multi-class anomaly detection setting, our method achieves competitive performance on MVTecAD and VisA datasets.

Original languageEnglish
Title of host publicationConference Proceedings - 2025 IEEE 5th International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331589592
DOIs
StatePublished - 2025
Event5th IEEE International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025 - Chongqing, China
Duration: 21 Nov 202523 Nov 2025

Publication series

NameConference Proceedings - 2025 IEEE 5th International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025

Conference

Conference5th IEEE International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025
Country/TerritoryChina
CityChongqing
Period21/11/2523/11/25

Keywords

  • mixed-attention
  • multi-class anomaly detection
  • multi-scale feature fusion
  • reverse distillation

Fingerprint

Dive into the research topics of 'A Multi-Class Anomaly Detection Method Based on Reverse Distillation and Mixed-Attention'. Together they form a unique fingerprint.

Cite this