TY - GEN
T1 - A Multi-Class Anomaly Detection Method Based on Reverse Distillation and Mixed-Attention
AU - Yun, Jiacheng
AU - Liu, Mi
AU - Li, Yang
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Reverse distillation is an efficient unsupervised anomaly detection framework that localizes anomalies by exploiting representation discrepancies between the teacher and student networks. However, despite being trained only on normal images, the student network can often reconstruct anomalous regions accurately - a phenomenon termed over-generalization, which degrades anomaly detection performance, especially in the multi-class setting. To enhance the reverse distillation framework's ability in the multi-class setting, we propose a Mixed-Attention Feature Selection (MAFS) module. By fusing spatial attention, channel attention, and self-attention, MAFS guides the model to select the most discriminative features for reconstruction while blocking potential anomalous information propagation to the student network, thereby alleviating over-generalization. Additionally, we design a more effective Multi-Scale Feature Fusion (MSFF) module, which leverages multi-scale features from the teacher network to enhance the reconstruction of normal regions. Following the unsupervised multi-class anomaly detection setting, our method achieves competitive performance on MVTecAD and VisA datasets.
AB - Reverse distillation is an efficient unsupervised anomaly detection framework that localizes anomalies by exploiting representation discrepancies between the teacher and student networks. However, despite being trained only on normal images, the student network can often reconstruct anomalous regions accurately - a phenomenon termed over-generalization, which degrades anomaly detection performance, especially in the multi-class setting. To enhance the reverse distillation framework's ability in the multi-class setting, we propose a Mixed-Attention Feature Selection (MAFS) module. By fusing spatial attention, channel attention, and self-attention, MAFS guides the model to select the most discriminative features for reconstruction while blocking potential anomalous information propagation to the student network, thereby alleviating over-generalization. Additionally, we design a more effective Multi-Scale Feature Fusion (MSFF) module, which leverages multi-scale features from the teacher network to enhance the reconstruction of normal regions. Following the unsupervised multi-class anomaly detection setting, our method achieves competitive performance on MVTecAD and VisA datasets.
KW - mixed-attention
KW - multi-class anomaly detection
KW - multi-scale feature fusion
KW - reverse distillation
UR - https://www.scopus.com/pages/publications/105038714665
U2 - 10.1109/IARCE68366.2025.11485697
DO - 10.1109/IARCE68366.2025.11485697
M3 - 会议稿件
AN - SCOPUS:105038714665
T3 - Conference Proceedings - 2025 IEEE 5th International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025
BT - Conference Proceedings - 2025 IEEE 5th International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 5th IEEE International Conference on Industrial Automation, Robotics and Control Engineering, IARCE 2025
Y2 - 21 November 2025 through 23 November 2025
ER -