TY - GEN
T1 - CDMNet
T2 - 2023 Workshop on UAVs in Multimedia: Capturing the World from a New Perspective, UAVM 2023, Co-located with MM 2023
AU - Lv, Chengtao
AU - Guo, Jinyang
AU - Yu, Jiaqi
AU - Zhang, Ruiyan
AU - Liu, Xianglong
N1 - Publisher Copyright:
© 2023 ACM.
PY - 2023/10/29
Y1 - 2023/10/29
N2 - Single-frame infrared small target (SIRST) detection is an extremely challenging task due to its low signal-to-noise ratio and low contrast. Previous methods fail to achieve promising performance as they do not consider the analogous and blurred background surrounding. To this end, we first propose a prototype-based contrastive loss (PCL) by modeling the foreground targets and the surrounding nearest backgrounds. As a result, the prototypes of different categories in the latent space could be far away, which enables the model to make clear decisions on the boundaries of infrared small targets. Moreover, previous methods neglect the distribution inconsistency caused by feature fusion in U-shaped architecture. Therefore, we design a multi-scale distribution-mapped fusion (MDMF) module, which greatly mitigates the distribution inconsistency issue. We incorporate the proposed PCL and MDMF module into the existing SIRST detection method to construct a new SIRST detection framework called Contrastive Distribution Mapped Network (CDMNet). Extensive experiments on two infrared small target datasets, NUDT-SIRST and IRSTD-1k, demonstrate that our model outperforms current competitive models on a variety of metrics.
AB - Single-frame infrared small target (SIRST) detection is an extremely challenging task due to its low signal-to-noise ratio and low contrast. Previous methods fail to achieve promising performance as they do not consider the analogous and blurred background surrounding. To this end, we first propose a prototype-based contrastive loss (PCL) by modeling the foreground targets and the surrounding nearest backgrounds. As a result, the prototypes of different categories in the latent space could be far away, which enables the model to make clear decisions on the boundaries of infrared small targets. Moreover, previous methods neglect the distribution inconsistency caused by feature fusion in U-shaped architecture. Therefore, we design a multi-scale distribution-mapped fusion (MDMF) module, which greatly mitigates the distribution inconsistency issue. We incorporate the proposed PCL and MDMF module into the existing SIRST detection method to construct a new SIRST detection framework called Contrastive Distribution Mapped Network (CDMNet). Extensive experiments on two infrared small target datasets, NUDT-SIRST and IRSTD-1k, demonstrate that our model outperforms current competitive models on a variety of metrics.
UR - https://www.scopus.com/pages/publications/85178521214
U2 - 10.1145/3607834.3616569
DO - 10.1145/3607834.3616569
M3 - 会议稿件
AN - SCOPUS:85178521214
T3 - UAVM 2023 - Proceedings of the 2023 Workshop on UAVs in Multimedia: Capturing the World from a New Perspective, Co-located with MM 2023
SP - 63
EP - 67
BT - UAVM 2023 - Proceedings of the 2023 Workshop on UAVs in Multimedia
PB - Association for Computing Machinery, Inc
Y2 - 2 November 2023 through 2 November 2023
ER -