TY - JOUR
T1 - M3-CR
T2 - Multiscale Multibranch Mamba for SAR-Assisted Optical Image Thick Cloud Removal
AU - Pan, Linpeng
AU - Song, Xuedong
AU - Xie, Fengying
AU - Zhang, Xiaozhe
AU - Ji, Haolin
AU - Shi, Zhenwei
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - SAR-assisted thick cloud removal from optical remote sensing images has long been a challenging task. Current mainstream methods face challenges in achieving an effective global receptive field, fully using multiscale features, and deeply integrating features from both modalities. To overcome these limitations, we propose the multiscale multibranch Mamba model for SAR-assisted thick cloud removal ( M3-CR). Specifically, we integrate the Mamba model into the task of SAR-assisted cloud removal, effectively modeling global dependencies within the images. Concurrently, a multiscale multibranch structure is introduced to extract and integrate multiscale information, and in combination with a convolutional branch to fully exploit the global and local geographic proximities inherent in remote sensing images. Furthermore, we present a novel feature fusion module leveraging the modal-traversing-2-D selective scan (MTSS2D) to enable deep interaction and integration of features from optical and SAR images. The experimental results on two benchmark databases show that the M3-CR achieves superior performance compared with state-of-the-art cloud removal approaches, while requiring fewer parameters and reduced floating-point operations (FLOPs).
AB - SAR-assisted thick cloud removal from optical remote sensing images has long been a challenging task. Current mainstream methods face challenges in achieving an effective global receptive field, fully using multiscale features, and deeply integrating features from both modalities. To overcome these limitations, we propose the multiscale multibranch Mamba model for SAR-assisted thick cloud removal ( M3-CR). Specifically, we integrate the Mamba model into the task of SAR-assisted cloud removal, effectively modeling global dependencies within the images. Concurrently, a multiscale multibranch structure is introduced to extract and integrate multiscale information, and in combination with a convolutional branch to fully exploit the global and local geographic proximities inherent in remote sensing images. Furthermore, we present a novel feature fusion module leveraging the modal-traversing-2-D selective scan (MTSS2D) to enable deep interaction and integration of features from optical and SAR images. The experimental results on two benchmark databases show that the M3-CR achieves superior performance compared with state-of-the-art cloud removal approaches, while requiring fewer parameters and reduced floating-point operations (FLOPs).
KW - Modal-traversing-2-D selective scan (MTSS2D)
KW - SAR-assisted thick cloud removal
KW - multiscale multibranch Mamba
KW - state-space model
UR - https://www.scopus.com/pages/publications/105004052032
U2 - 10.1109/TGRS.2025.3566088
DO - 10.1109/TGRS.2025.3566088
M3 - 文章
AN - SCOPUS:105004052032
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5623312
ER -