Skip to main navigation Skip to search Skip to main content

M3-CR: Multiscale Multibranch Mamba for SAR-Assisted Optical Image Thick Cloud Removal

  • Beihang University
  • Tianmushan Laboratory
  • Shanghai Aerospace Control Technology Institute
  • Shanghai Artificial Intelligence Laboratory

Research output: Contribution to journal › Article › peer-review

Abstract

SAR-assisted thick cloud removal from optical remote sensing images has long been a challenging task. Current mainstream methods face challenges in achieving an effective global receptive field, fully using multiscale features, and deeply integrating features from both modalities. To overcome these limitations, we propose the multiscale multibranch Mamba model for SAR-assisted thick cloud removal ( M3-CR). Specifically, we integrate the Mamba model into the task of SAR-assisted cloud removal, effectively modeling global dependencies within the images. Concurrently, a multiscale multibranch structure is introduced to extract and integrate multiscale information, and in combination with a convolutional branch to fully exploit the global and local geographic proximities inherent in remote sensing images. Furthermore, we present a novel feature fusion module leveraging the modal-traversing-2-D selective scan (MTSS2D) to enable deep interaction and integration of features from optical and SAR images. The experimental results on two benchmark databases show that the M3-CR achieves superior performance compared with state-of-the-art cloud removal approaches, while requiring fewer parameters and reduced floating-point operations (FLOPs).

Original languageEnglish
Article number5623312
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume63
DOIs
StatePublished - 2025

Keywords

  • Modal-traversing-2-D selective scan (MTSS2D)
  • SAR-assisted thick cloud removal
  • multiscale multibranch Mamba
  • state-space model

Fingerprint

Dive into the research topics of 'M3-CR: Multiscale Multibranch Mamba for SAR-Assisted Optical Image Thick Cloud Removal'. Together they form a unique fingerprint.

Cite this