Skip to main navigation Skip to search Skip to main content

A local enhanced mamba network for hyperspectral image classification

  • Beihang University

Research output: Contribution to journalArticlepeer-review

Abstract

Deep learning has significantly advanced hyperspectral image (HSI) classification, primarily due to its robust nonlinear feature extraction capabilities. The vision transformer has achieved notable performance but is limited by the quadratic computational burden of its self-attention mechanism. Recently, a network based on state space model named Mamba, has attracted considerable attention for its linear complexity and commendable performance. Nevertheless, Mamba was originally designed for one-dimensional causal sequence modeling, and its effectiveness in inherent non-causal HSI classification remains to be fully validated. To address this issue, we propose a novel Local Enhanced Mamba (LE-Mamba) network for hyperspectral image classification, which mainly comprises a Local Enhanced Spatial SSM (LES-S6), a Central Region Spectral SSM (CRS-S6), and a Multi-Scale Convolutional Gated Unit (MSCGU). The LES-S6 improves non-causal local feature extraction by incorporating a multi-directional local spatial scanning mechanism. Additionally, the CRS-S6 employs a bidirectional scanning mechanism in the spectral dimension to capture fine spectral details and integrate them with spatial information. The MSCGU utilizes a convolutional gating mechanism to aggregate features from diverse scanning routes and extract high-level semantic information. The overall accuracies of LE-Mamba on Indian Pines, WHU-Hi-HanChuan, WHU-Hi-LongKou, and Pavia University datasets are 99.16 %, 98.16 %, 99.57 %, and 99.63 %, respectively. Extensive experimental results on these four public datasets demonstrate that the LE-Mamba outperforms eight mainstream deep learning models in classification performance.

Original languageEnglish
Article number104092
JournalInternational Journal of Applied Earth Observation and Geoinformation
Volume133
DOIs
StatePublished - Sep 2024

Keywords

  • Hyperspectral image classification
  • Local spatial feature extraction
  • Mamba
  • Multi-directional scan mechanism
  • Transformer

Fingerprint

Dive into the research topics of 'A local enhanced mamba network for hyperspectral image classification'. Together they form a unique fingerprint.

Cite this