TY - GEN
T1 - Pruning State Space Models for Lightweight Remote Sensing Image Classification
AU - Wang, Lubo
AU - Yang, Qinzhe
AU - Shi, Zhenwei
AU - He, Lingjiao
AU - Xu, Jia
AU - Zou, Zhengxia
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - With the rapid advancement of satellite remote sensing technology, real-time on-board processing of optical imagery has become a critical demand for applications such as land resource management and disaster emergency response. However, spaceborne platforms face extreme resource constraints: existing satellites lack the necessary computational capacity, and the quadratic computational complexity of traditional Transformer architectures make them difficult to adapt. Although State Space Models (SSMs) offers significant improvements in efficiency with their linear computational complexity, a major gap remains for on-board deployment, and current research on lightweighting SSM architectures is scarce. This study proposes a lightweight remote sensing image classification algorithm via pruning of State Space Models, constructing a dual-track pruning methodology: Structured pruning progressively removes blocks based on a perturbation-based evaluation, which measures the importance of individual Mamba Blocks within the baseline model, thereby uncovering the critical role of deep modules. Unstructured pruning uses magnitude pruning and a momentum reset mechanism to address the issue of gradient coupling interference. This process demonstrates that sparse, high-performance sub-networks can be uncovered within SSMs. Experiments on three public remote sensing image datasets show that the proposed method reduces the number of model parameters by 50% to 70%, with negligible loss in classification accuracy.
AB - With the rapid advancement of satellite remote sensing technology, real-time on-board processing of optical imagery has become a critical demand for applications such as land resource management and disaster emergency response. However, spaceborne platforms face extreme resource constraints: existing satellites lack the necessary computational capacity, and the quadratic computational complexity of traditional Transformer architectures make them difficult to adapt. Although State Space Models (SSMs) offers significant improvements in efficiency with their linear computational complexity, a major gap remains for on-board deployment, and current research on lightweighting SSM architectures is scarce. This study proposes a lightweight remote sensing image classification algorithm via pruning of State Space Models, constructing a dual-track pruning methodology: Structured pruning progressively removes blocks based on a perturbation-based evaluation, which measures the importance of individual Mamba Blocks within the baseline model, thereby uncovering the critical role of deep modules. Unstructured pruning uses magnitude pruning and a momentum reset mechanism to address the issue of gradient coupling interference. This process demonstrates that sparse, high-performance sub-networks can be uncovered within SSMs. Experiments on three public remote sensing image datasets show that the proposed method reduces the number of model parameters by 50% to 70%, with negligible loss in classification accuracy.
KW - Image Classification
KW - Mamba
KW - Model Pruning
KW - Remote Sensing Image Classification
KW - State Space Model
UR - https://www.scopus.com/pages/publications/105043434070
U2 - 10.1109/MEAE68077.2025.11558007
DO - 10.1109/MEAE68077.2025.11558007
M3 - 会议稿件
AN - SCOPUS:105043434070
T3 - 2025 11th International Conference on Mechanical Engineering and Aerospace Engineering, MEAE 2025
SP - 409
EP - 413
BT - 2025 11th International Conference on Mechanical Engineering and Aerospace Engineering, MEAE 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 11th International Conference on Mechanical Engineering and Aerospace Engineering, MEAE 2025
Y2 - 17 October 2025 through 19 October 2025
ER -