TY - JOUR
T1 - MPA
T2 - A Mamba Pyramid Aggregator for Stereo Matching of Satellite Remote Sensing Images
AU - Zhang, Haopeng
AU - Zhu, Fangtao
AU - Dong, Chengyu
AU - Zhang, Xiaopeng
N1 - Publisher Copyright:
© 2008-2012 IEEE.
PY - 2026
Y1 - 2026
N2 - In recent years, deep learning-based stereo matching techniques have achieved significant progress in remote sensing applications such as large-scale scene 3D reconstruction. However, most existing mainstream methods rely on 3D convolutional neural networks to interpret and aggregate the cost volume, and their inherent local receptive fields limit the performance of the model when dealing with complex scenes commonly found in high-resolution satellite imagery, such as weakly-textured and repeated-textured areas. To address this limitation, we propose a novel, plug-and-play Mamba Pyramid Aggregator (MPA). Unlike traditional stacked 3D convolutional structures, MPA combines a pyramid structure with the sequence modeling capability of the Mamba model. While maintaining linear computational complexity, it enhances the network's interpretation ability through global context awareness and fine-grained aggregation at different granularities. MPA can be embedded as a plug-and-play module into existing stereo matching networks. We conducted enhancement experiments on five mainstream models using the WHU-Stereo and US3D satellite remote sensing datasets. The results show that MPA significantly improves the disparity estimation accuracy of all baseline models, particularly excelling in repeated-textured and weakly-textured areas, demonstrating its potential and value in handling complex remote sensing scenarios.
AB - In recent years, deep learning-based stereo matching techniques have achieved significant progress in remote sensing applications such as large-scale scene 3D reconstruction. However, most existing mainstream methods rely on 3D convolutional neural networks to interpret and aggregate the cost volume, and their inherent local receptive fields limit the performance of the model when dealing with complex scenes commonly found in high-resolution satellite imagery, such as weakly-textured and repeated-textured areas. To address this limitation, we propose a novel, plug-and-play Mamba Pyramid Aggregator (MPA). Unlike traditional stacked 3D convolutional structures, MPA combines a pyramid structure with the sequence modeling capability of the Mamba model. While maintaining linear computational complexity, it enhances the network's interpretation ability through global context awareness and fine-grained aggregation at different granularities. MPA can be embedded as a plug-and-play module into existing stereo matching networks. We conducted enhancement experiments on five mainstream models using the WHU-Stereo and US3D satellite remote sensing datasets. The results show that MPA significantly improves the disparity estimation accuracy of all baseline models, particularly excelling in repeated-textured and weakly-textured areas, demonstrating its potential and value in handling complex remote sensing scenarios.
KW - Cost Volume Aggregation
KW - Mamba Model
KW - Satellite Remote Sensing Images
KW - Stereo Matching
UR - https://www.scopus.com/pages/publications/105043006879
U2 - 10.1109/JSTARS.2026.3705099
DO - 10.1109/JSTARS.2026.3705099
M3 - 文章
AN - SCOPUS:105043006879
SN - 1939-1404
JO - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
JF - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
ER -