TY - JOUR
T1 - Feedback Network for Compact Thin Cloud Removal
AU - Ding, Haidong
AU - Xie, Fengying
AU - Zi, Yue
AU - Liao, Wei
AU - Song, Xuedong
N1 - Publisher Copyright:
© 2004-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - The thin cloud removal (CR) technique has great practical value for the application of remote-sensing images. Existing deep-learning-based methods have attained remarkable achievements. However, most of them neglect the inherent feature correlations in deeper layers due to learning successively. In this letter, we propose a compact thin CR network based on the feedback (FB) mechanism, called CRFB-Net, which leverages the high-level features as FB information to modulate shallow representations. CRFB-Net employs the recurrent architecture to achieve such an FB scheme. Specifically, the restoration process does not terminate after obtaining an output. In this case, the output of intermediate iterations will flow into the next iteration as FB. For better utilization of FB, a multiscale feature fusion block (MFFB) is designed to refine the low-level representations from three scales. Furthermore, we introduce a curriculum learning (CL) strategy to train the CRFB-Net by gradually increasing the complexity of restoration, through which a sharper result is produced step by step. Extensive experiments demonstrate the superiority of our CRFB-Net, outperforming state-of-the-art (SOTA).
AB - The thin cloud removal (CR) technique has great practical value for the application of remote-sensing images. Existing deep-learning-based methods have attained remarkable achievements. However, most of them neglect the inherent feature correlations in deeper layers due to learning successively. In this letter, we propose a compact thin CR network based on the feedback (FB) mechanism, called CRFB-Net, which leverages the high-level features as FB information to modulate shallow representations. CRFB-Net employs the recurrent architecture to achieve such an FB scheme. Specifically, the restoration process does not terminate after obtaining an output. In this case, the output of intermediate iterations will flow into the next iteration as FB. For better utilization of FB, a multiscale feature fusion block (MFFB) is designed to refine the low-level representations from three scales. Furthermore, we introduce a curriculum learning (CL) strategy to train the CRFB-Net by gradually increasing the complexity of restoration, through which a sharper result is produced step by step. Extensive experiments demonstrate the superiority of our CRFB-Net, outperforming state-of-the-art (SOTA).
KW - Curriculum learning (CL)
KW - feedback (FB) scheme
KW - recurrent architecture
KW - remote sensing
KW - thin cloud removal (CR)
UR - https://www.scopus.com/pages/publications/85151472095
U2 - 10.1109/LGRS.2023.3256416
DO - 10.1109/LGRS.2023.3256416
M3 - 文章
AN - SCOPUS:85151472095
SN - 1545-598X
VL - 20
JO - IEEE Geoscience and Remote Sensing Letters
JF - IEEE Geoscience and Remote Sensing Letters
M1 - 6003505
ER -