Improving Object Detection from Remote Sensing Images via Self-Supervised Adaptive Fusion Networks

  • Qiu Lu
  • , Tao Xu*
  • , Jiwen Dong
  • , Qingjie Liu
  • , Xiaohui Yang
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Detecting objects in remote sensing images is essential for intelligent interpretation. Although deep neural networks have made significant progress in recent years, they often struggle with complex backgrounds in remote sensing images, which can lead to inaccurate detection. To tackle this problem, a self-supervised adaptive fusion network (SSAFN) has been developed. The SSAFN includes an adaptive fusion module (AFM) and a self-supervised task module (SSTM). The AFM mainly fuses the deep semantic information to the shallow features with appropriate weights to enhance the semantic information of the shallow features. The SSTM is mainly to constrain the AFM through self-supervised tasks to fulfill the function similar to the attention mechanism: to make the AFM enhance the target feature representation and suppress the background information. The SSAFN reduces the impact of complex backgrounds on object representation, resulting in better detection results for various types of objects such as buildings, ships, and more. The proposed method has been tested on various datasets and has not only improved the detection accuracy for different types of objects but also enhanced the performance of popular object detection algorithms.

Original languageEnglish
Article number5000905
JournalIEEE Geoscience and Remote Sensing Letters
Volume21
DOIs
StatePublished - 2024

Keywords

  • Adaptive fusion module (AFM)
  • object detection
  • remote sensing image
  • self-supervised task module (SSTM)

Fingerprint

Dive into the research topics of 'Improving Object Detection from Remote Sensing Images via Self-Supervised Adaptive Fusion Networks'. Together they form a unique fingerprint.

Cite this