TY - GEN
T1 - Mining Oriented Information for Semi-Supervised Object Detection in Remote Sensing Images
AU - Wang, Yuhao
AU - Yao, Lifan
AU - Zhang, Xinye
AU - Song, Jiayun
AU - Zhang, Haopeng
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Traditional object detection requires extensive annotation, consuming considerable time and manpower. In recent years, semi-supervised object detection (SSOD) methods, which utilize a blend of unlabeled and labeled data to train object detectors, have been extensively researched. SSOD has made significant progress and can achieve similar levels of accuracy as the fully supervised methods. However, existing SSOD approaches primarily focus on horizontal objects in natural scenes, with scant research on other scenarios such as remote sensing images. This paper proposes a novel semi-supervised oriented object detection algorithm based on a two-stage object detector. For oriented objects in remote sensing, we particularly emphasize the utilization of oriented information of remote sensing objects to generate precise pseudo-label and improve the learning capability of the student network. Iterative labeled data filtering is performed by incorporating metrics with designed measurements. Valuable annotated samples can enhance the quality of pseudo-label generation. A strong augmentation method has been designed to utilize rotational information, enabling the student network to learn more diverse features. Additionally, we investigate the long-tail distribution problem in remote sensing images and mitigate the bias brought by category imbalance through phased training and post-processing in detection. Our experiments demonstrate that the designed semi-supervised oriented object detection method surpasses existing methods in the DOTAv1.5 benchmark, culminating in state-of-the-art performance.
AB - Traditional object detection requires extensive annotation, consuming considerable time and manpower. In recent years, semi-supervised object detection (SSOD) methods, which utilize a blend of unlabeled and labeled data to train object detectors, have been extensively researched. SSOD has made significant progress and can achieve similar levels of accuracy as the fully supervised methods. However, existing SSOD approaches primarily focus on horizontal objects in natural scenes, with scant research on other scenarios such as remote sensing images. This paper proposes a novel semi-supervised oriented object detection algorithm based on a two-stage object detector. For oriented objects in remote sensing, we particularly emphasize the utilization of oriented information of remote sensing objects to generate precise pseudo-label and improve the learning capability of the student network. Iterative labeled data filtering is performed by incorporating metrics with designed measurements. Valuable annotated samples can enhance the quality of pseudo-label generation. A strong augmentation method has been designed to utilize rotational information, enabling the student network to learn more diverse features. Additionally, we investigate the long-tail distribution problem in remote sensing images and mitigate the bias brought by category imbalance through phased training and post-processing in detection. Our experiments demonstrate that the designed semi-supervised oriented object detection method surpasses existing methods in the DOTAv1.5 benchmark, culminating in state-of-the-art performance.
KW - deep learning
KW - object detection
KW - remote sensing
KW - semi-supervised learning
UR - https://www.scopus.com/pages/publications/85205020189
U2 - 10.1109/IJCNN60899.2024.10650864
DO - 10.1109/IJCNN60899.2024.10650864
M3 - 会议稿件
AN - SCOPUS:85205020189
T3 - Proceedings of the International Joint Conference on Neural Networks
BT - 2024 International Joint Conference on Neural Networks, IJCNN 2024 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2024 International Joint Conference on Neural Networks, IJCNN 2024
Y2 - 30 June 2024 through 5 July 2024
ER -