TY - GEN
T1 - Two-branch Objectness-centric Open World Detection
AU - Wu, Yan
AU - Zhao, Xiaowei
AU - Ma, Yuqing
AU - Wang, Duorui
AU - Liu, Xianglong
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/10/10
Y1 - 2022/10/10
N2 - In recent years, with the development of deep learning, object detection has made great progress and has been widely used in many tasks. However, the previous models are all performed on closed sets, while there are many unknown categories in the real open world. Directly applying a model trained on known categories to the unknown classes will lead to misclassification. In this paper, we propose a two-branch objectness-centric open world object detection framework consisting of the bias-guided detector and the objectness-centric calibrator to effectively capture the objectness of both known and unknown instances and make the accurate prediction for known classes. The bias-guided detector trained with the known labels can predict the classes and boxes for known classes accurately. While the objectness-centric calibrator can localize the instances of any class, and does not affect the classification and regression of known classes. In the inference stage, we use the objectness-centric affirmation to confirm the results for known classes and predict the unknown instances. Comprehensive experiments conducted on the open world object detection benchmark validate the effectiveness of our method compared to state-of-the-art open world object detection approaches.
AB - In recent years, with the development of deep learning, object detection has made great progress and has been widely used in many tasks. However, the previous models are all performed on closed sets, while there are many unknown categories in the real open world. Directly applying a model trained on known categories to the unknown classes will lead to misclassification. In this paper, we propose a two-branch objectness-centric open world object detection framework consisting of the bias-guided detector and the objectness-centric calibrator to effectively capture the objectness of both known and unknown instances and make the accurate prediction for known classes. The bias-guided detector trained with the known labels can predict the classes and boxes for known classes accurately. While the objectness-centric calibrator can localize the instances of any class, and does not affect the classification and regression of known classes. In the inference stage, we use the objectness-centric affirmation to confirm the results for known classes and predict the unknown instances. Comprehensive experiments conducted on the open world object detection benchmark validate the effectiveness of our method compared to state-of-the-art open world object detection approaches.
KW - object detection
KW - objectness-centric affirmation
KW - objectness-centric calibrator
KW - open world
UR - https://www.scopus.com/pages/publications/85141063614
U2 - 10.1145/3552458.3556453
DO - 10.1145/3552458.3556453
M3 - 会议稿件
AN - SCOPUS:85141063614
T3 - HCMA 2022 - Proceedings of the 3rd International Workshop on Human-Centric Multimedia Analysis
SP - 35
EP - 40
BT - HCMA 2022 - Proceedings of the 3rd International Workshop on Human-Centric Multimedia Analysis
PB - Association for Computing Machinery, Inc
T2 - 3rd International Workshop on Human-Centric Multimedia Analysis, HCMA 2022, held in conjunction with the ACM Multimedia 2022
Y2 - 10 October 2022
ER -