TY - GEN
T1 - A Robust Camera-LiDAR Fusion Framework for 3D Object Detection in High-Dust Environments
AU - Wang, Mingyuan
AU - Liu, Wentao
AU - Zhou, Bin
AU - Wang, Zhangyu
AU - Liu, Runsen
AU - Wang, Hanyu
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - The fusion of camera and LiDAR features in the Bird's Eye View (BEV) perspective has become a prevalent solution for 3D detection in autonomous driving due to its simplicity and efficiency. However, in challenging environments like mining areas with dusty roads, existing BEV-based fusion networks struggle due to dust occlusion and misidentification of dust as obstacles. To address this, we propose a robust fusion framework that integrates fine-grained depth supervision and channel-wise attention mechanisms. Combined with a temporal multi-frame mechanism, our framework effectively mitigates issues caused by dust occlusion and misidentification. We validated our method's detection accuracy on a self-constructed mining road dataset, achieving 89.6% mAP, surpassing BEVFusion's 88.3% mAP. Tests on sensor occlusion and failure further demonstrated its robustness in adverse conditions typical of unstructured road scenarios.
AB - The fusion of camera and LiDAR features in the Bird's Eye View (BEV) perspective has become a prevalent solution for 3D detection in autonomous driving due to its simplicity and efficiency. However, in challenging environments like mining areas with dusty roads, existing BEV-based fusion networks struggle due to dust occlusion and misidentification of dust as obstacles. To address this, we propose a robust fusion framework that integrates fine-grained depth supervision and channel-wise attention mechanisms. Combined with a temporal multi-frame mechanism, our framework effectively mitigates issues caused by dust occlusion and misidentification. We validated our method's detection accuracy on a self-constructed mining road dataset, achieving 89.6% mAP, surpassing BEVFusion's 88.3% mAP. Tests on sensor occlusion and failure further demonstrated its robustness in adverse conditions typical of unstructured road scenarios.
KW - 3D object detection
KW - bird’s-eye-view feature
KW - depth estimation
KW - multi-sensor fusion
UR - https://www.scopus.com/pages/publications/85215533940
U2 - 10.1109/INDIN58382.2024.10774485
DO - 10.1109/INDIN58382.2024.10774485
M3 - 会议稿件
AN - SCOPUS:85215533940
T3 - IEEE International Conference on Industrial Informatics (INDIN)
BT - Proceedings - 2024 IEEE 22nd International Conference on Industrial Informatics, INDIN 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 22nd IEEE International Conference on Industrial Informatics, INDIN 2024
Y2 - 18 August 2024 through 20 August 2024
ER -