TY - JOUR
T1 - PGTFusion
T2 - Pseudo ground truth guided infrared and visible image fusion
AU - Zhu, Yiran
AU - Gao, Tianhao
AU - Wu, Renzhi
AU - Hu, Xiangyu
AU - Zhang, Yu
N1 - Publisher Copyright:
Copyright © 2026. Published by Elsevier B.V.
PY - 2026/8
Y1 - 2026/8
N2 - Infrared and visible image fusion aims to produce a unified representation that is not only visually informative but also semantically meaningful for downstream vision tasks. However, existing supervised fusion methods are fundamentally constrained by the absence of reliable ground truth images, while most unsupervised approaches optimize low-level appearance consistency without explicitly preserving semantic targets. This semantic misalignment often leads to fused images that either suppress critical infrared objects or introduce ambiguous structures, limiting their practical utility. To address this problem, we propose PGTFusion, a novel pseudo ground truth generation framework that introduces explicit semantic guidance into the fusion process. Specifically, salient infrared targets are identified through object detection and semantic segmentation, and are adaptively integrated with visible images to construct pseudo ground truths that preserve task-relevant thermal information while maintaining natural visual structures. In addition, a gradient enhancement module based on guided filtering is designed to reinforce structural and textural fidelity by explicitly supervising edge and detail reconstruction. Extensive experiments demonstrate that PGTFusion consistently outperforms nine state-of-the-art methods, producing fused images with improved semantic target visibility, structural consistency and perceptual quality, thereby offering a more task-oriented and semantically grounded solution for infrared and visible image fusion. Code of this work will be released at https://github.com/uzeful/PGTFusion .
AB - Infrared and visible image fusion aims to produce a unified representation that is not only visually informative but also semantically meaningful for downstream vision tasks. However, existing supervised fusion methods are fundamentally constrained by the absence of reliable ground truth images, while most unsupervised approaches optimize low-level appearance consistency without explicitly preserving semantic targets. This semantic misalignment often leads to fused images that either suppress critical infrared objects or introduce ambiguous structures, limiting their practical utility. To address this problem, we propose PGTFusion, a novel pseudo ground truth generation framework that introduces explicit semantic guidance into the fusion process. Specifically, salient infrared targets are identified through object detection and semantic segmentation, and are adaptively integrated with visible images to construct pseudo ground truths that preserve task-relevant thermal information while maintaining natural visual structures. In addition, a gradient enhancement module based on guided filtering is designed to reinforce structural and textural fidelity by explicitly supervising edge and detail reconstruction. Extensive experiments demonstrate that PGTFusion consistently outperforms nine state-of-the-art methods, producing fused images with improved semantic target visibility, structural consistency and perceptual quality, thereby offering a more task-oriented and semantically grounded solution for infrared and visible image fusion. Code of this work will be released at https://github.com/uzeful/PGTFusion .
KW - Gradient enhancement
KW - Image fusion
KW - Pseudo ground truth
KW - Salient infrared targets
UR - https://www.scopus.com/pages/publications/105039441381
U2 - 10.1016/j.infrared.2026.106645
DO - 10.1016/j.infrared.2026.106645
M3 - 文章
AN - SCOPUS:105039441381
SN - 1350-4495
VL - 157
JO - Infrared Physics and Technology
JF - Infrared Physics and Technology
M1 - 106645
ER -