TY - JOUR
T1 - Multi-Grained Guided Diffusion for Quantity-Controlled Remote Sensing Object Generation
AU - Yu, Zhiping
AU - Liu, Chenyang
AU - Zhong, Chuyu
AU - Zou, Zhengxia
AU - Shi, Zhenwei
N1 - Publisher Copyright:
© 2004-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Accurate object counts represent essential semantical information in remote sensing imagery, significantly impacting applications such as traffic monitoring and urban planning. Despite the recent advances in text-to-image (T2I) generation in remote sensing, existing methods still face challenges in precisely controlling the number of object instances in generated images. To address this challenge, we propose a novel method, multi-grained guided diffusion (MGDiff). During training, unlike previous methods that relied solely on latent-space noise constraints, MGDiff imposes constraints at three distinct granularities: latent pixel, global counting, and spatial distribution. The multi-grained guidance mechanism matches the quantity prompts with object spatial layouts in the feature space, enabling our model to achieve precise control over object quantities. To benchmark this new task, we present Levir-QCG, a dataset comprising 10504 remote sensing images across five object categories, annotated with precise object counts and segmentation masks. We conducted extensive experiments to benchmark our method against previous methods on the Levir-QCG dataset. Compared to previous models, the MGDiff achieves an approximately +40% improvement in counting accuracy while maintaining higher visual fidelity and strong zero-shot generalization. To the best of our knowledge, this is the first work to research accurate object quantity control in remote sensing T2I generation.
AB - Accurate object counts represent essential semantical information in remote sensing imagery, significantly impacting applications such as traffic monitoring and urban planning. Despite the recent advances in text-to-image (T2I) generation in remote sensing, existing methods still face challenges in precisely controlling the number of object instances in generated images. To address this challenge, we propose a novel method, multi-grained guided diffusion (MGDiff). During training, unlike previous methods that relied solely on latent-space noise constraints, MGDiff imposes constraints at three distinct granularities: latent pixel, global counting, and spatial distribution. The multi-grained guidance mechanism matches the quantity prompts with object spatial layouts in the feature space, enabling our model to achieve precise control over object quantities. To benchmark this new task, we present Levir-QCG, a dataset comprising 10504 remote sensing images across five object categories, annotated with precise object counts and segmentation masks. We conducted extensive experiments to benchmark our method against previous methods on the Levir-QCG dataset. Compared to previous models, the MGDiff achieves an approximately +40% improvement in counting accuracy while maintaining higher visual fidelity and strong zero-shot generalization. To the best of our knowledge, this is the first work to research accurate object quantity control in remote sensing T2I generation.
KW - Multi-grained guided diffusion (MGDiff)
KW - object generation
KW - quantity controllability
KW - remote sensing
UR - https://www.scopus.com/pages/publications/105004039982
U2 - 10.1109/LGRS.2025.3565817
DO - 10.1109/LGRS.2025.3565817
M3 - 文章
AN - SCOPUS:105004039982
SN - 1545-598X
VL - 22
JO - IEEE Geoscience and Remote Sensing Letters
JF - IEEE Geoscience and Remote Sensing Letters
M1 - 6008205
ER -