跳到主要导航 跳到搜索 跳到主要内容

Multi-Grained Guided Diffusion for Quantity-Controlled Remote Sensing Object Generation

  • Beihang University
  • Shanghai Artificial Intelligence Laboratory

科研成果: 期刊稿件文章同行评审

摘要

Accurate object counts represent essential semantical information in remote sensing imagery, significantly impacting applications such as traffic monitoring and urban planning. Despite the recent advances in text-to-image (T2I) generation in remote sensing, existing methods still face challenges in precisely controlling the number of object instances in generated images. To address this challenge, we propose a novel method, multi-grained guided diffusion (MGDiff). During training, unlike previous methods that relied solely on latent-space noise constraints, MGDiff imposes constraints at three distinct granularities: latent pixel, global counting, and spatial distribution. The multi-grained guidance mechanism matches the quantity prompts with object spatial layouts in the feature space, enabling our model to achieve precise control over object quantities. To benchmark this new task, we present Levir-QCG, a dataset comprising 10504 remote sensing images across five object categories, annotated with precise object counts and segmentation masks. We conducted extensive experiments to benchmark our method against previous methods on the Levir-QCG dataset. Compared to previous models, the MGDiff achieves an approximately +40% improvement in counting accuracy while maintaining higher visual fidelity and strong zero-shot generalization. To the best of our knowledge, this is the first work to research accurate object quantity control in remote sensing T2I generation.

源语言英语
文章编号6008205
期刊IEEE Geoscience and Remote Sensing Letters
22
DOI
出版状态已出版 - 2025

学术指纹

探究 'Multi-Grained Guided Diffusion for Quantity-Controlled Remote Sensing Object Generation' 的科研主题。它们共同构成独一无二的学术指纹。

引用此