基于云层与背景解耦的双分支GAN 云图像生成方法

Cloud image generation is an important branch of remote sensing image generation. Nevertheless, prevailing approaches predominantly target the production of homogeneous cloud types, offering inadequate control over cloud coverage and opacity. Furthermore, the failure to disentangle cloud attributes and terrestrial features seriously affect the diversity and veracity of the generated cloud images, which cannot meet the simulation requirements.This research introduces DecoupleGAN, a bifurcated GAN framework for cloud image generation based on the decoupling of cloud and background. DecoupleGAN employes a pair of separate GANs to independently capture the characteristic representations of cloud formations and the underlying background. Leveraging a cloud-background energy imaging model, coupled with specified transparency value, the methodology seamlessly integrates cloud foregrounds with remote sensing backdrops, extracting features with heightened efficiency and no cross-interference, thereby culminating in superior quality cloud imageries. Complementarily, this study also introduces a dataset comprised of varying cloud coverage categories, broadening the generative scope of the model. The algorithm has been verified to exhibit superior performance in simulation, specifically with an FID value of 49.0012 and a KID value of 0.0253, representing performance improvements of 33.11% and 16.98% respectively compared with single-branch networks. Moreover, compared with existing cloud generation methods, this algorithm can generate more realistic and diverse types of clouds, and is capable of simultaneously generating multiple different types of land cover backgrounds, significantly expanding the scope of application and practicality. DecoupleGAN achieves more realistic and harmonious cloud image simulation effects by decoupling the clouds from the background and independently processing the two branches, effectively preventing interference during the feature learning process.