Skip to main navigation Skip to search Skip to main content

R2H-CCD: Hyperspectral Imagery Generation from RGB Images Based on Conditional Cascade Diffusion Probabilistic Models

  • Beihang University
  • Shanghai Information Technology Research Center

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Hyperspectral imaging can capture detailed spectra of materials, but due to imaging conditions and equipment limitations, the cost of hyperspectral data collection is extremely high. Leveraging low-priced and easy-obtainable RGB images to generate hyperspectral images (HSIs) has gradually become a trend. Benefiting from the advantages of the denoising diffusion probability model (DDPM) in natural image super-resolution tasks, we consider the structural characteristics of HSI to design a novel spectral super-resolution algorithm, named R2H-CCD, which is a hyperspectral imagery generation method from RGB images based on conditional cascade diffusion probabilistic models. More specifically, the algorithm takes RGB image as conditional input and synthesise corresponding HSI from pure noise through a stochastic iterative denoising process. In addition, to obtain high-fidelity HSIs, it adopts U-Net structure to iteratively refine the generated images in an end-to-end training manner. The experiments on HFD100 dataset show the effectiveness and superiority of the proposed method.

Original languageEnglish
Title of host publicationIGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages7392-7395
Number of pages4
ISBN (Electronic)9798350320107
DOIs
StatePublished - 2023
Event2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023 - Pasadena, United States
Duration: 16 Jul 202321 Jul 2023

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2023-July

Conference

Conference2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023
Country/TerritoryUnited States
CityPasadena
Period16/07/2321/07/23

Keywords

  • Hyperspectral image
  • denoising diffusion probability model
  • image generation
  • spectral super-resolution

Fingerprint

Dive into the research topics of 'R2H-CCD: Hyperspectral Imagery Generation from RGB Images Based on Conditional Cascade Diffusion Probabilistic Models'. Together they form a unique fingerprint.

Cite this