An inpainting and super resolution method for image mapping spectrometer

  • Haotian Shao
  • , Lijuan Su
  • , Anqi Liu
  • , Yan Yuan*
  • , Yi Jiang
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Image Mapping Spectrometry (IMS) is a compact snapshot hyperspectral imaging technology. However, the image mapper used in the IMS causes degradation of the reconstructed spectral datacube, such as, low spatial resolution, missing areas and stripe artifacts. In this paper, we propose an end-to-end deep learning method to jointly inpainting and super resolution the restored spectral images of the IMS. The method includes an image inpainting network, which is designed to correct the nonuniform intensity and missing data, and an image super resolution network, which aims to enhance the spatial resolution of images. In addition, a local nonuniformity correction method is proposed to preprocess the IMS images. Simulation and experimental results demonstrate the effectiveness of the proposed method.

Original languageEnglish
Title of host publicationSPIE Future Sensing Technologies 2023
EditorsOsamu Matoba, Joseph A. Shaw, Christopher R. Valenta
PublisherSPIE
ISBN (Electronic)9781510657229
DOIs
StatePublished - 2023
EventSPIE Future Sensing Technologies 2023 - Yokohama, Japan
Duration: 18 Apr 202321 Apr 2023

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12327
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceSPIE Future Sensing Technologies 2023
Country/TerritoryJapan
CityYokohama
Period18/04/2321/04/23

Keywords

  • deep learning
  • hyperspectral imaging
  • image inpainting
  • image mapping spectrometry
  • super resolution

Fingerprint

Dive into the research topics of 'An inpainting and super resolution method for image mapping spectrometer'. Together they form a unique fingerprint.

Cite this