Skip to main navigation Skip to search Skip to main content

Multi-modal image fusion based on ROI and Laplacian Pyramid

  • Xiong Gao
  • , Hong Zhang*
  • , Hao Chen
  • , Jiafeng Li
  • *Corresponding author for this work
  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper, we propose a region of interest-based (ROI-adaptive) fusion algorithm of infrared and visible images by using the Laplacian Pyramid method. Firstly, we estimate the saliency map of infrared images, and then divide the infrared image into two parts: the regions of interest (RoI) and the regions of non-interest (nRoI), by normalizing the saliency map. Visible images are also segmented into two parts by using the Gauss High-pass filter: the regions of high frequency (RoH) and the regions of low frequency (RoL). Secondly, we down-sampled both the nRoI of infrared image and the RoL of visible image as the input of next level processing. Finally, we use normalized saliency map of infrared images as the weighted coefficient to get the basic image on the top level and choose max gray value of the RoI of infrared image and the RoH of visible image to get the detail image. In this way, our method can keep target feature of infrared image and texture detail information of visual image at the same time. Experiment results show that such fusion scheme performs better than the other fusion algorithms both on human visual system and quantitative metrics.

Original languageEnglish
Title of host publicationSixth International Conference on Graphic and Image Processing, ICGIP 2014
EditorsDavid Zhang, Yulin Wang, Xudong Jiang
PublisherSPIE
ISBN (Electronic)9781628415582
DOIs
StatePublished - 2015
Event6th International Conference on Graphic and Image Processing, ICGIP 2014 - Beijing, China
Duration: 24 Oct 201426 Oct 2014

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume9443
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference6th International Conference on Graphic and Image Processing, ICGIP 2014
Country/TerritoryChina
CityBeijing
Period24/10/1426/10/14

Keywords

  • Laplacian Pyramid
  • image fusion
  • infrared and visible Image
  • region of interest
  • saliency map

Fingerprint

Dive into the research topics of 'Multi-modal image fusion based on ROI and Laplacian Pyramid'. Together they form a unique fingerprint.

Cite this