A Deep Blind Image Quality Assessment with Visual Importance Based Patch Score

  • Zhengyi Lv
  • , Xiaochuan Wang
  • , Kai Wang
  • , Xiaohui Liang*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Convolutional neural networks (CNNs)-based no-reference image quality assessment (NR-IQA) suffers from insufficient training data. The conventional solution is splitting the training image into patches, assigning each patch the quality score, while the assignment of patch score is not consistent with the human visual system (HVS) well. To address the problem, we propose a patch quality assignment strategy, introducing the weighting map to describe the degree of visual importance of each distorted pixel, integrating the weighting map and the feature map to pool the quality score of each patch. With the patch quality, a CNNs-based NR-IQA model is trained. Experimental results demonstrate that proposed method, named as blind image quality metric with improved patch score (BIQIPS), improves the performance on most of the distortion types, especially on the types of local distortions, and achieves state-of-the-art prediction accuracy among the NR-IQA metrics.

Publication series

NameLecture Notes in Computer Science
Volume11362 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference2018 Scene Understanding and Modelling Challenge, SUMO 2018, 2018Learning and Inference Methods for High-Performance Imaging, LIMHPI 2018, 2018 Attention/Intention Understanding, AIU 2018, 2018 Museum Exhibit Identification Challenge for Domain Adaptation and Few-Shot Learning, 2018 RGB-D—Sensing and Understanding via Combined Color and Depth, 2018 Dense 3D Reconstruction for Dynamic Scenes, 2018 AI Aesthetics in Art and Media, AIAM 2018, 3rd International Workshop on Robust Reading, IWRR 2018, 2018 Artificial Intelligence for Retinal Image Analysis, AIRIA 2018, 2018 Combining Vision and Language, 1st International Workshop on Advanced Machine Vision for Real-Life and Industrially Relevant Applications, AMV 2018
Country/TerritoryAustralia
CityPerth
Period2/12/186/12/18

Keywords

  • Convolutional neural networks
  • Image quality assessment
  • Patch score
  • Visual importance

Fingerprint

Dive into the research topics of 'A Deep Blind Image Quality Assessment with Visual Importance Based Patch Score'. Together they form a unique fingerprint.

Cite this