Relation-Aware Reasoning with Graph Convolutional Network

  • Lei Zhou
  • , Yang Liu
  • , Xiao Bai*
  • , Xiang Wang
  • , Chen Wang
  • , Liang Zhang
  • , Lin Gu
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Semantic dependencies among objects are crucial for the recognition system to enhance performance. However, utilizing object-object relationships is a non-trivial task as objects are of various scales and locations, leading to irregular relationships. In this paper, we present a novel visual reasoning framework that incorporates both semantic and spatial relationships to improve the recognition system. We at first construct a knowledge graph to represent the co-occurrence frequency and relative position among categories. Based on this knowledge graph, we are able to enhance the original regional features by a Graph Convolutional Network (GCN) that encodes the high-level semantic contexts. Experiments show that our framework manages to outperform the baselines and state-of-the-art on different backbones in terms of both per-instance and per-class classification accuracy.

Original languageEnglish
Title of host publicationImage and Graphics - 11th International Conference, ICIG 2021, Proceedings
EditorsYuxin Peng, Shi-Min Hu, Moncef Gabbouj, Kun Zhou, Michael Elad, Kun Xu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages52-64
Number of pages13
ISBN (Print)9783030873547
DOIs
StatePublished - 2021
Event11th International Conference on Image and Graphics, ICIG 2021 - Haikou, China
Duration: 6 Aug 20218 Aug 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12888 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th International Conference on Image and Graphics, ICIG 2021
Country/TerritoryChina
CityHaikou
Period6/08/218/08/21

Keywords

  • Graph Convolutional Network
  • Knowledge graph
  • Object-object relationship
  • Visual reasoning

Fingerprint

Dive into the research topics of 'Relation-Aware Reasoning with Graph Convolutional Network'. Together they form a unique fingerprint.

Cite this