Skip to main navigation Skip to search Skip to main content

Few-shot learning with relation propagation and constraint

  • Huiyun Gong
  • , Shuo Wang
  • , Xiaowei Zhao
  • , Yifan Yan
  • , Yuqing Ma*
  • , Wei Liu
  • , Xianglong Liu
  • *Corresponding author for this work
  • Beihang University
  • Xiamen University
  • BUAA-CCMU Advanced Innovation Center for Big Data-based Precision Medicine

Research output: Contribution to journalArticlepeer-review

Abstract

Previous deep learning methods usually required large-scale annotated data, which is computationally exhaustive and unrealistic in certain scenarios. Therefore, few-shot learning, where only a few annotated training images are available for training, has attracted increasing attention these days, showing huge potential in practical applications, such as portable equipment or security inspection, and so on. However, current few-shot learning methods usually neglect the valuable semantic correlations between samples, thereby failing in extracting discriminating relations to achieve accurate predictive results. In this work, extending on a recent state-of-the-art few-shot learning method, transductive relation-propagation network (TRPN), which considers the correlations between training samples, a constrained relation-propagation network is proposed to further regularise the distilled correlations and thus achieve favourable few-shot classification performance. The proposed framework contains three main components, namely preprocess module, relational propagation module, and relation constraint module. First, sample features are extracted and a relation graph node is constructed by treating the relation of each support–query pair as a graph node in the preprocess module. After that, in the relation propagation module (RPM), the valuable information of support–query pairs is modelled and propagated to directly generate the relational representations for further prediction. Then, a relation constraint module is introduced to regularise the relational representations and make it consistent with the ground-truth relations as much as possible. With the guidance of the effective RPM and relation constraint module, the relational representations of the support–query pairs are distinguishable and thus can achieve accurate predictive results. Comprehensive experiments conducted on widely used benchmarks validate the effectiveness of our method compared to state-of-the-art few-shot classification approaches.

Original languageEnglish
Pages (from-to)608-617
Number of pages10
JournalIET Computer Vision
Volume15
Issue number8
DOIs
StatePublished - Dec 2021

Keywords

  • computer vision
  • correlation methods
  • graph theory
  • image recognition

Fingerprint

Dive into the research topics of 'Few-shot learning with relation propagation and constraint'. Together they form a unique fingerprint.

Cite this