Skip to main navigation Skip to search Skip to main content

MATGAN: Unified GANs for Multimodal Attribute Transfer by Coarse-to-Fine Disentangling Representations

  • Xi Guo
  • , Qiang Rao
  • , Kun He
  • , Fang Chen
  • , Bing Yu
  • , Bailan Feng
  • , Jian Huang*
  • , Qin Yang
  • *Corresponding author for this work
  • Beihang University
  • Huawei Technologies Co., Ltd.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Image attribute transfer aims to change an image to a target one with desired attributes. There are mainly two challenges for this task: multi-domain transfer and attribute-level multimodality. The first means editing multiple attributes using a single model and the second means diverse appearances for the target attribute. Existing methods cannot address the two problems simultaneously. Moreover, many works focus on image-level multimodality rather than attribute-level. In this paper, we propose a novel coarse-to-fine disentangling representation framework MATGAN to achieve Multimodal Attribute Transfer. In the coarse disentangling stage, we propose to embed images onto a content space and an attribute space for image-level multimodality. In the fine disentangling stage, we further disentangle the attribute space to bind with each attribute for attribute-level multimodal and multi-domain transfer. Extensive experiments demonstrate the effectiveness of our approach.

Original languageEnglish
Title of host publicationProceedings - 2022 International Conference on Frontiers of Artificial Intelligence and Machine Learning, FAIML 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages109-119
Number of pages11
ISBN (Electronic)9781665473644
DOIs
StatePublished - 2022
Event2022 International Conference on Frontiers of Artificial Intelligence and Machine Learning, FAIML 2022 - Virtual, Online, China
Duration: 19 Jul 2022 → 21 Jul 2022

Publication series

NameProceedings - 2022 International Conference on Frontiers of Artificial Intelligence and Machine Learning, FAIML 2022

Conference

Conference2022 International Conference on Frontiers of Artificial Intelligence and Machine Learning, FAIML 2022
Country/TerritoryChina
CityVirtual, Online
Period19/07/22 → 21/07/22

Keywords

  • disentangling representations
  • generative adversarial networks
  • multimodal attribute transfer

Fingerprint

Dive into the research topics of 'MATGAN: Unified GANs for Multimodal Attribute Transfer by Coarse-to-Fine Disentangling Representations'. Together they form a unique fingerprint.

Cite this