Abstract
Unsupervised multi-style image translation is an important and challenging study in the task of image translation. The translation relations between interrelated images should be analyzed from multiple angles as these relations are not merely unidirectional or based on a single factor. Multi-style image translation algorithms have recently emerged to establish a multifaceted relationship between coupled images and interpret their features, which can fully express the content and semantic information of these images. One key algorithm, the multimodal unsupervised image-to-image translation (MUNIT), achieves reasonable unsupervised translation, but its image style representation is random noise, which leads to suboptimal multi-style representation. In order to achieve better multi-style image translation, we propose an improved MUNIT scheme equipped with style coding, skip connection, and a self-attention mechanism. The proposed scheme pays more attention to image style coding as well as the global and detailed image information. Through extensive experimental comparisons with state-of-the-art methods on various image translation tasks, the advantages of this scheme are demonstrated qualitatively and quantitatively. The code and tutorials have already released at https://github.com/huawang123/LatentStyle.
| Original language | English |
|---|---|
| Pages (from-to) | 359-368 |
| Number of pages | 10 |
| Journal | Signal, Image and Video Processing |
| Volume | 16 |
| Issue number | 2 |
| DOIs | |
| State | Published - Mar 2022 |
Keywords
- Generative adversarial network
- Image-to-image translation
- Multimodal unsupervised image-to-image translation (MUNIT)
- Skip connection
Fingerprint
Dive into the research topics of 'Latent Style: multi-style image transfer via latent style coding and skip connection'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver