$S^2$-Flow: Joint Semantic and Style Editing of Facial Images


Krishnakant Singh (TU Darmstadt),* Simone Schaub-Meyer (TU Darmstadt), Stefan Roth (TU Darmstadt)
The 33rd British Machine Vision Conference

Abstract

The high-quality images yielded by generative adversarial networks (GANs) have motivated investigations into their application for image editing. However, GANs are often limited in the control they provide for performing specific edits. One of the principal challenges is the entangled latent space of GANs, which is not directly suitable for performing independent and detailed edits. Recent editing methods allow for either controlled style edits or controlled semantic edits. In addition, methods that use semantic masks to edit images have difficulty preserving the identity and are unable to perform controlled style edits. We propose a method to disentangle a GAN’s latent space into semantic and style spaces, enabling controlled semantic and style edits for face images independently within the same framework. To achieve this, we design an encoder-decoder based network architecture (S2-Flow), which incorporates two proposed inductive biases. We show the suitability of S2-Flow quantitatively and qualitatively by performing various semantic and style edits. Code and data are available at https://github.com/visinf/s2-flow.

Video



Citation

@inproceedings{Singh_2022_BMVC,
author    = {Krishnakant Singh and Simone Schaub-Meyer and Stefan Roth},
title     = {$S^2$-Flow: Joint Semantic and Style Editing of Facial Images},
booktitle = {33rd British Machine Vision Conference 2022, {BMVC} 2022, London, UK, November 21-24, 2022},
publisher = {{BMVA} Press},
year      = {2022},
url       = {https://bmvc2022.mpi-inf.mpg.de/0821.pdf}
}


Copyright © 2022 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection