Skip to main content

FrseGAN: Free-style editable facial makeup transfer based on GAN combined with transformer.

Xu, W., Wang, P. and Yang, X., 2024. FrseGAN: Free-style editable facial makeup transfer based on GAN combined with transformer. Computer Animation and Virtual Worlds, 35 (3), e2235.

Full text available as:

FrseGAN.pdf - Published Version
Available under License Creative Commons Attribution.


DOI: 10.1002/cav.2235


Makeup in real life varies widely and is personalized, presenting a key challenge in makeup transfer. Most previous makeup transfer techniques divide the face into distinct regions for color transfer, frequently neglecting details like eyeshadow and facial contours. Given the successful advancements of Transformers in various visual tasks, we believe that this technology holds large potential in addressing pose, expression, and occlusion differences. To explore this, we propose novel pipeline which combines well-designed Convolutional Neural Network with Transformer to leverage the advantages of both networks for high-quality facial makeup transfer. This enables hierarchical extraction of both local and global facial features, facilitating the encoding of facial attributes into pyramid feature maps. Furthermore, a Low-Frequency Information Fusion Module is proposed to address the problem of large pose and expression variations which exist between the source and reference faces by extracting makeup features from the reference and adapting them to the source. Experiments demonstrate that our method produces makeup faces that are visually more detailed and realistic, yielding superior results.

Item Type:Article
Uncontrolled Keywords:generative adversarial networks; makeup transfer; transformer
Group:Faculty of Media & Communication
ID Code:40075
Deposited By: Symplectic RT2
Deposited On:25 Jun 2024 10:23
Last Modified:25 Jun 2024 10:23


Downloads per month over past year

More statistics for this item...
Repository Staff Only -