Skip to main content

Real-Time Facial Expression Transfer with Single Video Camera.

Liu, S., Yang, X., Wang, Z., Xiao, Z. and Zhang, J. J., 2016. Real-Time Facial Expression Transfer with Single Video Camera. Computer Animation and Virtual Worlds, 27 (3-4), 301-310.

Full text available as:

casa_2016.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.


DOI: 10.1002/cav.1697


Facial expression transfer is currently an active research field. However, 2D image wrapping based methods suffer from depth ambiguity and specific hardware is required for depth-based methods to work. We present a novel markerless, real time online facial transfer method that requires only a single video camera. Our method adapts a model to user specific facial data, computes expression variances in real time and rapidly transfers them to another target. Our method can be applied to videos without prior camera calibration and focal adjustment. It enables realistic online facial expression editing and performance transferring in many scenarios, such as: video conference; news broadcasting; lip-syncing for song performances; etc. With a low computational demand and hardware requirement, our method tracks a single user at an average of 38 fps. Our tracking method runs smoothly in web browsers despite their slower execution speed.

Item Type:Article
Uncontrolled Keywords:expression transfer;facial animation;facial tracking
Group:Faculty of Media & Communication
ID Code:23414
Deposited By: Symplectic RT2
Deposited On:15 Apr 2016 14:34
Last Modified:14 Mar 2022 13:55


Downloads per month over past year

More statistics for this item...
Repository Staff Only -