Skip to main content

Real-Time Facial Expression Transfer with Single Video Camera.

Liu, S., Yang, X., Wang, Z., Xiao, Z. and Zhang, J. J., 2016. Real-Time Facial Expression Transfer with Single Video Camera. Computer Animation and Virtual Worlds, 27 (3-4), 301-310.

Full text available as:

[img]
Preview
PDF
casa_2016.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

6MB

DOI: 10.1002/cav.1697

Abstract

Facial expression transfer is currently an active research field. However, 2D image wrapping based methods suffer from depth ambiguity and specific hardware is required for depth-based methods to work. We present a novel markerless, real time online facial transfer method that requires only a single video camera. Our method adapts a model to user specific facial data, computes expression variances in real time and rapidly transfers them to another target. Our method can be applied to videos without prior camera calibration and focal adjustment. It enables realistic online facial expression editing and performance transferring in many scenarios, such as: video conference; news broadcasting; lip-syncing for song performances; etc. With a low computational demand and hardware requirement, our method tracks a single user at an average of 38 fps. Our tracking method runs smoothly in web browsers despite their slower execution speed.

Item Type:Article
ISSN:1546-4261
Uncontrolled Keywords:expression transfer;facial animation;facial tracking
Group:Faculty of Media & Communication
ID Code:23414
Deposited By: Symplectic RT2
Deposited On:15 Apr 2016 14:34
Last Modified:14 Mar 2022 13:55

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -