Supervised coordinate descent method with a 3D bilinear model for face alignment and tracking.

Zhang, Y., Liu, S., Yang, X., Zhang, J. J. and Shi, D., 2017. Supervised coordinate descent method with a 3D bilinear model for face alignment and tracking. Computer Animation & Virtual Worlds, 28 (3-4), e1773.

Full text available as:

[img] PDF
Tmpl_paj.pdf - Accepted Version
Restricted to Repository staff only until 21 May 2018.

1MB

DOI: 10.1002/cav.1773

Abstract

Face alignment and tracking play important roles in facial performance capture. Existing data-driven methods for monocular videos suffer from large variations of pose and expression. In this paper, we propose an efficient and robust method for this task by introducing a novel supervised coordinate descent method with 3D bilinear representation. Instead of learning the mapping between the whole parameters and image features directly with a cascaded regression framework in current methods, we learn individual sets of parameters mappings separately step by step by a coordinate descent mean. Because different parameters make different contributions to the displacement of facial landmarks, our method is more discriminative to current whole-parameter cascaded regression methods. Benefiting from a 3D bilinear model learned from public databases, the proposed method can handle the head pose changes and extreme expressions out of plane better than other 2D-based methods. We present the reliable result of face tracking under various head poses and facial expressions on challenging video sequences collected online. The experimental results show that our method outperforms state-of-art data-driven methods.

Item Type:Article
ISSN:1546-4261
Uncontrolled Keywords:face alignment; face tracking; facial performance capture; supervised coordinate descent method
Group:Faculty of Media & Communication
ID Code:29349
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:16 Jun 2017 11:37
Last Modified:20 Jun 2017 13:45

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -