The 4th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Conference 12-15 December • Exhibition 13-15 December • Hong Kong Convention & Exhibition Centre

Emerging Technologies

Kinect-Based Facial Animation

In this exhibition we present our system for performance-based character animation that enables any user to control the facial expressions of a digital avatar in real time. Compared to existing technologies, our system is easy to deploy and does not require any face markers, intrusive lighting, or complex scanning hardware. Instead, the user is recorded in a natural environment using the non-intrusive, commercially available Microsoft Kinect 3D sensor. High noise levels in the acquired data prevent conventional tracking methods from working well, and we developed a method to combine a database of existing animations with facial tracking to overcome this limitation and generate compelling animations. Realistic facial tracking facilitates a range of new applications, for example in digital gameplay, telepresence or social interactions.

Thibaut Weise, École Polytechnique Fédérale de Lausanne
Sofien Bouaziz, École Polytechnique Fédérale de Lausanne
Hao Li, Columbia University
Mark Pauly, École Polytechnique Fédérale de Lausanne