Disney researchers develop new automated process for cloning human faces
August 14, 2012
Left: Photograph and scanned 3D geometry of a human face. A physics-based optimization process is used to design the geometry of a synthetic skin in order to best match given target expressions. Right: final animatronic figure with fabricated skin. (Credit: Disney Research)
Researchers at Disney Research, Zürich, ETH Zürich, and Walt Disney Imagineering R&D have developed a new computational design process for cloning human faces that could greatly simplify the creation of synthetic skin for animatronic characters.
Background
Animatronics aims at creating physical robots that move and look like real humans. Many impressive characters have been created in this spirit, like those in the Hall of Presidents attraction at Walt Disney World. Until now, creating animatronic copies of real human individuals has been a difficult and labor-intensive process requiring the manual work of skilled animators, material designers and mechanical engineers.
Due to its expressive power, replicating the human face presents huge challenges. To deliver compelling and realistic performances, an animatronic character must produce a vast range of facial expressions, each having different deformations and wrinkles. Manually designing the shape and material properties of a single skin that is able to achieve all of these targets is a formidable task.
Bring in the clones
So the Zürich researchers invented a computational method for automatically designing synthetic skin to match real individuals.
The process starts by scanning 3D facial expressions from a human subject. Then, a novel optimization scheme determines the shape of the synthetic skin as well as control parameters for the robotic head that provide the best match to the human subject. This processing increases the realism of the resulting character, resulting in an animatronic face that closely resembles the human subject.
“With our method, we can simply create a robotic clone of a real person,” said Dr. Bernd Bickel, researcher at Disney Research, Zürich. “The custom digitally designed skin can be fabricated using injection molding and modern rapid prototyping technology. We 3D print a mold and use elastic silicon with properties similar to human skin as base material”.
“This innovative research builds upon our heritage in ‘Audio-Animatronics’ pioneered by Walt Disney himself,” said Prof. Markus Gross, director of Disney Research, Zürich. “Physical face cloning enables us to create personalized animatronic figures based on real individuals with a level of fidelity and realism never before possible.”
Their findings were presented at ACM SIGGRAPH 2012.