
In Harry Potterās universe, people in portraits and pictures donāt just sit there. They smile, gasp, wink, or get up to mischief. Facebook has been hard at work making this a reality for your profile pic as well.
Their new tool only requires a single image of a face as input. From this, it is then able to create an animated version that puts on either a happy, sad, or angry expression. This is no mere animated gif ā in theory, any expression could beĀ mapped to your face, including ones you would never think of making. The effect is sometimes a little strange to watch, but in a study half of the people who saw the animations were fooled into thinking that they were real.
āWeāve shown that reactive profile pictures are possible,ā says at Tel Aviv University, who conducted the research as part of a collaboration with Facebook.
Advertisement
To create the animations, the tool uses a ābaseā video of another completely different person. That person doesnāt have to be the same gender or look remotely similar. Their facial expression is mapped onto the still image and then warped so that it starts to look like an animated expression.
However, warping alone isnāt enough. When someone smiles they often go from not showing any teeth to revealing a set of pearly whites. However, from a single image, the system doesnāt necessarily know what the personās teeth look like so it has to steal them from the helper video.
āWe found that if we change the teeth people donāt notice too much,ā says Averbuch-Elor.
TheĀ team also showcased several ways Facebook could make use of these reactive profile pictures. For example, when someone clicks ālikeā on a post the profile picture could smile in response.
Systems like this are improving all the time. āI think eventually they will be completely indistinguishable from real videos,ā says Averbuch-Elor. In the future, the tool could be combined with natural language processing, so that when you are messaging with someone rather than a static image you see an animated version of the person reacting to whatās being said.
The project will be presented at the Conference on Techniques in Bangkok, Thailand later this month.