杏吧原创

IF THE computers we stare at all day could read our faces, they would probably know us better than anyone.

That vision may not be so far off. Researchers at the Massachusetts Institute of Technology鈥檚 Media Lab are developing software that can read the feelings behind facial expressions. In some cases, the computers outperform people. The software could lead to empathetic devices and is being used to evaluate and develop better adverts.

But the commercial uses are just 鈥渢he low-hanging fruit鈥�, says , a member of the Media Lab鈥檚 Affective Computing group. The software is getting so good and so easy to use that it could collate millions of peoples鈥� reactions to an event as they sit watching it at home, potentially replacing opinion polls, influencing elections and perhaps fuelling revolutions.

鈥淚 feel like this technology can enable us to give everybody a non-verbal voice, leverage the power of the crowd,鈥� el Kaliouby says. She and her colleagues have developed a program called that can interpret expressions on the basis of a few seconds of video. The software tracks 22 points around the mouth, eyes and nose, and notes the texture, colour, shape and movement of facial features. The researchers used machine-learning techniques to train to tell the difference between happiness and sadness, boredom and interest, disgust and contempt. In tests to appear in the IEEE Transactions on Affective Computing, the software proved to be better than humans at telling joyful smiles from frustrated smiles. A commercial version of the system, called Affdex, is now being used to test adverts (see 鈥淟ike what you see?鈥�).

聯The software proved to be better than humans at telling joyful smiles from frustrated smiles聰

Collecting emotional reactions in real time from millions of people could profoundly affect public polling. El Kaliouby, who is originally from Egypt, was in Cairo during the uprising against then-president Hosni Mubarak in 2011. She was startled that Mubarak seemed to think people liked his presidency, despite clear evidence to the contrary.

鈥淪he thought maybe Mubarak didn鈥檛 think a million people was a big enough response to believe that people are upset,鈥� lab director Rosalind Picard said at the lab鈥檚 spring meeting on 25 April. 鈥淭here are 80 million people in Egypt, and most of them were not there. If we could allow them the opportunity to safely and anonymously opt in and give their non-verbal feedback and join that conversation, that would be very powerful.鈥�

Pollsters could even collect facial reactions on the streets, or analyse the reaction of an audience listening to a politician鈥檚 speech. Picard鈥檚 group recently ran an MIT-wide experiment called Mood Meter, placing cameras all over campus to gauge the general mood. To preserve privacy, the cameras didn鈥檛 store any video or record faces 鈥� they just counted the number of people in the frame, and how many were smiling.

Frank Newport, editor in chief of political polling firm Gallup, headquartered in Washington DC, says such software could be useful. 鈥淭here鈥檚 no question that emotions and instincts have an impact in politics,鈥� he says. 鈥淲e鈥檙e certainly open to looking at anything along those lines.鈥� But he鈥檇 want to know how well facial responses predict actual votes.

Picard worries that the technology might have a dark side. 鈥淢y fear is that some of these dictators would want to blow away the village that doesn鈥檛 like them,鈥� she says. It would be important to protect the identities and IP addresses of viewers, she says.