It was like playing against a wall. That鈥檚 how European Go champion Fan Hui described the experience of losing five straight games to AlphaGo, an artificial intelligence built by Google鈥檚 DeepMind team. 鈥淭he problem is humans sometimes make very big mistakes, because we are human,鈥� he said. 鈥淭he program is not like this.鈥�
Computers play lots of different games these days. As well as Go, the DeepMind team have pitted their algorithms against dozens of 80s arcade games and 3D mazes based on 90s shooters. There are bot-on-bot events involving first-person shooters like Unreal Tournament. And there are regular showdowns between bots and professional players, such as the annual .
Games are a great way to test AIs because they offer a range of challenges, says Julian Togelius at New York University. But as computers hone their gaming skills, we will need new ways to make them fun opponents.
Advertisement
Overall, we鈥檙e still winning. 鈥淭he best StarCraft-playing programs can barely beat a beginner,鈥� says Togelius. Computers are quickly closing the gap, though.
Togelius is interested in what鈥檚 known as general artificial intelligence 鈥� the kind of smarts that can be applied to many different problems. The problem is that you can鈥檛 achieve it by training an AI on one game. 鈥淵ou can鈥檛 just take AlphaGo and apply it to another problem, not even another game,鈥� he says. 鈥淒eep Blue beat Kasparov in chess but can鈥檛 play checkers. The best StarCraft bot is worthless at Super Mario Bros.鈥� The AI simply gets good at a specific task, and its skills aren鈥檛 transferable.
A general AI would be able to play many different games, even ones it has never seen before. Together with colleagues at the University of Essex, UK, and DeepMind, Togelius runs the 鈥� now in its third year 鈥� testing AIs across a variety of different arcade games. This year, events are planned for July, September and October.
To err is human
But to be truly entertaining opponents 鈥� as Fan found out 鈥� AIs need another human trait: the ability to make mistakes. 鈥淭his is actually one of the biggest problems with AI for games,鈥� says games developer Chris Hecker. 鈥淚t鈥檚 hugely important to make them fallible.鈥�
Hecker is working on a two-player game called . One player controls a spy who must blend into a small crowd of computer-controlled guests at a cocktail party to avoid being identified. The other player controls a sniper trying to pick the spy off. The spy tries to act like a bot while the sniper looks for human slips.
Hecker wants to add a single-player mode in which an AI takes on either the spy or sniper role. 鈥淭he big challenge is going to be making it feel like it鈥檚 fair and not cheating,鈥� says Hecker.
The spy role will require the AI to occasionally make a slip so that it stands out from the other computer-controlled guests. The sniper role will be even trickier to get right. 鈥淚t鈥檚 relatively trivial to make an AI that can kill a player every time, but making it feel like a worthy competitor and, more importantly, fun and interesting to play, is hard.鈥�
One solution is to have the AI sniper let players know what tipped it off. 鈥淚f it can remember and tell you, 鈥業 shot you because I saw you bug the ambassador,鈥� then that鈥檚 starting to be a conversation between the human and AI player that feels fair and natural,鈥� says Hecker.
But knowing why you lost doesn鈥檛 help if you lose every time. So Hecker wants the AI to play like a human would 鈥� with mistakes. The idea is to have the AI sniper gradually build up a case against each of the guests based on their actions, but then have it forget things. 鈥淚t is very hard as a human player to remember all the things each guest does, and I鈥檒l have to model that,鈥� he says.
The idea of fallible AI could open up whole new ways to play. and colleagues at the University of California, Santa Cruz, are developing a game called , which simulates a small community. The player has to investigate a death by interviewing characters who misremember and lie.
Unreliable characters like this are common in novels and TV dramas, but not in video games. When they appear, as in L.A. Noire, released in 2011, their false memories and lies are scripted.
Lyin鈥� AIs
This will not be the case in Talk of the Town. Each character is played by an AI agent with a mental model of the town and townsfolk. As the game proceeds, characters pick up information, some of it incorrect. They also share information with each other and have to choose whether or not to believe what they hear.
On top of this, characters鈥� memories fade or get muddled as the game progresses. 鈥淚f one agent believes another works at a certain bar in town, they might come to believe that the character works at a different bar,鈥� says Ryan 鈥� or even a dentist鈥檚.
The AI characters can also lie. 鈥淟ying is the most challenging aspect to model because lying is a very complex and nuanced human phenomenon,鈥� says Ryan. 鈥淧eople lie about all sorts of things for all sorts of reasons.鈥�
Fallibility will, of course, not be part of the job specification when AlphaGo takes on the world Go champion in Seoul, South Korea, next month. How might the outcome reflect on his opponent, in a part of the world where the game is taken very seriously?
鈥淚n China, Go is not just a game,鈥� Fan told reporters after his defeat. 鈥淚t is also a mirror on life. We say if you have a problem with your game, maybe you also have a problem in life.鈥�
