
This week, Google鈥檚 AlphaGo beat a grandmaster at the complex game Go 鈥 an artificial intelligence milestone (see 鈥How victory for Google鈥檚 Go AI is stoking fear in South Korea鈥, 鈥Machines are teaching themselves to grapple with the real world鈥 and 鈥Humans strike back: How Lee Sedol won a game against AlphaGo鈥). Here鈥檚 what the experts say AI鈥檚 next big challenge should be.
No-limit poker: Go represents the ultimate in games where all the information is available to the players. But AI still struggles with games where information is incomplete 鈥 like poker, where a player doesn鈥檛 know what card is coming next.
鈥淐omputers have beaten the best people at heads-up limit Texas Hold鈥檈m, but not yet at no-limit, a much more complicated game,鈥 says Peter Stone at the University of Texas at Austin.
Advertisement
Diplomacy: 鈥淎lphaGo doesn鈥檛 know the meaning of any of the symbols it is so adroitly manipulating: it doesn鈥檛 even know that it is playing Go,鈥 says Mark Bishop at Goldsmiths, University of London. So he suggests the strategy board game Diplomacy, in which players pose as European powers competing for land and resources.
Diplomacy embodies many of the obstacles between current and true AI. 鈥淚nterestingly, it is a game that in theory a computer could play very well, as moves are communicated in writing,鈥 says Bishop. But it would have to pass the Turing test 鈥 humans could team up against the AI if they figured out which player it was.
鈥淭hese twists on gaming go beyond the mathematical challenges being breached by current AI鈥
StarCraft: In Go, there might be about 300 possible moves at any time. In StarCraft, a strategy video game with hundreds of pieces, there might be 10300. 鈥淵ou can鈥檛 even examine all possible moves in the current state, let alone all possible future move sequences,鈥 says Stuart Russell at the University of California, Berkeley.
Instead, the AI would have to consider its actions and goals on a higher level, then work out a plan to get there 鈥 requiring reasoning methods applicable to a wider range of real problems.
Dungeons & Dragons: 鈥淲hat we鈥檙e seeing with AlphaGo is not trying to prove or disprove a humanlike sense of reality or believability, but instead is purely goal-centred 鈥 to win the game,鈥 says Julie Carpenter at the California Polytechnic State University in聽San Luis Obispo. She says it would be interesting to throw AI at something like a role-playing game. There, the machine鈥檚 goals wouldn鈥檛 be as obvious. It would need to rely on skills like social communication and higher-level situational awareness in order to succeed.
Cheating: Human players can read their opponent鈥檚 faces and body language for clues about what to do next. They can also get ahead by using deceptive tactics, like misdirection. Could a robotic hustler ever successfully spot these false behaviours 鈥 or even cheat without being detected? 鈥淭hese twists on gaming go beyond the largely mathematical challenges that are currently being breached by current AI,鈥 says Ronald Arkin of the Georgia Institute of Technology in Atlanta.
The real world: 鈥淚鈥檓 not particularly interested in seeing AI pitted against other games,鈥 says Murray Shanahan at Imperial College London. That鈥檚 useful for testing an algorithm or new learning methods, he says, but the true frontier is the real world. 鈥淲hen machine learning is as good at understanding the everyday world as it is at Go, we鈥檒l be well on the way to human-level artificial general intelligence.鈥
This article appeared in print under the headline 鈥淭ime to raise the game鈥
Article amended on 9 May 2016
Correction: We had the affiliation of Julie Carpenter wrong when this article was first published. It has now been corrected.