
It starts off as unformed as any other infant, but this virtual ratâs knack for learning could take it a long way â perhaps all the way to Mars
IN January, Max Versace and Heather Ames were busy with two newborns: their son Gabriel and Animat, a virtual rat.
Like all babies, when Gabriel was born his brain allowed him to do only simple things like grasp, suck and see blurry images of his parents. The rest was up to him. From the first day his body experienced the world, his senses began to respond. He learned to follow a moving object with his eyes, tell red from yellow, and reach for his mother. Over the next couple of years, he will learn to crawl, walk, talk and, eventually, look after himself.
Advertisement
With any luck, Animatâs development will follow a similar path. It didnât start with much programming, either. But Animatâs interaction with its virtual world has already taught it how to tell colours apart and understand the space around it. As it develops, it will use its senses to learn even more.
Animatâs âparentsâ, researchers at Boston University, are trying to build intelligent machines based on the smartest machine we know of: the brain. But instead of focusing on programming the brain itself, they are taking a cue from biology. Like every human baby, and unlike the vast majority of engineered intelligence, the development of Animatâs intelligence will depend on the way its body senses the world. They hope this approach will advance machine intelligence to the point that robots start to think in a more human way.
That goal has proved a formidable challenge. Take Watson, IBMâs supercomputer which in February stole the crown from two human champions on the US quiz show Jeopardy! To do so, it used sophisticated successors of the first AI algorithms to tap massive databases stored on 90 servers. All that machinery required 80 kilowatts of energy to run, enough to power a small village. Our grey matter is spartan in comparison. âA brain consumes less power than a light bulb, and occupies less volume than a 2-litre bottle of soda,â says Dharmendra Modha, a computer scientist at IBM.
But power and space are just practical considerations. The more fundamental issue is that brute-force computation cannot compare with the functioning of a real brain. Human intelligence arises not from logic, but from our ability to respond to ambiguity and adjust to rapidly changing situations. âThe idea that human expertise can be formalised in logical rules turned out to be a fundamentally wrong assumption,â says Rolf Pfeifer, an AI researcher at the University of Zurich in Switzerland.
Researchers had started clamouring for a different approach decades ago. In the 1980s, Rodney Brooks at the Massachusetts Institute of Technology proposed an alternative. He argued that it was backwards to start by programming complex abilities, when we didnât even know how to make a rudimentary intelligence that could avoid bumping into walls. Instead, he said, we should emulate nature, which has given us senses that allow us to survive independently in an unscripted world. To build machines that can think without explicit instructions, Brooks reasoned, we first need to build their bodies.
âTo build machines that can think, we first need to build their bodiesâ
Brooksâs idea worked. In 1989, he built , a six-legged insect-robot that was able to navigate without the help of a central control system. Its sensors responded in real time to feedback it gleaned by interacting with its environment. As the robot walked around, for example, its force inputs changed, and these changes, in turn, steered its next movements, allowing it to negotiate terrain it had not been explicitly programmed to expect ().
Over the next decade, research in neurobiology, cognitive science and philosophy suggested that Brooksâs ideas applied much more broadly. In the late 1990s, George Lakoff, a cognitive scientist at the University of California, Berkeley, proposed that human intelligence, too, is inextricably linked to the way our bodies and senses interact with the environment. According to Lakoff and his supporters, our âembodied mindâ explains not only rudimentary intelligence, such as how we learn to visually recognise objects, but even complicated, abstract thought (). Here, at last, was the key to building a sophisticated, human-like intelligence.
There was just one problem: embodied AI is difficult to upgrade. Improving a robotâs sensor-laden body requires not just programming extra functions but the painstaking disassembly and reassembly of the sensors themselves. Despite these obstacles, a few researchers found the idea too compelling to abandon. In 2009, Owen Holland at the University of Sussex in Brighton, UK, created a humanoid robot modelled on some of the principles that had led to Genghis, called . However, Eccerobot is still incapable of even basic movements, and has exhibited no sign of intelligence. And so, even as advances in computing power have supercharged conventional AI, embodied AI limps on in ever-smaller circles.
Then, a couple of years ago, Versace and his team began to realise that there was hope for embodiment after all â if you skipped the physical body. Thanks to powerful new graphics cards, video game designers can simulate anything, including a robotâs body, the environment it lives in, and even the complex physics underlying the interactions between the two. âGraphics cards are starting to change the game of what questions you can pose,â says Ennio Mingolla, a cognitive scientist on the Animat team.
Accelerated learning
He and the rest of the team seized on these advances to âcheatâ at embodiment. Instead of toiling over a real body, they built a virtual one, whose synthetic sensors would interact with a painstakingly rendered virtual environment (). This way, they reasoned, they could reap all the advantages of embodied AI with none of the drawbacks. If it worked, they would be able to hit fast-forward on the evolution of an embodied intelligence.
Animat was born on 11 January. That was the day Versaceâs team hooked up its brain, which is made up of hundreds of neural models â for colour vision, motor function and anxiety, among others â all of which are faithful imitations of biology. That means they donât contain a list of explicit commands, just as Gabrielâs brain doesnât calculate his cot dimensions to figure out where to reach for a toy. âEverything is designed as closely as possible to its biological counterpart,â Versace says. âThere are no rules, per se.â
So, like Genghis, Animat depends on the feedback it gets from its virtual âbodyâ, which is equipped with the kinds of sensors found in skin and the retina, to learn and move. Unlike Genghis, however, every bit of Animat can be upgraded in the blink of an eye.
Its environment also obeys the laws of real-world physics, including gravity, giving Animat realistic sensory information. Light hits its virtual retina, for example, giving it colour vision, and correctly calibrated forces â for things like water and air pressure â are exerted against its simulated skin. Different combinations of such inputs drive Animatâs reactions.
Animatâs virtual world is a giant blue swimming pool surrounded by many poles, all different colours (see diagram). Like real rats, Animat hates water, courtesy of an anxious streak Mingolla included in its neural models. The only way to escape the water is to find a small platform hidden somewhere below the waterâs surface. The test of Animatâs intelligence is how quickly it learns to find that anxiety-alleviating platform.
The first experiment looked like a failure: Animat swam frantically in random patterns for an hour before the researchers gave up and ended the test. When they dropped it into the pool a second time, however, Animatâs swimming pattern changed. This time, after 45 minutes of swimming in a new pattern, it stumbled onto the platform. Its anxiety levels decreased sharply when it left the water, and that reward strengthened the connections that led it there. It now knew the colour of the poles near the platform, for example, and the approximate path it took to get there.
And sure enough, the third time it was chucked into the water, Animat spent far less time swimming before it found the platform, because it looked for the right coloured poles. On the fourth try, it didnât even hesitate: it swam directly to the platform. âYou could see the intelligence of the animal right away,â Versace says. âThat was the Eureka moment.â
Within a few years, Versaceâs team plans to create more Animats with expanded capabilities. As well as visually recognising objects, these creatures will hear and even communicate with each other. The optimistic time frame wouldnât be possible without the fast track virtual bodies provide.
Brain transplant
Auspicious as these early experiments may be, however, the virtual world is just a rehearsal space. The real test will come once Animatâs virtual body is swapped for a real one. After all, the ultimate goal is a robot that can move independently in the real world.
âThe virtual world is just a rehearsal space. The real test will come once Animatâs virtual body is swapped for a real oneâ
The advantage of such a machine over a traditionally built AI is that it would not require every possible scenario to be anticipated in the programming. That would save millions of lines of instructions. This means less hardware, and less hardware means less power is needed to run it all. And that, ultimately, is the point of embodied cognition: a machine that can move, make its own decisions, and survive in the real world on very little juice â just like we do.
The possibilities for such machine intelligence explain why, earlier this year, NASA came calling. A Mars rover with biological intelligence could learn to use its neural networks for vision, to balance itself, and to navigate away from rough terrain, eliminating the need for constant human supervision. âSuch a rover would also be able to plan its route, explore, sense its battery level and safely return to base,â Versace says. The team is already preparing a virtual Mars for Animat, complete with craters.
Because Animat is designed to learn like its biological counterparts, some familiar questions crop up. Can Animat feel pain? After all, Animat gets negative reinforcement, in the form of intense anxiety, and positive reinforcement in the form of instant relief when it reaches the hidden platform. âIt basically starts to build these representations of good and evil,â Versace says. So when should he start worrying about animal cruelty?
The point might not be as silly as it sounds. Feeling could be a crucial bridge between intelligence and consciousness. Some cognitive scientists think that basic mechanisms of reinforcement, such as anxiety and relief, are exactly how human consciousness arises. The âfeelâ of consciousness â the internal experience of seeing red or feeling pain â derives not from higher cognition, but from simple interactions with the world. âFeel is not something thatâs generated by our brains, but something that we do, a way of interacting with the world,â says Kevin OâRegan of the Institute of Neuroscience and Cognition at Paris Descartes University in France.
Neither Versace nor Ames believe Animat will develop consciousness. But they donât mind: they have their hands full with the embodied biological intelligence they created the old-fashioned way.