Teaching artificial intelligence to understand simple physics concepts, such as that one solid object can鈥檛 occupy the same space as another, could lead to more capable software that takes less computational resources to train, say researchers at DeepMind.
The UK-based company has previously created AI that can beat expert players at chess and Go, write computer software and solve the protein-folding problem. But these models are highly specialised and lack a general understanding of the world. As DeepMind鈥檚 researchers say in their latest paper, 鈥渟omething fundamental is still missing鈥�.
Now, at DeepMind and his colleagues have created an AI called Physics Learning through Auto-encoding and Tracking Objects (PLATO) that is designed to understand that the physical world is composed of objects that follow basic physical laws.
Advertisement
The researchers trained PLATO to identify objects and their interactions by using simulated videos of objects moving as we would expect, such as balls falling to the ground, rolling behind each other and bouncing off each other. They also gave PLATO data showing exactly which pixels in every frame belonged to each object.
To test PLATO鈥檚 ability to understand five physical concepts such as persistence (that an object tends not to vanish), solidity and unchangingness (that an object tends to retain features like shape and colour), the researchers used another series of simulated videos. Some showed objects obeying the laws of physics, while others depicted nonsensical actions, such as a ball rolling behind a pillar, not emerging from the other side, but then reappearing from behind another pillar further along its route.
They tasked PLATO to predict what would happen next in each video, and found that its predictions were reliably wrong for nonsensical videos, but usually correct for logical ones, suggesting the AI has an intuitive knowledge of physics.
Piloto says the results show that an object-centric view of the world could give an AI a more generalised and adaptable set of abilities. 鈥淚f you consider, for instance, all the different scenes that an apple might be in,鈥� he says. 鈥淵ou don鈥檛 have to learn about an apple on a tree, versus an apple in your kitchen, versus an apple in the garbage. When you kind of isolate the apple as its own thing, you鈥檙e in a better position to generalise how it behaves in new systems, in new contexts. It provides learning efficiency.鈥�
at the University of Southampton, UK, says the work could lead to new avenues of AI research, and may even reveal clues about human vision and development. But he expressed concerns about reproducibility because the paper says that 鈥渙ur implementation of PLATO is not externally viable鈥�.
鈥淭hat means they鈥檙e using an architecture that other people probably can鈥檛 use,鈥� he says. 鈥淚n science, it鈥檚 good to be reproducible so that other people can get the same results and then take them further.鈥�
at New York University says the findings could help to lower the computational requirements for training and running AI models.
鈥淭his is somewhat like teaching a kid what a car is by first teaching them what wheels and seats are,鈥� he says. 鈥淭he benefit of using object-centric representation, instead of raw visual inputs, makes AI learn intuitive physical concepts with better data efficiency.鈥�
Nature Human Behaviour
