Google has trained an artificial intelligence, named SingSong, that can generate a musical backing track to accompany people鈥檚 recorded singing.
To develop it, Jesse Engel and his colleagues at Google Research used an algorithm to separate the instrumental and vocal parts from 46,000 hours of music and then fine-tuned an existing AI model 鈥� also created by Google Research, but for generating 鈥� on those pairs of recordings.
After that training, the adapted AI was able to accept new vocal recordings that weren鈥檛 in the training data and create a backing track for them.
Advertisement
To judge its abilities, the researchers got people to listen to 800 pairs of song clips, each 10 seconds long. In each pair of clips, one had a vocal that had been given a backing track by SingSong, while the other had the same vocal with either an existing human-generated backing track that matched the beat and key as closely as possible, the original backing track for the vocal or an entirely random backing track.
In 66 per cent of the trials, participants preferred the SingSong version when asked which clip had the backing track that was more 鈥渕usically compatible with the vocals鈥�. You can .
at Goldsmiths, University of London says the output of the AI is convincing in terms of key, melody and harmony.
鈥淚 wouldn鈥檛 say you鈥檇 release it as a finished track. It would need development, but it seems to be working in terms of coherence, for sure. The grooves it鈥檚 suggesting, they work and they鈥檙e interesting. And unexpected, some of them, in a good way that feels like working with another musician,鈥� she says. 鈥淚t鈥檚 exciting and I could certainly see it as part of a process to suggest ideas really quickly. It鈥檚 not going to take over quite yet, but I think it鈥檚 going to be facilitative for a lot of musicians.鈥�
The results of SingSong are impressive and convincing in most cases, says at the University of Oxford, but he cautions that the technology has the potential to disrupt music production.
鈥淚 have some misgivings about what this will mean culturally for us generally, as well as the implications for those musicians whose skill and musical ideas are being mimicked through the SingSong鈥檚 trawl of the internet,鈥� he says.
The Google team didn鈥檛 respond to an interview request.
The AI might not work for everybody yet, though. The team writes that SingSong was less able to generate good backing tracks when the vocals were recorded by amateur singers because the tempo and pitch varied too much. The group suggests that in future versions, people could sing along to a metronome and automatic pitch correction could be applied to their recordings.
Reference:
