A computer system that recognises dance moves could synchronise music and lighting with a performance, or be incorporated into an interactive computer game, its designers say.
Researchers at Arizona State University in the US developed the system, which can recognise dance moves from normal video footage. They previously created a system that tracks a dancer鈥檚 movements using markers attached to their limbs and joints 鈥� a motion analysis technique known as 鈥渕otion capture鈥�.
鈥淯sing normal video cameras will make interactive dance performances user-friendly,鈥� says Gang Qian, a member of the research team. 鈥淚t鈥檚 less intrusive because there is no need to put markers on the subjects, and conditions like lighting and costume can be more flexible.鈥�
Advertisement
The researchers worked with professional dancers to develop the system, which uses two video cameras, one behind a dancer and the other to one side. 鈥淲ith two cameras, the system can identify dance poses more accurately,鈥� Qian explains. 鈥淭here are many ambiguous poses when using only one camera.鈥�
Dancing shadow
Video footage of a performer is fed to a computer that removes the background to produce a pair of white-on-black silhouettes. The computer then converts these silhouettes into numerical coordinates that can be compared to a library of twenty modern dance poses already stored in the system.
If the computer finds a statistically close match it signals that it has spotted a particular dance move. In tests involving different dancers the system was 83% accurate at identifying the moves stored in its memory. This could allow it to synchronise background music or stage lighting to an improvised dance performance, the researchers suggest. Or it could be incorporated into a dance-based computer game.
But Sean Gong, who researches computer recognition of human behaviour at Queen Mary鈥檚 University in London, US, says the system could also have limitations. 鈥淥ne of the problems with silhouette-based recognition is that it is very view dependent,鈥� he told New 杏吧原创. 鈥淵ou would need to have no clutter around, a relatively clean background, and the same viewing angle for the [computer] training and the final performance.鈥�
Gong adds that dancers probably need to be disciplined to ensure particular moves are recognised. 鈥淏ut dancing is probably one of the most challenging human movements to track,鈥� he adds, 鈥渁nd perfecting these systems could lead to the development of new kinds of entertainment.鈥�
