IF YOU鈥橰E sick of wading through a clogged email inbox or scrolling through endless Twitter timelines, J枚rg M眉ller has a more fun way of sifting through your messages: sound.
In his audio-enabled 鈥淏oomRoom鈥� at the Technical University of Berlin, Germany, emails and tweets fly around you like a flock of birds, each chirping a subtly different sound that identifies the sender. More urgent messages whizz directly over your head. Touch one and a computer reads it out.
Being able to direct sound in such a focused way has only recently become possible thanks to smarter audio processing algorithms, directional loudspeakers and gesture-recognition technology, says M眉ller. His flying email concept might still seem a bit far-fetched, but steering sound exactly where it is wanted is already catching on elsewhere in a number of different real-world applications. One day, it might even help create smart homes that can speak to their visually impaired owners.
Advertisement
For example, of San Diego, California, has developed a highly directional 鈥渉ypersound鈥� loudspeaker that makes audible sound ride on an inaudible ultrasound carrier wave. This allows a gamer to be immersed in stereo audio that only they can hear 鈥� and it was a gaming highlight of January鈥檚 Consumer Electronics Show in Las Vegas, Nevada.
Hypersound is also being trialled in branches of McDonald鈥檚 in Disneyland and North Euclid, California. 鈥淭here鈥檚 often a TV on in McDonald鈥檚 but not everyone wants to listen to it. So you can decide whether you want the TV sound beamed to your table,鈥� says Parametric Sound spokesman David Lowey. In toy shops, the Build-A-Bear chain is beaming instructions on how to build the toy to children using hypersound. 鈥淐ar makers are looking at it too 鈥� so only the driver hears the GPS navigation instructions,鈥� Lowey says.
鈥淒irected sound could be used in cars so that only the driver hears the GPS navigation instructions鈥�
Back in Berlin, the BoomRoom consists of a ring of 56 loudspeakers that allow sounds to be assigned stationary or mobile positions in the space around you (see diagram). An array of 16 gesture-recognising cameras allows you to control what those sounds do. A music track, for instance, could be assigned to an object in the room such as a vase. To play the track you simply pick up the vessel and 鈥減our out鈥� a track in mid air. Gestures such as moving your hands apart or bringing them together can alter qualities like volume, treble and bass. 鈥淭he instruments exist in mid-air so you can do your own sound mixing,鈥� says M眉ller, whose team is working alongside Sascha Spors of the University of Rostock, Germany.
The BoomRoom relies on a technique developed at the Delft University of Technology in the Netherlands called . This constructs a 3D sound field by cancelling and reinforcing sound waves in much the same way as a hologram does with light waves. The trick is to use an algorithm that controls the speakers precisely and uses constructive and destructive interference of the sound waves to place sounds where they are wanted, moment by moment. 鈥淚t鈥檚 actually easier to produce a 3D sound field than it is with light because audio frequencies are so much lower,鈥� says Spors.
Timing so many loudspeakers at once is crucial and it has only just become possible because the computer power needed to run the algorithms has finally been developed, says M眉ller. The speakers aren鈥檛 special in any way: all the WFS algorithms need to know is where each speaker is. 鈥淎ll the magic happens in software,鈥� says M眉ller. The system will be presented at the annual conference in Toronto, Canada, in April.
For M眉ller, the standout application of this technology is as a future smart room for people who are blind or sight-impaired. If a blind person entered a room, the important objects inside could announce their location. Users could also leave messages for one another in mid-air to be read out by a computer.
Another aim is to assign sounds to items in a room to reduce the number of gadgets we need. A bowl of marbles, for instance, could become an answering machine: the bowl could click when there are messages in it 鈥� and the user picks up a marble to hear a message. When they have heard it, pretending to pluck it out of the marble deletes the message.
To work in everyday life, the hope is that the flat panel actuators that act as loudspeakers by making glass and other flat surfaces vibrate will drop in price in coming years, making it cheap enough to fill houses with them. 鈥淲e believe that in the future loudspeaker panels will be integrated in walls,鈥� says M眉ller.
The technology could also be a boon to gamers. The BoomRoom was first used for an audio-based lightsaber game in which a blindfolded person had to react to the 鈥渮ummm, zummm鈥� of a digital adversary鈥檚 lightsaber, their voice or their breath on the back of their neck. It worked too well: 鈥淭hey found it impressively immersive and fun to use. But some hit out quite frantically and we had to calm them down to stop them hitting the speakers,鈥� says M眉ller.
Sound sculptor Bill Fontana of San Francisco, California 鈥� who once playing in the hall of the nearby Tate Modern 鈥� describes the Berlin technology as having fantastic potential to push sound in novel directions. 鈥淭here is a lot of uncharted territory with using sound in our living and architectural spaces. Culturally, we are acoustically illiterate in many ways and regard most sound as noise.鈥�
This article appeared in print under the headline 鈥淧ure sound, direct to you鈥�
