杏吧原创

Talk with a dolphin via underwater translation machine

A computer system that divers can wear may bridge the language barrier between us and dolphins
鈥淪o long, and thanks for all the fish鈥
(Image: Flip Nicklin/Minden/FLPA)

Editorial:The implications of interspecies communication

A DIVER carrying a computer that tries to recognise dolphin sounds and generate responses in real time will soon attempt to communicate with wild dolphins off the coast of Florida. If the bid is successful, it will be a big step towards two-way communication between humans and dolphins.

Since the 1960s, captive dolphins have been communicating via pictures and sounds. In the 1990s, Louis Herman of the Kewalo Basin Marine Mammal Laboratory in Honolulu, Hawaii, found that bottlenose dolphins can keep track of over 100 different words. They can also respond appropriately to commands in which the same words appear in a different order, understanding the difference between 鈥渂ring the surfboard to the man鈥 and 鈥渂ring the man to the surfboard鈥, for example.

But communication in most of these early experiments was one-way, says , founder of the Wild Dolphin Project in Jupiter, Florida. 鈥淭hey create a system and expect the dolphins to learn it, and they do, but the dolphins are not empowered to use the system to request things from the humans,鈥 she says.

Since 1998, Herzing and colleagues have been attempting two-way communication with dolphins, first using rudimentary artificial sounds, then by getting them to associate the sounds with four large icons on an underwater 鈥渒eyboard鈥.

By pointing their bodies at the different symbols, the dolphins could make requests 鈥 to play with a piece of seaweed or ride the bow wave of the divers鈥 boat, for example. The system managed to get the dolphins鈥 attention, Herzing says, but wasn鈥檛 鈥渄olphin-friendly鈥 enough to be successful.

Herzing is now collaborating with , an artificial intelligence researcher at the Georgia Institute of Technology in Atlanta, on a project named Cetacean Hearing and Telemetry (CHAT). They want to work with dolphins to 鈥渃o-create鈥 a language that uses features of sounds that wild dolphins communicate with naturally.

Knowing what to listen for is a huge challenge. Dolphins can produce sound at frequencies up to 200 kilohertz 鈥 around 10 times as high as the highest pitch we can hear 鈥 and can also shift a signal鈥檚 pitch or stretch it out over a long period of time.

The animals can also project sound in different directions without turning their heads, making it difficult to use visual cues alone to identify which dolphin in a pod 鈥渟aid鈥 what and to guess what a sound might mean.

To record, interpret and respond to dolphin sounds, Starner and his students are building a prototype device featuring a smartphone-sized computer and two hydrophones capable of detecting the full range of dolphin sounds.

A diver will carry the computer in a waterproof case worn across the chest, and LEDs embedded around the diver鈥檚 mask will light up to show where a sound picked up by the hydrophones originates from. The diver will also have a Twiddler 鈥 a handheld device that acts as a combination of mouse and keyboard 鈥 for selecting what kind of sound to make in response.

Herzing and Starner will start testing the system on wild Atlantic spotted dolphins (Stenella frontalis) in the middle of this year. At first, divers will play back one of eight 鈥渨ords鈥 coined by the team to mean 鈥渟eaweed鈥 or 鈥渂ow wave ride鈥, for example. The software will listen to see if the dolphins mimic them. Once the system can recognise these mimicked words, the idea is to use it to crack a much harder problem: listening to natural dolphin sounds and pulling out salient features that may be the 鈥渇undamental units鈥 of dolphin communication.

聯The idea is to work with dolphins to create a language featuring sounds dolphins already use聰

The researchers don鈥檛 know what these units might be. But the algorithms they are using are designed to sift through any unfamiliar data set and pick out interesting features (see 鈥淧attern detector鈥). The software does this by assuming an average state for the data and labelling features that deviate from it. It then groups similar types of deviations 鈥 distinct sets of clicks or whistles, say 鈥 and continues to do so until it has extracted all potentially interesting patterns.

Once these units are identified, Herzing hopes to combine them to make dolphin-like signals that the animals find more interesting than human-coined 鈥渨ords鈥. By associating behaviours and objects with these sounds, she may be the first to decode the rudiments of dolphins鈥 natural language.

of the , a non-profit organisation in Old Mystic, Connecticut, thinks that getting wild dolphins to adopt and use artificial 鈥渨ords鈥 could work, but is sceptical that the team will find 鈥渇undamental units鈥 of natural dolphin communication.

Even if they do, deciphering their meanings and using them in the correct context poses a daunting challenge. 鈥淚magine if an alien species landed on Earth wearing elaborate spacesuits and walked through Manhattan speaking random lines from The Godfather to passers-by,鈥 he says.

鈥淲e don鈥檛 even know if dolphins have words,鈥 Herzing admits. But she adds, 鈥淲e could use their signals, if we knew them. We just don鈥檛.鈥

Pattern detector

The software that Thad Starner is using to make sense of dolphin sounds was originally designed by him and a former student, David Minnen, to 鈥渄iscover鈥 interesting features in any data set. After analysing a sign-language video, the software labelled 23 of 40 signs used. It also identified when the person started and stopped signing, or scratched their head.

The software has also identified gym routines 鈥 dumb-bell curls, for example 鈥 by analysing readings from accelerometers worn by the person exercising, even though the software had not previously encountered such data. However, Starner cautions that if meaning must be ascribed to the patterns picked out by the software, then this will require human input.