New vocal technology called Vocaloid:
- Developed at Pompeu Fabra University in Spain and financed by the Yamaha Corporation, the software, which is due to be released to consumers in January, allows users to cast their own (or anyone else's) songs in a disembodied but exceedingly life-like concert-quality voice. Just as a synthesizer might be programmed to play a series of notes like a violin one time and then like a tuba the next, a computer equipped with Vocaloid will be able to "sing" whatever combination of notes and words a user feeds it. The first generation of the software will be available for $200. But its arrival raises the prospect of a time when anyone with a laptop will be able to repurpose any singer's voice or even bring long-gone virtuosos back to life. In an era when our most popular singers are marketed in every conceivable way - dolls, T-shirts, notebooks, make-up lines - the voice may become one more extension of a pop-star brand.
The human voice has proven the most difficult of all sounds to synthesize. Digital technology can produce something clear enough to convey meaning, but only in a clipped monotone that sounds more like a robot than a real live person. A convincing human voice, spoken or sung, with all its complex, flowing articulations and quivering uncertainties has been unattainable. Yamaha has not yet made Vocaloid available for scrutiny, but judging by some early samples and demonstrations, the company seem to have made that quantum leap.
You can think of the software as a kind of audio font: musical notation and lyrics can be translated into the chosen voice, then saved for replay, just as a word processor might translate a text into Helvetica or Times New Roman and print it out as many times as you like.
These fonts are made up of a database of phonemes, the basic sounds that make up any language. To create the database, technicians record a singer performing as many as 60 pages of scripted articulations (like "epp, pep, lep"). Assorted pitches and techniques like glissandos and legatos are also thrown in the mix; with all the combinations, the process takes a week of five-hour singing days. The resultant font is "reminiscent" of the singer's voice, says Ed Stratton, the managing director of Zero-G Limited, a London-based company that has licensed the Vocaloid technology.
Article comments
1 - Tom Johnson
What a shame they couldn't have used a normal audio format. I couldn't make heads or tails of the all-Japanese site for the "Mid Radio Player" you have to use.
But wow, is this creepy. I'm already bothered by the software that keeps people's voices on key. I can see real abuses of this in the future - not only applying dead celebrities vocals to things they might never have had anything to do with were they alive, but also using these impersonations to spruce up half-finished demos or vault songs for release to the public. It's just wrong, man, wrong!
2 - Eric Olsen
Clapton font: "It's all wrong but it's alright.."
3 - TDavid
You can find windows media file format at the vocaloid site samples available here: http://www.vocaloid.com/en/sample.html
That first sample is downright eerie. Despite it being in Japanese and me not understanding a word, it sounds fantastic.
4 - Eric Olsen
thanks TD! The machines are coming to deal with difficult divas, recalcitrant harmonists, and pitch-challenged poptarts. Somewhere down the line we are going to have to decide what we really value about "humanness."