The revelation that a documentary filmmaker used voice-cloning software to make the late chef Anthony Bourdain say words he never spoke has drawn criticism amid ethical concerns about use of the powerful technology.
The movie Roadrunner: A Film About Anthony Bourdain appeared in cinemas Friday and mostly features real footage of the beloved celebrity chef and globe-trotting television host before he died in 2018. But its director, Morgan Neville, told The New Yorker that a snippet of dialogue was created using artificial intelligence technology.
Thats renewed a debate about the future of voice-cloning technology, not just in the entertainment world but in politics and a fast-growing commercial sector dedicated to transforming text into realistic-sounding human speech.
Unapproved voice cloning is a slippery slope, said Andrew Mason, the founder and CEO of voice generator Descript, in a blog post Friday. As soon as you get into a world where youre making subjective judgment calls about whether specific cases can be ethical, it wont be long before anything goes.
Before this week, most of the public controversy around such technologies focused on the creation of hard-to-detect deepfakes using simulated audio and/or video and their potential to fuel misinformation and political conflict.
But Mason, who previously founded and led Groupon, said in an interview that Descript has repeatedly rejected requests to bring back a voice, including from people who have lost someone and are grieving.
Its not even so much that we want to pass judgment, he said. Were just saying you have to have some bright lines in whats OK and whats not.
Angry and uncomfortable reactions to the voice cloning in the Bourdain case reflect expectations and issues of disclosure and consent, said Sam Gregory, program director at Witness, a nonprofit working on using video technology for human rights. Obtaining consent and disclosing the technowizardry at work would have been appropriate, he said. Instead, viewers were stunned first by the fact of the audio fakery, then by the directors seeming dismissal of any ethical questions and expressed their displeasure online.
It touches also on our fears of death and ideas about the way people could take control of our digital likeness and make us say or do things without any way to stop it, Gregory said.
Neville hasnt identified what tool he used to recreate Bourdains voice but said he used it for a few sentences that Bourdain wrote but never said aloud.
With the blessing of his estate and literary agent we used AI technology, Neville said in a written statement. It was a modern storytelling technique that I used in a few places where I thought it was important to make Tonys words come alive.
Neville also told GQ magazine that he got the approval of Bourdains widow and literary executor. The chefs wife, Ottavia Busia, responded by tweet: I certainly was NOT the one who said Tony would have been cool with that.
Although tech giants like Microsoft, Google and Amazon have dominated text-to-speech research, there are now also a number of startups like Descript that offer voice-cloning software. The uses range from talking customer service chatbots to video games and podcasting.
Many of these voice cloning companies prominently feature an ethics policy on their website that explains the terms of use. Of nearly a dozen firms contacted by The Associated Press, many said they didnt recreate Bourdains voice and wouldnt have if asked. Others didnt respond.
We have pretty strong polices around what can be done on our platform, said Zohaib Ahmed, founder and CEO of Resemble AI, a Toronto company that sells a custom AI voice generator service. When youre creating a voice clone, it requires consent from whoevers voice it is.
Ahmed said the rare occasions where hes allowed some posthumous voice cloning were for academic research, including a project working with the voice of Winston Churchill, who died in 1965.
Ahmed said a more common commercial use is to edit a TV ad recorded by real voice actors and then customize it to a region by adding a local reference. Its also used to dub anime movies and other videos, by taking a voice in one language and making it speak a different language, he said.
He compared it to past innovations in the entertainment industry, from stunt actors to greenscreen technology.
Just seconds or minutes of recorded human speech can help teach an AI system to generate its own synthetic speech, though getting it to capture the clarity and rhythm of Anthony Bourdains voice probably took a lot more training, said Rupal Patel, a professor at Northeastern University who runs another voice-generating company, VocaliD, that focuses on customer service chatbots.
If you wanted it to speak really like him, youd need a lot, maybe 90 minutes of good, clean data, she said. Youre building an algorithm that learns to speak like Bourdain spoke.
Neville is an acclaimed documentarian who also directed the Fred Rogers portrait Wont You Be My Neighbor? and the Oscar-winning 20 Feet From Stardom. He began making his latest movie in 2019, more than a year after Bourdains death by suicide in June 2018.
Read more:
Why the Anthony Bourdain voice cloning creeps people out - Associated Press
- Exclusive: Camb takes on ElevenLabs with open voice cloning AI model Mars5 offering higher realism, support for 140 ... - VentureBeat - June 13th, 2024 [June 13th, 2024]
- Meet Kyogu Lee, President of Supertone - the voice cloning AI company acquired by HYBE for $32m - Music Business Worldwide - June 13th, 2024 [June 13th, 2024]
- Single-cell cloning solution speeds breakthroughs | UNC-Chapel Hill - The University of North Carolina at Chapel Hill - June 13th, 2024 [June 13th, 2024]
- Making of the Annual Report 2023: Avatar Technology and Voice Cloning - LLYC - June 13th, 2024 [June 13th, 2024]
- Zoom CEO wants AI digital clones to go to meetings for you - New York Post - June 13th, 2024 [June 13th, 2024]
- Sask. urging federal government to ban AI voice cloning ahead of elections - CBC.ca - June 13th, 2024 [June 13th, 2024]
- Saskatchewan pushing Ottawa to ban the use of AI for voice cloning - CBC.ca - June 13th, 2024 [June 13th, 2024]
- AI voice cloning easily manipulates Biden and Trump, study finds - Fast Company - May 31st, 2024 [May 31st, 2024]
- Voice cloning of political figures is still easy as pie - TechCrunch - May 31st, 2024 [May 31st, 2024]
- Voice cloning of political figures is still easy as pie - StartupNews.fyi - May 31st, 2024 [May 31st, 2024]
- Texas A&M Researcher Who First Cloned Cat Dies At 66 - Texas A&M University Today - May 31st, 2024 [May 31st, 2024]
- AI voice cloning tools imitating political leaders threaten elections report - The Independent - May 31st, 2024 [May 31st, 2024]
- Chanley Howell on AI Cloning - 'Risks can outweigh the benefits' - Foley & Lardner LLP - May 31st, 2024 [May 31st, 2024]
- AI clones of Keir Starmer and PM raise fears of election interference - The Times - May 31st, 2024 [May 31st, 2024]
- Cloning pioneer Mark Westhusin of Texas A&M dies at 66 - Bryan-College Station Eagle - May 31st, 2024 [May 31st, 2024]
- How Revenge of the Sith Fixed Star Wars' Oldest Clone Wars Continuity Problem - Screen Rant - May 31st, 2024 [May 31st, 2024]
- Truecaller unveils AI call scanner to combat growing threat of voice cloning scams - Business Today - May 31st, 2024 [May 31st, 2024]
- AI cloning of deceased loved ones flourishes in China - NewsBytes - May 15th, 2024 [May 15th, 2024]
- Fossil Catches Starfish Cousin in the Act of Cloning Itself - The New York Times - May 15th, 2024 [May 15th, 2024]
- Experts warn of a new voice cloning scam - Crime - Ahmedabad Mirror - May 15th, 2024 [May 15th, 2024]
- Voice-cloning technology bringing a key Supreme Court moment to 'life' - The Associated Press - May 15th, 2024 [May 15th, 2024]
- Clone Trooper vs Stormtrooper: What's the Difference? - CBR - May 15th, 2024 [May 15th, 2024]
- I lost my voice because of a tumor but an AI clone gave it and my confidence back to me - AOL - May 15th, 2024 [May 15th, 2024]
- Orphan Black: Krysten Ritter Uncovers Wide Conspiracy With Young Clone In Action-Packed Echoes Trailer - Screen Rant - May 15th, 2024 [May 15th, 2024]
- The Pet-Cloning Industry is Going Wild - Air Mail - March 31st, 2024 [March 31st, 2024]
- OpenAI's voice cloning AI model only needs a 15-second sample to work - The Verge - March 31st, 2024 [March 31st, 2024]
- Beyond cloning: Harnessing the power of virtual quantum broadcasting - Phys.org - March 31st, 2024 [March 31st, 2024]
- OpenAI built a voice cloning tool, but you cant use it yet - TechCrunch - March 31st, 2024 [March 31st, 2024]
- OpenAI reveals Voice Engine, but won't yet publicly release the risky AI voice-cloning technology - ABC News - March 31st, 2024 [March 31st, 2024]
- OpenAI unveils voice-cloning tool but delays release on safety grounds - The National - March 31st, 2024 [March 31st, 2024]
- Best way to clone the SSD from old computer to new computer with an M.2 Samsung Drive? - ASEAN NOW - March 31st, 2024 [March 31st, 2024]
- OpenAI Debuts Voice-Cloning Tech, But Won't Release It Widely - PCMag - March 31st, 2024 [March 31st, 2024]
- OpenAI holds back wide release of voice-cloning tech due to misuse concerns - Ars Technica - March 31st, 2024 [March 31st, 2024]
- OpenAI unveils voice-cloning tool | National | caledonianrecord.com - The Caledonian-Record - March 31st, 2024 [March 31st, 2024]
- OpenAI Voice Cloning Tool Is Here, But Not Everyone Can Use It: Here's Why - Times Now - March 31st, 2024 [March 31st, 2024]
- OpenAI unveils voice-cloning tool | National | elkharttruth.com - The Elkhart Truth - March 31st, 2024 [March 31st, 2024]
- OpenAI reveals impressive voice cloning model, and it's scary good - XDA Developers - March 31st, 2024 [March 31st, 2024]
- OpenAI's new 'Voice Engine' clones your voice in only 15 seconds - Interesting Engineering - March 31st, 2024 [March 31st, 2024]
- OpenAI Unveils Voice Cloning Tool, But Public Access Remains Limited - BBN Times - March 31st, 2024 [March 31st, 2024]
- OpenAI reveals Voice Engine, but won't yet publicly release the risky AI voice-cloning technology - MSN - March 31st, 2024 [March 31st, 2024]
- OpenAI to introduce new voice cloning tool for limited use to prevent security breaches - Daily Jang - March 31st, 2024 [March 31st, 2024]
- OpenAI Unveils Groundbreaking Voice Cloning Technology, Prioritizes Safety Concerns - elblog.pl - March 31st, 2024 [March 31st, 2024]
- OpenAI's voice-cloning tool is impressive but full of safety concerns - NewsBytes - March 31st, 2024 [March 31st, 2024]
- OpenAI unveils voice cloning tool - FRCN HQ - Federal Radio Corporation of Nigeria - March 31st, 2024 [March 31st, 2024]
- Startup Clones Three Piglets Gene-Hacked to Have Organs Transplanted Into Humans - Futurism - February 18th, 2024 [February 18th, 2024]
- Detective Hayseed The Cloning Madness review - Adventure Gamers - February 18th, 2024 [February 18th, 2024]
- IS VOICE CLONING SOON TO COME UNDER THE FTCS NEW IMPERSONATION RULE? FTC Issued a Supplemental Notice of Proposed Rulemaking Directed at the Use of... - February 18th, 2024 [February 18th, 2024]
- Explained: What is voice cloning scam and how you can avoid getting scammed - Times of India - February 18th, 2024 [February 18th, 2024]
- UK business registry says yes, chef to hundreds of cloned IDs and restaurants - Biometric Update - February 18th, 2024 [February 18th, 2024]
- "It Has The Interest Of The Emperor": Bad Batch Star Hints At How High The Stakes Are In Season 3 - Screen Rant - February 18th, 2024 [February 18th, 2024]
- AI Voice Cloning: What It Is And How To Avoid Getting Scammed By It - NDTV - February 18th, 2024 [February 18th, 2024]
- 'They Cloned Tyrone' Ending Explained: Are Two John Boyegas Better Than One? - Collider - February 18th, 2024 [February 18th, 2024]
- Researchers develop method to boost tree genetic cloning - CGTN - February 18th, 2024 [February 18th, 2024]
- A mysterious phone call cloned Biden's voice. Can the next one be stopped? - POLITICO - January 30th, 2024 [January 30th, 2024]
- AI-generated voice cloning: Tips on how to protect yourself from scams - Boston 25 News - January 30th, 2024 [January 30th, 2024]
- Years Before Jurassic Park, The Boys from Brazil Presented Cloning as a Terrifying Possibility - Syfy - January 30th, 2024 [January 30th, 2024]
- How to clone a HDD to an SSD for free on Windows - PCWorld - January 30th, 2024 [January 30th, 2024]
- Endangered bulls have been cloned in China - AzerNews.Az - January 30th, 2024 [January 30th, 2024]
- Ian Wilmut, Scientist Behind Dolly the Cloned Sheep, Is Dead at 79 - The New York Times - September 17th, 2023 [September 17th, 2023]
- Kang the Conqueror's New Chrono-Clone Power Proves He's ... - Screen Rant - September 17th, 2023 [September 17th, 2023]
- 17 Years Later, a Forgotten Star Wars Invention Could Save a ... - Inverse - September 17th, 2023 [September 17th, 2023]
- Bixby's voice cloning feature is getting a wider rollout - Android Authority - August 28th, 2023 [August 28th, 2023]
- The next chapter in publishing: Embracing text-to-speech and AI ... - WAN-IFRA - August 28th, 2023 [August 28th, 2023]
- How to Clone Yourself on CapCut Without a Green Screen - MUO - MakeUseOf - August 28th, 2023 [August 28th, 2023]
- Halton Police arrest two in VIN cloning investigation - HaltonHillsToday - August 28th, 2023 [August 28th, 2023]
- Best tycoon games on Roblox: My Dragon Tycoon, Clone Tycoon 2 ... - CharlieINTEL.com - August 28th, 2023 [August 28th, 2023]
- Inside a sex toy factorys clever uses of tech and science, including cloning OnlyFans models and 3D p... - The US Sun - February 18th, 2023 [February 18th, 2023]
- How does cloning work? | Live Science - February 7th, 2023 [February 7th, 2023]
- 20 Years after Dolly the Sheep Led the WayWhere Is Cloning Now? - February 7th, 2023 [February 7th, 2023]
- Isolating, Cloning, and Sequencing DNA - Molecular Biology of the Cell ... - November 25th, 2022 [November 25th, 2022]
- Cell Phone Fraud | Federal Communications Commission - October 23rd, 2022 [October 23rd, 2022]
- Mumbai: Is cheque cloning the new con in town? - mid-day.com - October 17th, 2022 [October 17th, 2022]
- Mom Shares Surprising Differences Between Her Cloned Cat and Original Cat - Yahoo Life - October 15th, 2022 [October 15th, 2022]
- Cloning a Rare ISA Card to Talk to the First-Ever CD-ROM Drive - Adafruit Blog - October 15th, 2022 [October 15th, 2022]
- How an Ancient Species Survived Thousands of Years Without Reproducing - History of Yesterday - October 15th, 2022 [October 15th, 2022]
- 'Exception' Ending, Explained: Why Were The Crew Members Reprinted? Was Kate Reprinted At The End? | DMT - DMT - October 15th, 2022 [October 15th, 2022]
- Fraudsters Cloned Company Directors Voice In $35 Million ... - Forbes - October 13th, 2022 [October 13th, 2022]
- Projects - Octopus Deploy - October 13th, 2022 [October 13th, 2022]
- The World's First Cloned Wolf Has Reportedly Been Born in China, And It's Adorable - ScienceAlert - October 2nd, 2022 [October 2nd, 2022]
- Lancashire novelist Jenn Ashworth talks cloning herself, national awards, and having her work read by Maxine Peake - Lancashire Evening Post - October 2nd, 2022 [October 2nd, 2022]