LONDON, February 29, 2024 — A musician silenced by illness is making music again, thanks to artificial intelligence. Patrick Darling, who lost his ability to sing and play instruments, has recreated his voice using AI technology and is now composing new songs.
A Voice Reborn Through Technology
Table of Contents
AI tools are allowing a musician facing debilitating illness to continue his creative work, offering a powerful example of technology’s potential to overcome physical limitations.
What happens when a musician loses their voice? for Patrick Darling, AI offered a pathway to continue composing and performing, effectively “banking” his voice before it was lost and then recreating it for new musical endeavors.
“Sadly, I have lost the ability to sing and play my instruments,” Darling said onstage at a recent event in London, using his AI-generated voice clone. “Despite this, most of my time these days is spent still continuing to compose and produce my music.Doing so feels more important than ever to me now.”
Losing the Ability to Create
Darling’s musical journey began around age 14, mastering instruments like bass guitar, acoustic guitar, piano, melodica, mandolin, and tenor banjo. But singing, he explained at the event, was his greatest passion.
Over a decade ago, while still a university student, Darling connected with Nick Cocking and soon joined his irish folk outfit, the ceili House Band, in April 2014. Cocking described Darling as someone who “elevated the musicianship of the band.”
however, a few years ago, Cocking and other bandmates noticed changes in Darling’s physical condition. He became increasingly clumsy, struggling with balance. Cocking recalled a rainy walk through Cardiff where Darling repeatedly slipped and fell.
These initial concerns escalated. By August 2023,the disease began affecting his legs,forcing him to sit during performances. The loss of function then spread to his hands, preventing him from playing guitar or banjo. “Eventually he couldn’t play the guitar or the banjo anymore,” Cocking said.
By April 2024, Darling found it difficult to speak and breathe simultaneously. The band carried him onstage for that performance. “He called me the day after and said he couldn’t do it anymore,” Cocking recounted, his voice filled with emotion. “By June 2024,it was done.” That marked the last time the band played together.
“Banking” a Voice for the Future
Darling was connected with a speech therapist who suggested “banking” his voice – a process where individuals facing speech loss record themselves speaking. these recordings are t
Did you know? – Voice banking involves recording a person’s speech while they are still able to, creating a digital library of their voice that can be used to create a synthetic voice later.
hese recordings are then used to train an AI model to replicate the individual’s unique vocal characteristics. Darling recorded hours of speech, capturing his tone, accent, and nuances.
The AI model was developed by VocaliD, a company specializing in voice cloning technology. The process wasn’t perfect initially. “The first version sounded a bit robotic,” Cocking said. “But they refined it, and it now sounds remarkably like Patrick.”
Pro tip – When considering voice banking, start the process as early
