The Dangers of AI Voice Cloning: The Dark Side of Innovation

A high-profile case involving a physical education teacher and former athletic director of a Baltimore County high school has brought attention to the growing interest in AI-powered voice cloning technology. In January, a recording circulated on social media that allegedly contained fake audio of Pikesville High School Principal Eric Eiswert making racist and anti-Semitic comments. However, experts noted that the recording had a flat tone, clean background sounds, and lacked coherent breathing sounds or pauses.

Baltimore County police were able to track down the recording to Dazhon Darien, who was once an athletic director at the school. Darien is said to have used the school’s computers to access OpenAI tools and Microsoft Bing Chat services in order to create the audio. He was linked to its release through an email address and associated recovery phone number. Darien was arrested at the airport and is facing charges including theft, disrupting school operations, retaliation against a witness, and stalking.

The misuse of AI voice cloning technology has been on the rise in recent years as services improve in sounding more human. Other cases of improper use of apps and software for voice cloning have been reported in Pakistan and Texas. In response to this growing misuse of AI technology, OpenAI decided to limit the public use of its Voice Engine text-to-speech generation platform. US lawmakers have also introduced bills to prevent tech companies from using an individual’s face, voice or name without permission.

The Baltimore County police case, along with those from across the globe, highlights the potential risks of AI voice cloning technology and the need for stricter regulations. The misuse of these technologies can have serious consequences on individuals and institutions alike. With advances in AI technology comes a responsibility to address ethical and legal implications to prevent further misuse and harm.