Artificial intelligence enables voice reproduction
The startup Eleven Labs, which launched a voice cloning tool using artificial intelligence software, announced that it had detected an "increase in abusive use".
The London-based company recently launched a beta version of its platform to create "tools that produce words with sounds very close to reality" after it managed to raise two million dollars, according to "Agence France Presse", Tuesday.
Users from the anonymous "4chan" page shared messages created using the program containing fake voices for several celebrities, including British actress Emma Watson and American broadcaster Joe Rogan, to make them utter racist, sexist and homophobic sentences.
In one of these messages, a voice similar to that of Emma Watson is heard reading a passage from the book "Mein Kampf" by Nazi leader Adolf Hitler, while in another message a voice similar to that of American analyst Ben Shapiro is heard threatening to rape Representative Alexandria Ocasio-Cortez.
The voices of directors Quentin Tarantino and George Lucas were also misused
Eleven Labs tweeted: “We want to solve this problem by adopting additional protection measures
Among the startup's suggestions are enhancing user identification, better validation of intellectual property rights for forms, and manual verification procedures.
And "Eleven Labs" is one of several companies that develop software based on artificial intelligence software that anyone can use.
These tools have garnered a lot of attention since OpenAI launched at the end of last year the ChatGBT chatbot that is capable of answering a variety of questions and writing texts.
But these programs are accompanied by concerns related to the "deepfake" technology, which is based on digital manipulations of images or sounds to the extent of matching with reality.