Startup uses AI to develop 'digital twins' for voice actors to generate content using their own voices

IT House News on October 15th, according to a Bloomberg report on the 14th, a voice actor Ciccy Jones founded the AI ​​startup Morpheme, aiming to use AI to "reshape" dubbing and foley methods from cartoons to games. .

The content that needs to be rewritten is: Image source Pexels

She has previously participated in the dubbing work of a series of important works such as "Starry Sky" and "Baldur's Gate". Once, she was required to provide the voiceover for a scene in which an astronaut wakes up in space and faces breathing difficulties. She admitted: "After 10 minutes, I almost fainted."

According to reports, if her project can be favored by technology investors, in the future these complex dubbing tasks will only need to be outsourced to her own "digital twin" - Powered by AI, using the actor's own voice to generate specified voice.

In addition, the company is also developing a "sound library" specifically designed to simulate heavy breathing and screaming, and customers can reuse these sounds during game development. The software can also render actors' voices into other languages, which is expected to enable major companies to achieve faster speed and lower costs in cross-cultural communication.

While this kind of venture capital excites investors, it also makes actors, screenwriters and other creative people "fearful": In the game industry, people are worried that AI may completely eliminate a certain type of work.

According to PitchBook statistics, in 2022, voice-related artificial intelligence startups received US$378.6 million in investment (IT House Note: approximately 2.768 billion yuan), and a total of 47 transactions were conducted. Some of these companies are using artificial intelligence technology for things like voice cloning and generation

The above is the detailed content of Startup uses AI to develop 'digital twins' for voice actors to generate content using their own voices. For more information, please follow other related articles on the PHP Chinese website!