Startup uses AI to develop 'digital twins' for voice actors to generate content using their own voices

According to a Bloomberg report on the 14th, a voice actor Ciccy Jones founded the AI ​​startup Morpheme, which aims to use AI to "reinvent" dubbing and foley methods from cartoons to games.

She has previously participated in the dubbing work of a series of masterpieces such as "Starry Sky" and "Baldur's Gate". Once she had to dub an astronaut who woke up in space and faced She dubbed the scene where she had difficulty breathing, and she bluntly said, "After 10 minutes, I almost fainted."

According to reports, if her project can get the support of technology investors, in the future these complex dubbing tasks will only need to be outsourced to her own "digital twin" - driven by artificial intelligence and using the actor's own voice Generate specified voices

In addition, the company is also developing a "sound library" specifically designed to simulate heavy breathing and screaming, and customers can reuse these sounds during game development. The software can also render actors' voices into other languages, which is expected to allow major companies to communicate across cultures faster and at lower costs.

While this kind of venture capital excites investors, it also makes creative people such as actors and screenwriters "fearful": In the game industry, people are worried that AI may completely eliminate a certain type of work.

According to PitchBook statistics, in 2022, funds invested in voice-related AI startups reached US$378.6 million (approximately RMB 2.768 billion), involving a total of 47 transactions. Some of these companies are using artificial intelligence technology for things like voice cloning and generation

The above is the detailed content of Startup uses AI to develop 'digital twins' for voice actors to generate content using their own voices. For more information, please follow other related articles on the PHP Chinese website!