How does AI+ music 'generate” beautiful melodies? Let's reveal the opening song of the World Artificial Intelligence Conference together

How does AI music “generate” beautiful melodies? Let’s reveal the opening song of the World Artificial Intelligence Conference

On the big screen, two 3D manipulators visible to the naked eye danced on the music light spots. One beat the drums, the other played the wind. Together with an erhu player, they "ignited" the whole audience with a majestic opening song. field.

At the opening ceremony of the 2023 World Artificial Intelligence Conference, the opening song expressed a strong national style atmosphere by integrating national musical instruments such as erhu, pipa, suona and guqin. The most special thing is that this piece of music integrates AI technology. The performer and the "performer" created by AI played together, playing a special melody on the stage of the World Artificial Intelligence Conference.

Left hand tame right hand

How to make people happy with AI without any sense of disobedience? The creator, Zhu Yun, a famous young erhu performer, introduced that the opening piece, which is about 2 and a half minutes long, is divided into three sections. Each section has its own mystery and incorporates AI technology.

At the beginning of the music, the interactive music played by the 3D robotic arm is directly generated by AI. The left arm plays the notes and then "tames" the right hand to let it play the chords; the second section is about generating the future. The melody is generated by AI and is generated by the robotic arm. Play together with others; the melody of the third section is also designed based on the parameters given by AI, and is played together with the folk band.

Chords and melody are the core of composition. Zhu Yunbian hands these two cores to generative software, while he himself is only responsible for "fine-tuning".

The video footage of the opening film is also generated, calculated and adjusted through AI. The exoskeleton of the musical instrument is designed using AI derivatives to achieve real-time rendering of AR AI paintings, and the overall presentation is a naked-eye 3D visual effect. In addition, the lights are also programmed by AI to complete the output and interact with the melody sensor.

"Break" the sound wave to the minimum

Zhu Yun, an erhu performer and composer born in the 1990s, has won many awards in international music competitions. Zhu Yunbian is full of curiosity and expectations for the future of Chinese music after integrating AI technology, hoping to spread Chinese music to the public more widely. He founded the country's first AI music group that combines Chinese style with cyberpunk style, creating a unique "AI Chinese style" music style.

"Sound wave is the smallest unit of a piece of music. AI performance is to 'break' the sound wave to the smallest element and then recombine it. Different sound waves can present the sounds of different instruments. This is the underlying logic of AI performance ." Editor Zhu Yun said, "AI is not just a 'sensor', it can learn human performance skills and then evolve into other works."

"Not perfect, but can be smarter"

The opening song is actually "flawed". Editor Zhu Yun said: “When AI learns music and performs it, the timbre produced will be biased and the drumbeats will be inaccurate. However, I did not calibrate it specifically and retained the process of AI learning and playing. I think this is the essence of AI. ”

And the “imperfect” AI he calls is becoming smarter and smarter. Editor Zhu Yun said that today's AI performance, in terms of technical level, has reached the third to fourth level of ordinary people's musical instrument examinations. "As long as the AI ​​can 'listen' to more music, its composition and performance level will be improved." It will be higher, the larger the base of the database, the more it will play like the player."

Zhu Yunbian also said that if AI wants to become a professional performer, it still has a long way to learn: "Humans have their own emotions when playing music. Everyone's life experience is different. The core expressed in music is also different, which is something that AI cannot yet achieve. He believes that the help of AI will bring "natural sounds" that have never been experienced before, and continue to show unlimited possibilities for innovation in the field of music.

Text: Cao Yijing

Editor: Zhu Yikai

* Please indicate when reprinting from Pudong official WeChat

The above is the detailed content of How does AI+ music 'generate” beautiful melodies? Let's reveal the opening song of the World Artificial Intelligence Conference together. For more information, please follow other related articles on the PHP Chinese website!