Sora comes to Adobe video editing software! The new version of Premiere Pro opens the era of AI editing

Sora will be integrated into Adobe video editing software.

In the latest Premier Pro concept demonstration, Adobe showed the results of its collaboration with OpenAI:

Outside of the main lens, Sora Generate a B-roll auxiliary shot.

In addition to Sora, other popular AI video tools Runway and Pika will also be optional.

Runway is used similarly to Sora in the demonstration and can generate a brand new auxiliary shot.

#Pika can naturally extend the existing lens for several seconds.

It should be emphasized that these features are still in the early preview and research stage, and it has not yet been revealed when they will be released.

In contrast, the functions supported by Adobe’s own AI product Firefly are more certain.

Professional editors can easily add and remove objects from their videos and expand footage on the timeline without ever leaving Premiere Pro.

Within this year, the video editing workflow will officially enter the AI ​​era.

Demo dismantling

Adobe’s promotional video this time mainly shows three major “functions”.

The first step is to add objects

to parts of the video

and add new objects.

In the video, the man slowly walked towards the woman, and then the woman turned around and opened a suitcase placed on the trunk of the car.

#Looking carefully, the box contains some scattered diamonds.

Just click the "Add Object" button, then select the target area and enter the prompt word. There were only a few diamonds in the beginning, and the number increased, filling the entire box.

#And the subsequent pictures also changed accordingly. With the slight movement of the camera, the diamonds also changed naturally, and there were no flaws at all.

In addition to such "addition", "subtraction" operation -

Delete existing objects in the video

- Premier will also do it.

With the blessing of the smart magic wand, it only takes one click to automatically identify the entire object, unlike the ordinary magic wand which can only select areas with similar colors. After the recognition is completed, objects can be eliminated with just one click, and the background of the corresponding area will be automatically completed.

#Exhibition boards on the wall and objects on the ground can all be removed with one click, leaving no trace of what once existed.

Between one "plus" and one "subtraction", the replacement of objects is also realized.

The man in the video put on a new watch that can follow the movement of his wrist, and other parts of the video are not affected.

Being able to achieve these effects with one click is indeed very powerful, but this kind of operation targeting local details is even more powerful, and there is

Video extension .

When you find that there is a gap in the timeline and you don’t know what materials to put in it, Premiere can directly generate content to fill the gap, and it can be completed with just one click and drag.

The effect can be said to be seamless.

The most critical thing is that all AI generated results are not destructive to the original material.

You can roll back to the initial version at any time, or switch directly between different AI model results.

In addition, Adobe also provides a "content certificate" function. All videos produced by Premiere Pro will clearly indicate whether and which AI technology was used.

The release date of the above functions has not yet been determined, and no more information has been disclosed except that it will be released within this year.

In addition, Deepa Subramaniam, Adobe’s vice president of product marketing for creative professional applications, said that Adobe has not yet resolved the issue of how revenue generated from the use of third-party AI tools will be distributed between Adobe and partners.

To train its own AI video models, Adobe is buying video clips from photographers and artists.

Including short films showing people's daily activities and expressing various emotions, the payment is 2.62-7.25 US dollars per minute.

In this way, Adobe Firefly will ensure that AI-generated content is safe for commercial use.