Screenwriter and director Paul Trillo was one of the first to demonstrate a music video that was completely generated by OpenAI's artificial intelligence Sora.
The video was shot for indie chillwave musician Washed Out (Ernest Weatherly Green Jr.) and his new single The Hardest Part. The four-minute clip is a series of quick shots in various scenes combined to create the illusion of continuous zoom.
https://youtu.be/-Nb-M1GAOX8The video was completely generated by AI
As part of the project, Sora has generated more than 700 excerpts, of which 55 individual clips have been selected. Then they were mounted into a whole video sequence in Adobe Premiere.
According to the director, in order to get the desired result, they had to come up with detailed hints for the AI. They included not only the image itself, but also the camera angles and the movements of the characters.
"We fly through the bubble, it bursts, we fly through the gum and out onto the open football field," Trillo wrote as a clue to one short fragment of the video.
The director noted that the video used only the possibilities of generating video from text. He did not use the technique of "animating" static frames with the help of AI, which is gaining popularity in the creative environment.
Trillo had the idea to create a music video 10 years ago, but then he abandoned it. Now, thanks to AI, I was able to realize my plans.
First official commissioned music video made with @OpenAI Sora for @realwashedout
This was an idea I had almost 10 years ago and then abandoned. Finally was able to bring it to life.
Watch the full video here https://t.co/sGpmMLVCul pic.twitter.com/J3RxRD9nzo
In an interview with the Los Angeles Times, Green also said that he was looking forward to using new technologies and evaluating their impact on creativity.
"So if this is an innovation, I will be happy to take part in it," the musician added.
The first of its kind?
OpenAI introduced the Sora video generator in February 2024. The tool caused delight on social networks, but it was not released in a public release.
The developers fear that the generator may be used to create manipulative and disinformation videos. Therefore, the startup provided access to the tool only to security experts and a small group of "visual artists, designers and cinematographers."
In early April, OpenAI published an Air Head video created by the Canadian creative studio Shy Kids using Sora. However, he relied heavily on other VFX and video editing tools, such as rotoscoping in Adobe After Effects.
https://youtu.be/9oryIMNVttoNevertheless, the appearance of such videos indicates the desire of creative personalities to use new AI tools for self-expression and storytelling. At the same time, many criticize technologies and OpenAI, in particular, as violating copyrights by scraping and training algorithms on artists' works without their consent or compensation.
Earlier research showed that people cannot distinguish AI videos from real ones.