The release of “The Hardest Part,” the first major music video created with OpenAI’s SORA model, marks a significant milestone in the intersection of artificial intelligence and creative arts. Directed by Paul Trillo for the artist Washed Out, this video leverages SORA’s innovative capabilities to push the boundaries of what’s possible in music video production.
Mit dem Laden des Videos akzeptieren Sie die Datenschutzerklärung von Vimeo.
Mehr erfahren
The Making of “The Hardest Part”
Paul Trillo utilized SORA to generate around 700 clips, each approximately 20 seconds long, selecting 55 for the final nearly four-minute video. The process involved rendering at 720P resolution and later upscaling to 2K. The transitions between scenes were crafted using long-form prompts due to the absence of the multi-modal blending feature, which was still in development at the time.
Innovations in SORA: MiniClips and Prompt Engineering
One of the latest features of SORA, MiniClips, plays a crucial role in enhancing the creative workflow. This tool allows directors to preview the first four frames of either 8 or 32 mini-inferred clips. This capability enables quick assessment of the basic elements of a shot before committing to a full render, significantly reducing the time and effort involved in the trial-and-error process of prompt engineering.
Prompt engineering itself is a critical aspect of using SORA effectively. Trillo’s approach involved crafting detailed prompts that could handle multiple scene transitions within a single generation. For instance, one prompt described a continuous shot zooming through a 1980s high school corridor, transitioning into a classroom, and eventually into a football field—all captured with a cinematic, vintage aesthetic.
Costs and Accessibility
The compute costs for generating videos with SORA are significant but deemed reasonable for professional use. Estimations suggest that inferring 230 minutes of SORA video could cost around $644, not including other expenses like upload, download, and storage. This positions SORA as a powerful yet costly tool, highlighting the necessity for substantial investment in AI infrastructure.
Future Prospects
Looking ahead, SORA is expected to integrate multi-modal inputs, further simplifying the creative process by allowing users to incorporate visual references alongside text prompts. This evolution will make SORA even more accessible and powerful for filmmakers and other creatives.
In conclusion, the debut of “The Hardest Part” signifies more than just a technical achievement; it represents a glimpse into the future of AI-driven creative processes. As SORA continues to evolve, it promises to unlock new realms of creativity and efficiency in video production.
The Artist’s Perspective: Washed Out on AI and Creativity
Washed Out, the musician behind the song “The Hardest Part,” shared his thoughts on Twitter regarding AI in music and art. He clarified that his new album is not an “AI album” and does not have any AI-focused themes. However, he emphasized his interest in science and technology and expressed excitement about the creative potential of these new tools.
Washed Out also acknowledged the serious concerns raised about AI and emphasized the need for responsible use of AI tools. He sees the music video as an opportunity to stimulate discussion about the responsible use of AI in the creative industry.
Conclusion
The debut of “The Hardest Part” signifies more than just a technical achievement; it represents a glimpse into the future of AI-driven creative processes. As SORA continues to evolve, it promises to unlock new realms of creativity and efficiency in video production. The discussions and perspectives surrounding this project underscore the importance of a balanced and responsible approach to AI in art.
