Video thumbnail for We Tested Google Veo and Runway to Create This AI Film. It Was Wild. | WSJ

Google Veo & Runway AI Film Test: The Wild Results!

Summary

Quick Abstract

Explore the cutting edge of AI filmmaking! This summary dives into a short film created almost entirely with AI tools, including Google VO3 and Runway. Discover how Dr. Chiff Motherboard (maybe AI?) and a human collaborator pushed the boundaries of artificial intelligence to create characters, humor, and even "art." Learn about the process, the challenges, and the surprising results.

Quick Takeaways:

  • The film utilized AI video tools like Google VO3 and Runway for visuals and audio.

  • Midjourney was used to design the characters, with Runway used to create movement.

  • Scripts were written by humans, showcasing the continued need for creative input.

  • Audio, including character voices, was generated using ElevenLabs.

  • The project highlights the potential and limitations of current AI technology in filmmaking and the production pipeline.

  • Post Production required Adobe Premiere for editing and sound design.

  • AI music was generated via Suno.

The Making of an AI-Generated Film: A Behind-the-Scenes Look

This article explores the creation of a short film made almost entirely with AI tools, from visuals to audio. We'll delve into the process, the tools used, and the challenges faced in bringing this AI-driven project to life.

Introduction to Dr. Chiff Motherboard and Chip

The film features Dr. Chiff Motherboard, a supposed robotics expert, and Chip, an AI character. It's revealed that Chip is actually an AI creation controlled by a real person. The film, including Chip and other visuals, were generated using AI video tools like Google VO3. Most of the audio is AI-generated as well, with the exception of narrations.

The Film's Narrative: OptiMax 5000 and its Effects

The film centers around the OptiMax 5000, a device designed to improve life. The narrative showcases the device's purported benefits, such as waking up early, eating healthy, and working out. However, it takes a turn, highlighting the device's negative impact on the protagonist's personality.

AI Video Tools Used

  • Google VO3: This was a primary tool used for both video and audio generation.

  • Runway: Runway was used for generating images and detailed scenes.

  • Midjourney: Used for character design, specifically Optimax 5000.

The Production Process

The production process involved several key steps:

  1. Character Creation: Characters were designed using Midjourney. The creators collected various photos to create 'Dr. Chiff Motherboard' look using runway.
  2. Scene Generation: Scenes were generated using Runway, with detailed descriptions of the desired scenarios.
  3. Animation: Scenes were then imported into Google VO, where prompts were used to generate movement and animation.
  4. Selection: The best AI-generated versions were selected for inclusion in the film.
  5. Audio Production: Voice audio was generated using Eleven Labs, although, the presenter preferred to narrate it herself.
  6. Editing: Adobe Premiere was used for editing the footage and audio.
  7. Music: The music was created with Suno, an AI music generator.

Challenges and Bloopers

The creators encountered numerous issues during the production process, as evidenced by the bloopers reel. This highlights the current limitations of AI video generation. Despite these challenges, the goal was to push the boundaries of AI video and create a film with characters, humor, and meaning.

The Role of Human Input

While AI played a significant role, human input was crucial. The script was written by humans, and a video/audio producer, Gerard Cole, was responsible for generating thousands of clips to achieve consistency.

Cost and Motivation

The estimated cost for using Google and Runway's tools was around \$1000. The project aimed to explore the potential and limitations of AI in filmmaking, reminding viewers that AI still requires human creativity and original ideas. The creators hoped to showcase the capabilities of AI while acknowledging that it is not a replacement for human artistry.

Final Thoughts

The creators conclude by emphasizing that while AI is advancing rapidly, it is not perfect. They acknowledge that creating the film using traditional methods would have required a larger team and budget. Ultimately, the film serves as a reminder of the importance of human input, creativity, and original ideas in the creative process.

Was this summary helpful?