Recently, the world of artificial intelligence has been abuzz with discussions about video generating AI. One of my favorite artists, NOEP, used a significant amount of AI-generated video content during his latest stadium concert, which sparked my interest in these emerging tools. Consequently, I decided to dip my toes into this fascinating realm and create a short AI video myself.
Here's the result:
So, how does one go about creating a video using AI?
Let me take you through the steps I followed to create an overnight advertisement for Productory using AI tools.
ChatGPT For The Scenario And Scripting
The first step in the process was scripting. I used ChatGPT to draft the script. With my super secret prompt, I fine-tuned the language to ensure that the storytelling was captivating and engaging. After perfecting the script, I broke it down into different scene descriptions within the same platform, ChatGPT. This process allowed me to visualize the flow of the video and determine the appropriate visuals for each scene.
![Using ChatGPT for video script editing.](/images/blog/is-ai-video-poised-for-its-pri-inline-1-91a8b269c7faf1cc3ccb2c0ca34f10939ac6e65344b59ab2bcfa1f4f79b3.avif
Giving Voice To The Video
Next, I used Elevenlabs' text-to-speech AI for the voiceover. The AI converted the written script into spoken words, providing the narration for my video.
ElevenLabs is an American software company that specializes in the development of AI-assisted text-to-speech and speech synthesis software. The company's flagship product, Speech Synthesis, is a browser-based application that uses artificial intelligence to generate lifelike speech by synthesizing vocal emotion and intonation. This innovative technology has been praised for its ability to produce high-quality, natural-sounding speech.
![Elevenlabs is a great tool for voiceover](/images/blog/is-ai-video-poised-for-its-pri-inline-2-c87101fd8172305ad2eb416e8e53adc2c232a8f63b74e01e6afd7b6f0eaa.avif
The product’s reputation is largely positive, with users frequently lauding ElevenLabs as a safe platform on various review sites. The software's quality and its capacity to generate natural-sounding speech synthesis have particularly impressed users.
Creating video content
With the script and voiceover ready, I then had to generate the visual elements of the video. I either prompted one of the video generators directly or used Midjourney, an AI tool that creates images based on prompts, to conjure up the images. These images were then fed into the video creators to generate the scenes.
Among the AI video tools I used were RunwayML, Pika Labs, and Genmo. Let's have a look at each one of them.
RunwayML
RunwayML is an innovative AI-powered video production studio that has been making waves in the creative industry. It's a generative AI tool, which means it uses artificial intelligence to generate images and videos, offering a new dimension of creativity to its users. The platform is designed to be user-friendly, even for those who don't have coding skills, making AI tools accessible to creators everywhere. One of the standout features of RunwayML is its ability to generate compelling images and videos using text, images, or video clips.
This feature allows users to endlessly expand any image with simple text prompts and instantly remix the style and composition of any image. It's like having a limitless canvas at your fingertips. The platform has received rave reviews from its users, who appreciate its super sharp masking capabilities and the variety of cool effects available.
Users have described RunwayML as their "new video editing best friend," praising its one-stop-shop approach to AI tools under one brand/domain. They also commend the platform for its quick, good explanations and not overpromising on what it can deliver.
.
The software is lauded for its professional-grade features that allow users to produce high-quality videos. It is beginner-friendly with an intuitive interface that enables easy navigation and seamless editing. The design and layout of the software are clear and straightforward, making it accessible to users of various skill levels.
CapCut offers a wide range of editing tools, including cropping and trimming clips, adding text, adjusting brightness and saturation, and more. It also provides unique editing features such as Auto Captions, Body Effects, Chroma Key, Keyframe and Tracking, and 3D Zoom. These features enable advanced users to produce impressive movies.
In conclusion, CapCut is a robust video editing tool that offers a range of features for creating professional-grade videos. Its user-friendly interface and advanced capabilities make it a popular choice among content creators.
Lessons learned
So, what insights did I got from this adventure?
First, image creation is currently ahead of video generation by about 9-12 months in the development curve. However, video is catching up fast, and we can expect significant advancements soon.
Second, mastering controllability in AI video generation is still a challenging task. Achieving the right balance between automation and human control to create compelling and realistic videos requires skill and experience.
Third, starting a clip with an image created in Midjourney often yields better and more realistic results. This approach provides a strong foundation for the video and ensures a seamless transition between scenes.
Overall, while AI video tools show great promise, they are not yet ready for prime time. However, they are rapidly evolving, and things are set to get very interesting very soon.
As a side note, this experiment wasn't just for fun. I actually undertook it as part of my upcoming AI training course at EBS. The aim was to demonstrate how different AI tools can be combined to produce captivating content.
In conclusion, the future of AI in video production is bright and full of potential. With continuous advancements in technology, it won't be long before we see AI-generated videos taking center stage in various domains, from entertainment to advertising and beyond. So, keep your popcorn ready, because the show is about to begin! 😎 🎥 🍿