https://www.makeuseof.com
Over the last few months, we’ve witnessed some mind-blowing breakthroughs in the world of generative AI. Amid all the hype around AI chatbots and image generators, Runway has gone one step further and announced an AI model that can create videos from text prompts.
Meet Gen-1: An AI Model That Generates Videos
On 6th February 2023, Runway, in its tweet, announced a new AI model called Gen-1. Unlike AI image generators, Gen-1 doesn’t generate entirely new videos. Instead, it creates videos from the ones you upload, using text or image prompts to apply effects to those videos. The result is a video that has a similar composition as the original but in a different style.
In case you don’t know, Runway has an online video editor that utilizes AI tools. It is also one of the companies that created Stable Diffusion—an AI model that creates images from text prompts. And now, it is taking the lead in AI text-to-video creation.
What Can Gen-1 Do?
Runway has released an explainer video giving a sneak peek into the astonishingly powerful Gen-1. As displayed in the video, there are five different modes available for styling your videos.
- Stylization: Using this mode, you can apply the style of an image to an existing video. You can also use a unique text prompt to do the same.
- Storyboard: Storyboard can create animations from mockups. For example, the demo shows how the Storyboard feature turns a simple video of standing books into that of realistic buildings.
- Mask: This mode lets you apply effects to individual objects in the video using text prompts.
- Render: You can provide Gen-1 with an untextured render and text prompt/image to create a new, stylized video.
- Customization: Lastly, you can customize the AI model to create exactly what you wish using more options.
How to Join the Gen-1 Waitlist to Try It for Yourself
Early access to Gen-1 is now open, but you’ll have to join the waitlist. You can request access by filling out this Google Form. And as the company announced in its tweet, referring it to your friends can get you ahead on the waiting list.
Runway keeps track of referrals by asking you to enter the email address of the person (in the waitlist signup form) who referred the tool to you.
Generative AI Continues to Grow
Thanks to Runway’s Gen-1, AI-generated videos are now a thing. Though access to Gen-1 is limited right now, the explainer video and Runway’s track record of creating phenomenal AI tools have raised hopes.
While AI art generation continues to grow, it's important not to forget the ethical aspects of this technology.
