Runway’s latest feature, unveiled on September 13, has generated quite a buzz in the creative community. This innovative video-to-video generation tool enables users to dramatically alter the visual aesthetics of existing video clips simply by using textual prompts.
For a remarkable demonstration of its capabilities, check out the video below that showcases the transformative power of this technology.
Runway Gen-3 Alpha just leveled up with Video-to-Video
Now you can transform any video’s style using just text prompts at amazing quality.
10 wild examples of what’s possible: pic.twitter.com/onh12zCzpI
— Min Choi (@minchoi) September 15, 2024
AI enthusiasts are creating stunning visual effects compatible with Apple’s Vision Pro headset. This suggests exciting possibilities for developers who utilize the recently announced API.
On Monday, X user Cristóbal Valenzuela shared a quick video clip showcasing how Gen-3 integrates with Apple’s Vision Pro.
Early experiments rendering Gen-3 on top of the Apple Vision Pro, made by @Nymarius_ pic.twitter.com/SiUNR0vX0G
— Cristóbal Valenzuela (@c_valenzuelab) September 15, 2024
The clip presents a modern office scene augmented with a visual overlay, transforming the space into a lush jungle ruin. While some viewers expressed skepticism about the video’s authenticity, it is reportedly a creation from a Runway employee.
Content creator Cosmo Scharf shared similar effects, providing additional visual evidence for credibility.
Gen-3 Alpha video to video is remarkable!
Here’s a test from the Vision Pro.
One day this will run in real-time on mixed reality glasses and your world will never look the same. #VisionHack pic.twitter.com/GTgartg5ry
— Cosmo Scharf ᯅ (@cosmoscharf) September 15, 2024
On the same day, Runway launched a new API designed to allow developers to integrate video generation features into various applications and devices. However, access is currently limited to select users. Interested developers can join a waitlist here. To participate, users must subscribe to either the Build or Enterprise plan. Once granted access, they’ll work with the Gen-3 Alpha Turbo model, which has slightly reduced capabilities compared to the main Gen-3 Alpha model.
The service will cost one cent per generation credit, with a single second of video generation requiring five credits—resulting in a pricing model of five cents per second of video. Additionally, developers will need to display a “Powered by Runway” banner linking back to the company’s website in any application utilizing the API.
As the video generation market gets busier—with players like Adobe’s Firefly, Meta’s Sora, Canva, and others entering the fray—Runway aims to distinguish itself by being among the first to provide its tools as an API. It remains to be seen whether this strategy will help the company offset significant training expenditures and lead to profitability.
