Runway 介紹 Gen-1 影片生成技術
Gen-1: The next step forward for generative AI
Runway 介紹 Gen-1,這項技術將圖像或文字提示詞的構圖與風格套用到來源影片的結構,生成新影片。Gen-1 提供風格轉換、分鏡、遮罩、渲染及模型自訂五種模式。用戶研究中,Gen-1 相對 Stable Diffusion 1.5 和 Text2Live 的偏好率分別為 73.53% 和 88.24%。
Gen-1 uses words and images to generate new videos out of existing ones.
Anastasis Germanidis Feb 2023
Authors
Patrick Esser, Johnathan Chiu, Parmida Atighehchian, Jonathan Granskog, Anastasis Germanidis 1
No lights. No camera. All action.
Realistically and consistently synthesize new videos by applying the composition and style of an image or text prompt to the structure of your source video. It's like filming something new, without filming anything at all.
Introducing a more expressive, cinematic and consistent video generation technique.
Bringing the magic back to making movies.
Learn how Gen-1 can turn any video into a compelling piece of footage.
Mode 01: Stylization
Transfer the style of any image or prompt to every frame of your video.
Source Video
Generated Video
Mode 02: Storyboard
Turn mockups into fully stylized and animated renders.
Input Video
Generated Video
Mode 03: Mask
Apply stylization selectively to specific regions of your video while leaving the rest unchanged.
Input Video
Generated Video
Mode 04: Render
Turn untextured renders into realistic outputs by applying an input image or prompt.
Input Video
Generated Video
Mode 05: Customization
Unleash the full power of Gen-1 by customizing the model for even higher fidelity results.
Input Video
Generated Video
The New Standard for Video Generation
Based on user studies, results from GEN-1 are preferred over existing methods for image-to-image and video-to-video translation.
73.53%
Preferred over Stable Diffusion 1.5
88.24%
Preferred over Text2Live
A New Era for Motion (and) Pictures
Runway Research is dedicated to building the multimodal AI systems that will enable new forms of creativity. Gen-1 represents yet another of our pivotal steps forward in this mission.
Authors
Patrick Esser, Johnathan Chiu, Parmida Atighehchian, Jonathan Granskog, Anastasis Germanidis 1
來源:Runway:News(網頁) · runway.com