跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 5 天前AI 評分43

Code World Model 2.0:邁向無限可控影片生成

Code World Model 2.0: Towards Infinite Controllable Video Generation

AI 導讀

Code World Model 2.0 提出 Invoker-Render,結合雙向創作模型與因果四步串流模型,支援可控影片生成。模型以約 200 小時的多粒度資料訓練,並透過 Progressive Forcing(ProForcing)訓練及蒸餾串流渲染器。實驗顯示,它可穩定生成 30 分鐘賽車影片,並保留場景及主體外觀。

正文

Published on Nov 17

·

Submitted by

Ruoyu

on Nov 19

Authors:

,

,

,

,

,

,

,

,

,

Abstract

Visual proxies decouple explicit world-state simulation from photorealistic video synthesis, offering a controllable interface for both offline clip creation and real-time interactive streaming. Yet a practical renderer must address two challenges. Upstream proxies vary from coarse layouts to fine articulated geometry depending on the interaction, and streaming inference must operate in a few causal steps without accumulating drift across self-generated history. We present Invoker-Render, pairing a bidirectional creation model with a causal four-step streaming model under a shared conditioning interface over structural proxies, an appearance reference, and language. Trained on an aligned approximately 200-hour multi-granularity corpus, Invoker-Render honors fine geometric constraints when supplied while synthesizing plausible local motion under coarse proxies, enabling runtime selection of input detail. To bridge bidirectional creation and real-time streaming without compounding step compression and rollout drift, we introduce Progressive Forcing (ProForcing). ProForcing first trains a causal predictor and distills it into a four-step renderer using histories derived from training videos. Training then shifts to continuous self-generated rollouts. A pipelined serving stack supports efficient streaming inference. Experiments show versatile control across proxy families, granularities, and camera paths, consistent gains over recent streaming baselines, and stable 30-minute racing rollouts that preserve scene and subject appearance.

View arXiv page View PDF Project page GitHub 109 Add to collection

Get this paper in your agent:

hf papers read 2611.22925

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

inclusionAI/invoker-render-1.0

Video-to-Video •

33B •

Updated about 21 hours ago

•

1.99k

•

8

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.22925 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co