AnyGameRenderer:跨遊戲保持實體一致性的生成式渲染與實體級基準
AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark
AnyGameRenderer 是影片轉影片生成模型,可將低質素的遊戲畫面轉成高保真視覺效果,同時保留畫面佈局、鏡頭及實體的位置和出現時間。模型以 LoRA 微調 33B 的 MiniMax-H3 ref2va,並在涵蓋 753 個實體的 59 個留出案例上評測。相較基礎模型,時間匹配率由 50.9% 升至 62.9%,未能識別數量變化的比例由 34.7% 降至 21.3%。
Published on Oct 22
Authors:
,
,
,
Abstract
AnyGameRenderer is a video-to-video generative model that transforms low-quality agent-built game footage into high-fidelity visuals while preserving layout, camera, and entity timing.
AI coding agents can now build small playable games in minutes, but the results usually look like programmer art: gray blockouts, colored geometric primitives, and flat semantic blobs. We present AnyGameRenderer, a video-to-video generative renderer that turns such footage into high-quality visuals with characters, motion detail, and effects. Throughout, it keeps the layout, camera, and every entity's position and timing intact. Our AnyGameRenderer generalizes across a wide range of genres that agents build, such as tower defense, auto-battlers, top-down survivors, turn-based battles, kart racing, and crowd runners. AnyGameRenderer takes plain video as its game-state input, with no complex representations such as engine G-buffers, per-object class labels, or low-poly proxies. Gray blockouts, colored primitives, semantic maps, and wireframes all work as input. It also preserves entity correspondence: group counts stay correct, and entities appear and disappear on the right frame. We implement AnyGameRenderer by LoRA fine-tuning MiniMax-H3 ref2va, a 33B reference-video-conditioned video generation model. Training uses sim10k paired clips from three sources: (i) multi-stream rendering data from 38 agent-made games exported from GEAR, an AI game-creation tool; (ii) two-stream rendering data from Unreal Engine, with programmatically controlled crowds, count changes, and entity scales; and (iii) real gameplay recordings, with pairs reconstructed via 3D-box detection. To evaluate the entity correspondence, we propose an entity-level benchmark of 59 held-out cases with 753 entities, scored against ground-truth boxes. Compared with the base model, AnyGameRenderer better preserves entity correspondence: temporal match rises from 50.9\% to 62.9\%, missed count changes fall from 34.7\% to 21.3\%, and fewer entities are hallucinated or left unrendered.
View arXiv page View PDF Project page GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.31466
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 1
Video-to-Video • Updated about 2 hours agoAlayaLab/AnyGameRenderer
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.31466 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.31466 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co