Frontier3DBench:跨物件、場景及互動開放世界 3D 創作的編碼智能體評測
Frontier3DBench: Benchmarking Coding Agents for 3D Creation across Objects, Scenes, and Interactive Open Worlds
Frontier3DBench以涵蓋物件、場景及互動開放世界創作的145項任務、9個類別,建立統一基準,評估編碼智能體在外觀、結構及行為方面的3D創作能力。11種模型與 harness 配置中,GPT-6.1-sol在物件和場景層面領先,總分最高為66.02/100;GPT-6-astra則在互動世界建構領先。
Published on Nov 6
Authors:
,
,
,
,
,
,
,
,
,
,
,
Abstract
A unified benchmark of 145 tasks across object, scene, and interactive open-world 3D creation evaluates coding agents on appearance, structure, and behavior, revealing reference fidelity and coordinated activity completion as central bottlenecks.
Coding agents combine visual understanding with program execution, offering a new route to automated 3D creation. By translating images and instructions into editable programs, they bring reconstruction, generation, and editing into a shared workflow. Yet existing benchmarks fragment evaluation across task scopes and protocols, leaving their capabilities across construction levels unclear. We propose Frontier3DBench, a unified benchmark of 145 tasks across 9 categories spanning object, scene, and interactive open-world creation, with joint evaluation of appearance, structure, and behavior. Experiments with 11 model-harness configurations reveal strengths that vary by level: GPT-6.1-sol leads the object and scene levels and achieves the highest overall score of 66.02/100, whereas GPT-6-astra leads interactive world construction. However, all configurations score lower on reference reconstruction than on text-driven generation in object and scene tasks. Producing plausible content thus remains easier than reproducing specified geometry, layouts, and visual details. Moreover, generated worlds average 83.08/100 on local mechanisms but only 20.82 on motion clearance and 30.26 on stateful workflows: individual mechanisms often function, whereas complete activities that require coordinated actions and persistent state remain difficult. These results identify reference fidelity and coordinated activity completion as central bottlenecks for coding agents in 3D creation.
View arXiv page View PDF Project page Add to collection
Get this paper in your agent:
hf papers read 2611.09017
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2611.09017 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2611.09017 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.09017 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co