LongBanana:長上下文多參考圖像合成的專家驗證基準
LongBanana: An Expert-Verified Benchmark for Long-Context Multi-Reference Image Synthesis
LongBanana 是一個針對長上下文多參考圖像合成、由專家設計及驗證的基準,包含 90 項任務及共 4,670 個專家指定的原子評估項目。每項任務約有 32 張參考圖像和 20 項約束,並以圖像中的實體與關係圖評估內容保真度、關係綁定及整體約束滿足度。研究亦提出 LongBanana-Gen;實驗顯示,精簡的智能體框架優於直接生成,而 RPR 工作流程的成效視乎框架而異,程式碼及數據已公開。
Published on Nov 4
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
We introduce LongBanana, to our knowledge the first expert-designed and expert-verified benchmark for long-context multi-reference image synthesis in the age of agent-driven image generation. The task requires retrieving dispersed visual evidence, rejecting distractors, binding entities and relations, and composing one coherent final image from multiple references. LongBanana contains 90 carefully designed tasks organized by a 3-by-3 taxonomy; each task includes about 32 reference images, 20 constraints, and 50 evaluation items, yielding 4,670 expert-specified atomic evaluation items in total. Its graph-grounded evaluation design instantiates each task with reference images and an entity-relation graph, then converts node, edge, and whole-graph obligations into checklist items for Content Fidelity, Relational Binding, and Global Constraint Satisfaction. Reviewed expert labels include a 15% double-labeled subset with 89.4% exact agreement and 0.83 quadratic weighted kappa. We further introduce LongBanana-Gen, an agent-harness framework for long-horizon image generation; experiments show that minimal agent harnesses improve over direct generation, while a ReAct-Plan-Exec-Reflect (RPR) workflow yields harness-dependent gains by strengthening evidence grounding and repair. Together, LongBanana provides an auditable testbed for measuring dense visual evidence use and a shared target for developing stronger agent-driven image-generation systems. Code and data are available at the project page: https://long-banana.com/.
View arXiv page View PDF Project page GitHub Add to collection
Get this paper in your agent:
hf papers read 2611.06856
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2611.06856 in a model README.md to link it from this page.
Datasets citing this paper 1
Kwai-Kolors/LongBanana
Viewer • Updated 4 days ago • 6 • 399
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.06856 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co