LabInstruct:實驗室操作程序情境式教學影片生成基準評測
LabInstruct: Benchmarking Situated Instructional Video Generation for Lab Procedures
LabInstruct 評測真實實驗室程序的情境式指導影片生成,發現視覺上看似合理的影片仍可能有程序錯誤。基準涵蓋 5 個科學領域的 204 項任務,並評估 8 款前沿圖像轉影片模型。
Published on Sep 29
Authors:
,
,
,
,
,
,
Abstract
LabInstruct evaluates AI-generated instructional videos for real laboratory tasks and reveals that visual plausibility does not ensure procedural correctness.
Self-driving laboratories (SDLs) aim to automate the full experimental loop, from scientific decision-making to physical execution. Ideally, AI-generated plans could be carried out directly by robotic systems, but reliable automation remains difficult in complex, open-world laboratory environments, where experiments often involve fine-grained manipulation, long-horizon procedures, and substantial variation across tasks and setups. Humans therefore remain an important execution interface between AI-generated plans and physical experiments, creating a need for clear and effective human-facing experimental guidance. Because laboratory procedures are inherently visual, spatial, and dynamic, video is particularly well suited to communicating apparatus configurations, manipulation actions, temporal dependencies, and state changes. Recent advances in video generation now make it possible to synthesize experimental demonstrations directly from an initial workspace image and a natural-language instruction. However, whether such models can reliably communicate real laboratory procedures has not been systematically studied. We introduce LabInstruct, a benchmark for situated instructional video generation in real laboratories. LabInstruct contains 204 tasks across 5 scientific disciplines, with real reference executions and structured annotations of objects, actions, contacts, and state transitions. Evaluating 8 frontier image-to-video models, we find that visually plausible generations frequently remain procedurally incorrect, revealing a substantial gap between visual realism and the reliability required for experimental instruction.
View arXiv page View PDF Project page GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.14020
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.14020 in a model README.md to link it from this page.
Datasets citing this paper 1
CSU-JPG/LabInstruct
Preview • Updated 1 day ago • 247
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.14020 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co