ForceHarness:讓凍結的前沿模型把力轉化為行動與物理資訊
ForceHarness: Turning Force into Action and Physics for Frozen Frontier Models
研究提出 ForceHarness,讓凍結的前沿多模態模型無需示範或微調,便可透過自行調節力道的控制原語和附有不確定性的物理量,使用力資訊操作機械人。在沒有腕部力感測器的真實機械臂上,GPT-6 Astra 的零樣本成功率由 3.3% 升至 90.0%。
Published on Nov 16
·
on Nov 18
Authors:
,
,
,
Abstract
Frontier multimodal models can now control robots zero-shot from images, yet many manipulation tasks depend on contact forces that images cannot show. Bringing force to an API-only frozen model raises two challenges. First, contact evolves much faster than an API model can decide, so the system must close the loop on force beneath the model. Second, a frozen model cannot interpret raw force streams, so force must be returned in a form the model can reason about. Therefore, we present ForceHarness, a harness that lets frozen models use force without demonstrations or finetuning. After calibrating hand force from a wrist sensor or joint torques alone, ForceHarness addresses the first challenge with self-terminating force primitives that regulate force on their own and return at a contact event. To address the second challenge, a physics translation layer turns each force trace into physical quantities with uncertainty as the tool result. To evaluate ForceHarness against expert force controllers and learned policies under identical conditions, we also build HiddenPhys, a seven-task MuJoCo benchmark with hidden physical variables. On a real arm without a wrist force sensor, ForceHarness raises the zero-shot success rate of GPT-6 Astra from 3.3% to 90.0%. In simulation, it adds 17.5 percentage points on the public ForceBench suite and 34.3 percentage points on HiddenPhys, surpassing force-aware policies trained on demonstrations on both benchmarks and matching hand-written expert controllers on HiddenPhys. Ablations further show that smaller models make significantly better decisions when given physical quantities rather than raw force values.
View arXiv page View PDF Project page GitHub 1 Add to collection
Get this paper in your agent:
hf papers read 2611.21099
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2611.21099 in a model README.md to link it from this page.
Datasets citing this paper 1
Jack97/ForceHarness-Data
Franka Panda • Updated about 11 hours ago • 1.42k episodes
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.21099 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co