跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-05AI 評分46

CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling

CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling

AI 導讀

CLIFT 以保形自我驗證把稀疏評審回饋轉為可重用的訓練獎勵,並支援無需外部評審的測試時軌跡選擇。在 WebArena Infinity,CLIFT 在開源 Web 智能體中達到最先進表現;在 VisualWebArena,使用開源模型訓練的問題庫轉移至 GPT-5.5 後,亦達到最先進表現。在 Online Mind2Web,將認證問題庫轉換後,可提升即時網頁智能體的零樣本評估表現。

正文

Published on Oct 5

Authors:

,

,

,

,

Abstract

CLIFT uses conformal self-verification to convert sparse judge feedback into reusable training rewards and judge-free test-time trajectory selection for open-source web agents.

Open-source web agents are now strong enough to execute realistic browser tasks, but training them with reinforcement learning still depends on weak supervision: binary task success is too sparse for credit assignment, while frontier-language-model judges are too expensive to call at every step and cannot be assumed available at deployment. We introduce CLIFT, a training and test-time scaling method built around conformal self-verification. During training, the agent answers natural-language verification questions about its own rollouts; a Compositional Conformal Certifier keeps only question signals whose URL-conditional evidence agrees with a training-time judge, assigns signed trust weights through polarity-aware lift, and blends the resulting verifier score into per-step rewards in a way that never subtracts from the judge baseline. At test time, the same certified bank is frozen and reused as structured evidence for Conformal Trajectory Selection (CTS): the agent samples a greedy rollout and one or more diverse retries, the self-verifier summarises each URL trace, and a conservative majority-vote rule chooses whether to swap away from the current incumbent without calling any external judge. This single mechanism supports three settings. On WebArena Infinity, CLIFT achieves state-of-the-art performance among open-source web agents. On VisualWebArena, a bank trained with the open model transfers to GPT-5.5 at test time and reaches state-of-the-art performance under the canonical harness. On Online Mind2Web, without training an agent on the benchmark, translating the certified question bank improves a live-web agent in zero-shot evaluation. Together these results position conformal self-verification as a way to turn costly judge feedback into a reusable training signal and a judge-free test-time scaling signal.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2610.06829

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.06829 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.06829 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co