跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-08AI 評分49

Opera: A Verbal Critic Framework for Long-horizon Coding Agents

Opera: A Verbal Critic Framework for Long-horizon Coding Agents

AI 導讀

Opera 是一套面向長時程編碼智能體的語言批評框架,會追蹤每項修正直至問題解決,並提升非批評智能體在三項基準測試上的問題解決率。在四個策略模型中,Opera 在 Terminal-Bench 2.1、SWE-Bench Pro 子集及 DeepSWE v1.1 分別帶來最高 12.4、15.0 及 8.9 個百分點的提升。

正文

Published on Oct 8

·

Submitted by

KaiMei

on Oct 9

Authors:

,

,

,

,

,

,

,

,

Abstract

Long-horizon coding agents need timely corrections, yet feedback can be ineffective or even harmful when it misjudges ongoing work or fails to address the underlying problem. Existing critics focus on evaluating trajectories and generating feedback, but rarely track what happens after feedback is delivered. We present Opera, a verbal critic framework that treats each correction as a persistent note, followed until the diagnosed problem is resolved. Opera decides when to review through periodic and event-driven triggers, diagnoses issues with typed operators, audits feedback against visible evidence before delivery, and tracks the agent's subsequent actions to distinguish mere compliance from actual resolution. As a test-time critic, Opera improves the resolve rate of non-critic agents by up to 12.4, 15.0, and 8.9 percentage points on Terminal-Bench 2.1, a SWE-Bench Pro subset, and DeepSWE v1.1, respectively, across four policy models, and achieves the highest mean resolve rate among competitive critic baselines on all three benchmarks, and also improves policy models when the policy critiques itself. Beyond inference, Opera-guided rollouts provide approximately on-policy training data: fine-tuning Qwen3.5-9B on them improves its resolve rate on held-out SWE-Bench Pro repositories by 10.2 percentage points without a critic at inference time, matching fine-tuning on rollouts from a stronger model, while preserving its performance when switching harness, i.e., from Openhands to Terminus-2, which the latter substantially degrades. Our code is available at: https://github.com/dongyuanjushi/Opera.

View arXiv page View PDF GitHub 1 Add to collection

Get this paper in your agent:

hf papers read 2609.33987

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2609.33987 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2609.33987 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2609.33987 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co