跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-23AI 評分45

AdaPRA:以自適應評分準則提升數據科學智能體

AdaPRA: Process Reward Agents with Adaptive Rubrics for Data Science

AI 導讀

AdaPRA 透過累積任務知識及自適應評分準則引導的過程監督,減少數據科學智能體的執行錯誤並提升排行榜表現。每項任務嘗試五次時,AdaPRA 令 80B Qwen 模型在 DSPredict-Easy 和 DSPredict-Hard 的排行榜百分位分別提升 24.5 點和 14.8 點。

正文

Published on Oct 23

Authors:

,

,

,

,

,

,

Abstract

AdaPRA improves data science agents via persistent knowledge accumulation and adaptive rubric-guided process supervision, reducing errors and boosting leaderboard performance.

Data science agents can automate end-to-end machine learning workflows, yet they remain far from competitive on human leaderboards. Agents make process errors such as insufficient exploration, unsound validation, coding bugs, and poor use of a fixed budget (re-running the same exploratory data analysis and baseline models in every attempt). We propose AdaPRA to address these issues: a persistent coding agent harness that accumulates knowledge across attempts on the same task, with rubric-guided process supervision that identifies and corrects errors. Our process reward agent audits the agent's trajectory and workspace by executing checks, and adapts its rubrics to each task. We find that rubrics seeded from easier tasks generalize to harder tasks, with rubric adaptation further improving performance. With five attempts per task, AdaPRA improves an 80B Qwen model's leaderboard percentile by 24.5 points on DSPredict-Easy and 14.8 points on DSPredict-Hard while reducing process errors. We also show that supervision with rubrics mined from one base model's runs improves another (DeepSeek-V3.2), and that AdaPRA beats DataPRM, a competitive PRM for data science. We also share our code for reproducibility.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2610.33245

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.33245 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.33245 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.33245 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co