跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-15AI 評分39

SWE-at-Scale:從歷史錯誤修復中可擴展地合成軟件工程任務

SWE-at-Scale: Scalable Issue Synthesis from Historical Bug Fixes

AI 導讀

SWE-at-Scale 透過逆向分析真實軟件修復,自動合成逼真、可執行的軟件工程任務,供編碼智能體評估。實驗顯示,生成任務較現有合成基線更多樣、逼真,並對頂尖編碼智能體更具挑戰;在單一程式碼情境下,即使每個檔案生成量達 200 次,錯誤多樣性仍穩健提升。

正文

Abstract

SWE-at-Scale synthesizes realistic software engineering tasks by inverting real-world fixes to generate diverse, executable bugs for evaluating coding agents.

As coding agents become increasingly capable, robust evaluation requires a broader and more diverse supply of verifiable software engineering (SWE) tasks. However, real-world tasks are constrained by the natural frequency of issue reporting and the substantial cost of manual curation. Furthermore, existing synthetic approaches rely primarily on the pretrained knowledge of large models coupled with heuristic prompting, often failing to capture the authentic, complex mechanics of software failures. To exponentially scale SWE task production, we introduce SWE-at-Scale, a framework that automatically synthesizes realistic issues by reverse-engineering real-world software fixes. Our key insight is that historical fixes encapsulate deep mechanistic knowledge of bug formation: inverting a fix transforms repair supervision into bug-induction supervision grounded in actual development scenarios. SWE-at-Scale transfers these learned bug patterns to novel code contexts, repeatedly sampling diverse bug typologies to construct executable SWE tasks. Extensive experiments show that SWE-at-Scale generates more diverse and realistic SWE tasks than current synthesis baselines while posing greater challenges to state-of-the-art coding agents. Notably, SWE-at-Scale can generate distinct bug types from a single code context, with bug diversity scaling robustly even up to 200 generations per file. Overall, SWE-at-Scale turns finite real-world fixes into reusable supervision for scalable synthesis of realistic, diverse, and challenging SWE tasks.

View arXiv page View PDF GitHub Add to collection

Get this paper in your agent:

hf papers read 2610.21359

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.21359 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.21359 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.21359 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co