跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 8 天前AI 評分49

CompoundingKernel:自我改進,從零開始躋身第一

CompoundingKernel: Self-Improving from Zero to First

AI 導讀

CompoundingKernel 是一個透過搜尋撰寫 GPU kernel 的自我改進 Agent 系統,截至 2026-11-11,其生成的 kernel 在 SOL-ExecBench(NVIDIA B200)的公開 L1、L2 和 Quantization 榜均排名第一。

正文

Published on Nov 14

Authors:

,

,

,

,

,

,

,

,

Abstract

We present CompoundingKernel, a self-improving agent system that writes GPU kernels by search. As of 2026-11-11, its generated kernels rank #1 on the public L1, L2 and Quantization boards of SOL-ExecBench (NVIDIA B200). They have held #1 on L1 since 2026-10-27, albeit a short loss on 2026-11-07. All 235 problems have a site-verified correct kernel; on the 209 public-board problems they are 4.40x faster than the benchmark's reference baseline. The search starts from zero: agents get each problem's PyTorch definition but no reference kernels or official scores. A per-problem archive outside the model holds every correct kernel and its lineage. An LLM controller reads it, picks a parent or a new design, and gives each parallel child agent one direction. Checks outside the model decide correctness. At equal wall time, it beat a coded UCB style tree on 35 of 38 problems by making 2.4x as many correct attempts. Over a thousand agents ran at once, and one warm restart fix raised their evaluation rate 3.6x. We find that the rate of reliable measurements, not the number of agents, limits how far such a search scales. Our code and kernels are available on URL.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2611.19230

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.19230 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.19230 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co