跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 16 天前AI 評分43

CPU-ARC:用於 CPU 推理重用的智能體推理快取

CPU-ARC: Agentic Reasoning Caching for on-CPU Reasoning Reuse

AI 導讀

CPU-ARC 提出智能體推理快取方法,從 LLM 推理軌跡構建可在 CPU 執行的快取,讓已推理任務的解法可高效套用至新問題。在多項具挑戰性的數學及科學任務中,快取的表現與前沿 LLM 相當,並具可解釋、可持續訓練及抵抗輸入擾動等特點;調用成本比來源模型低 16-291x。

正文

Published on Nov 6

Authors:

,

,

,

Abstract

Reasoning caches built from LLM traces can efficiently apply previously derived solutions to new problem instances with robustness and much lower invocation cost than source models.

Large language models reinvent the wheel all the time. They conflate task-solving with the execution of the solutions, which forces them to solve every problem from scratch. We show that once a task has been reasoned through, the application of its solution to a new problem instance can be done very efficiently and with little involvement from language models. We introduce agentic reasoning caching, a method for constructing robust CPU-executable agentic reasoning caches (ARCs) from LLM reasoning traces. ARCs show on-par performance with frontier LLMs across a range of difficult mathematical and scientific tasks, are fully explainable, continually trainable, robust to input perturbations, and 16-291x cheaper to invoke than the source model.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2611.09891

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.09891 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.09891 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.09891 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co