跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 28 天前AI 評分55

記憶税:剖析智能體記憶的淨價值

Memory Tax: Dissecting the Net Value of Agent Memory

AI 導讀

這項研究透過多項基準測試和不同模型骨幹的大規模評估,發現不少專用記憶系統在許多情況下不及直接從原始歷史檢索的簡單 RAG,呈現負淨價值。研究以 RAG 為參照,把記憶的淨價值拆分為「記憶收益」與「記憶税」;記憶處理可能移除或遮蔽證據,造成記憶税。作者表示將向社羣開源程式碼和結果,並希望這個概念能引導更可靠的記憶設計與評估。

正文

Published on Oct 25

Authors:

,

,

,

,

,

,

,

,

,

Abstract

Large-scale evaluation reveals that dedicated memory systems often underperform naive retrieval-augmented generation, introducing a framework of memory benefit and memory tax to assess net value.

Memory is increasingly used in long-horizon agents, yet the net value of building memory over direct retrieval from raw history remains largely unclear. Through a large-scale evaluation across multiple benchmarks and model backbones, we find many dedicated memory systems underperform naive RAG in many cases, indicating a negative net value. Taking RAG as a reference, we dissect the net value of memory into the gains and losses over direct retrieval, termed memory benefit and memory tax. These gains and losses arise because memory process changes how the raw information is organized and accessed. We view such changes as the double-edged deviations from the raw history. They are originally designed and introduced to benefit the task, for example by reorganizing facts or distilling preferences, but some may also remove or obscure evidence, giving rise to memory tax. Since memory benefit reflects the expected gains of its design, we then focus more on the overlooked memory tax, study how it arises from the system and evaluation side, and generalize the concept to more application scenarios of memory. We hope the notion of memory tax can provide a new lens and shift more attention from standalone performance to the net value of memory, informing more reliable memory designs and evaluations. We will open-source the code and results to the community. Project Page: https://hexuan21.github.io/MemoryTax/

View arXiv page View PDF Project page GitHub 4 Add to collection

Get this paper in your agent:

hf papers read 2610.34073

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.34073 in a model README.md to link it from this page.

Datasets citing this paper 7

hexuan21/MemoryTax-Res-world-model-mem

Viewer •

Updated 1 day ago

•

546

•

43

hexuan21/MemoryTax-Res-Other

Updated 1 day ago

•

42

hexuan21/MemoryTax-Res-GPT-5-6-luna

Updated 1 day ago

•

27

hexuan21/MemoryTax-Res-Qwen3-6-27B

Updated 1 day ago

•

27

Browse 7 datasets citing this paper

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.34073 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co