Test-Time Memory Evolution 能否在科學發現中勝過測試時訓練?
Can Test-Time Memory Evolution Outperform Test-Time Training for Scientific Discovery?
Test-Time Memory Evolution(TTME)在五項數學任務中均勝過測試時訓練(TTT),並降低計算成本。TTME 透過持續更新外部記憶來引導後續探索,不更新模型權重;在相同發現框架下,FLOPs 減少 82.8-84.6%,執行時間縮短 47.7-58.4%。
Published on Oct 23
Authors:
,
,
,
,
,
Abstract
Test-Time Memory Evolution updates external memory without changing model weights to guide scientific discovery more efficiently than test-time training.
Recent test-time training (TTT) frameworks have enabled open-weight large language models (LLMs) to outperform inference-only frameworks powered by frontier models on scientific discovery tasks. However, TTT introduces additional computational cost for online weight updates during the discovery process, making computational efficiency an important consideration when scaling to larger models. This motivates us to explore an efficient test-time adaptation method for scientific discovery. We introduce Test-Time Memory Evolution (TTME), a plug-and-play test-time adaptation method, as an alternative to TTT. TTME continually updates the external memory by distilling the experience to guide subsequent discovery without updating model weights. To have a clean comparison, we evaluate TTME and TTT under the same discovery framework, replacing only the test-time adaptation method. Our evaluation shows that TTME outperforms TTT on all five mathematical tasks, while reducing computational cost by 82.8-84.6% in FLOPs and 47.7-58.4% in runtime. These results establish TTME as an effective and computationally efficient alternative to TTT in the evaluated discovery settings.
View arXiv page View PDF GitHub Add to collection
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.32046 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.32046 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.32046 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co