學習中的結構化最佳化網絡穩健解釋分析(REASON)
Robust Explanatory Analysis for Structured Optimization Networks (REASON) in Learning
REASON 提出雙迴圈推理框架,以快速迴圈處理現有證據可解決的殘差,並由中速迴圈主動取得額外證據,提升分佈偏移下的穩健性。實驗顯示,雙迴圈模型以約為中速迴圈一半的計算量持續勝過快速迴圈,包括面對未見過的損壞時。提供較乾淨的觀測時,模型在相同計算成本下亦勝過分階段分類器及 learning-to-defer 方法。
Published on Oct 14
Authors:
,
Abstract
A two-loop inference framework resolves residual errors via fast and evidence-seeking loops to improve robustness under distribution shift with lower computation.
We seek a hierarchical resolution of residual error under a composite learning objective as a principled mechanism for identifying and exploiting additional information, particularly under distribution shift and perturbation. Inspired by the System 1/System 2 paradigm, we formulate this principle as a two-loop mechanism serving a common inference goal. A fast, System 1-like loop resolves the residual addressable by the available evidence; the remaining epistemic residual triggers a medium speed, System 2-like loop that actively acquires additional evidence and measures its informational value through residual reduction. Over nested solution spaces, the medium-loop optimum is provably no worse than the fast-loop optimum. Experiments show that the resulting two-loop model consistently improves upon the fast loop at approximately half the computation of the medium loop, including under unseen corruptions, and, when provided a cleaner observation, outperforms staged classifiers and learning-to-defer methods at equal computational cost.
View arXiv page View PDF Add to collection
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.19378 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.19378 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.19378 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co