跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-01AI 評分38

MEA: A Reward-Driven Multi-Agent System for Faithful Model Explanations

MEA: A Reward-Driven Multi-Agent System for Faithful Model Explanations

AI 導讀

MEA 是一個多智能體框架,透過 Proposer 選擇及設定解釋工具,並以忠實度獎勵端到端優化 Actor,為表格、文字及視覺模型生成自然語言解釋。研究發現,前沿 LLM 系統性地產生不忠實解釋;MEA 在六個數據集上勝過事後解釋器、智能體及閉源基線。相較未訓練的骨幹模型,MEA 的忠實度在表格、文字及視覺任務分別提升 +28%、+21% 及 +34%。

正文

Published on Oct 1

Authors:

,

,

,

,

Abstract

Recent years have seen the employment of a plethora of machine learning (ML) models in high-stakes domains, but they remain largely opaque to the practitioners who act on their predictions. While post-hoc explanation methods offer a lens into this model behavior, wielding them effectively demands expertise most domain experts lack: navigating high-dimensional outputs, selecting the best explanations, and synthesizing evidence across disparate tools. To this end, we present MEA, a multi-agent framework that removes the explanation knowledge barrier entirely: a Proposer agent selects and configures explanation tools based on the question and modality, while an Actor agent is optimized end-to-end against faithfulness, transforming the outputs into natural language explanations grounded in model behavior across tabular, text, and vision modalities. Further, we introduce diverse question types spanning feature attribution, counterfactual reasoning, and spurious feature detection, each paired with a perturbation-based faithfulness metric. We find that frontier LLMs systematically produce unfaithful explanations. By optimizing against faithfulness rewards augmented with a modality-adaptive penalty, MEA consistently outperforms post hoc explainers, agentic, and closed-source baselines across six datasets, with reward-driven optimization yielding faithfulness gains of +28% (tabular), +21% (text), and +34% (vision) over the untrained backbone. More broadly, our findings suggest that AI agents themselves can serve as a scalable, adaptable interface to ML explainability, opening a path toward natural-language explainability that generalizes beyond the fixed, single-purpose tools that have long defined the field.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.02480

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.02480 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.02480 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.02480 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co