跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-14AI 評分38

Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extraction

Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extraction

AI 導讀

MULTIFINGROUND 是一項多語言基準測試,顯示語言模型雖能識別財務概念,仍常未能找回全部對應數值證據。基準涵蓋 90 個發行人的 FY2025 英文、法文及希臘文披露資料,評估 15 個模型。當中 8 個 API 及開放權重參考模型的概念識別準確率達 97.3-99.4%,但在 26.6-41.9% 已正確識別的概念組中,至少漏掉一項目標事實。

正文

Published on Oct 14

Authors:

,

,

,

,

,

,

Abstract

The study introduces MULTIFINGROUND, a multilingual benchmark showing that language models recognize financial concepts across languages but frequently fail to recover all corresponding numerical evidence.

Comparing financial disclosures across languages requires identifying shared accounting concepts and recovering all numerical facts that express them. Existing benchmarks evaluate aspects of these capabilities, but provide limited insight into whether both succeed on the same multilingual evidence. In particular, it remains unclear whether language models can recognize these concepts across languages and exhaustively recover their corresponding numerical evidence from the same contexts. We introduce MULTIFINGROUND, a benchmark designed to investigate this recognition-grounding gap in multilingual financial reports. Constructed from FY2025 disclosures of 90 issuers in English, French, and Greek, MULTIFINGROUND aligns independently authored reports through a shared accounting taxonomy and provides traceable fact-level annotations. The benchmark evaluates financial fact identification, concept recognition, exhaustive fact selection, and concept discrimination without candidate labels. Across 15 evaluated models, eight API and open-weight reference models achieve 97.3-99.4\% concept recognition accuracy, yet miss at least one target fact in 26.6-41.9\% of correctly recognized groups. Further analyses reveal substantial variation in concept discrimination and limited gains from the evaluated finance-specialized models. Our findings demonstrate that strong concept recognition can coexist with incomplete evidence recovery, highlighting the importance of evaluating semantic recognition and evidence completeness together.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.19432

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.19432 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.19432 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.19432 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co