跳到正文
Cohere Labs:官方研究博客·· 3 天前AI 評分53

敍事鴻溝:大語言模型能否協助用戶跨語言瀏覽多元敍事?

THE NARRATIVE GAP: Can LLMs Help Us Navigate Diverse Narratives Across Languages?

AI 導讀

Cohere Labs 提出 NarrativeBench,並評估 14 個大語言模型,發現現有模型尚缺乏可靠引導用戶跨語言瀏覽多元敍事的能力。基準包含 1,333 篇來自 23 種出版語言、涉及 23 個爭議議題的新聞文章,以及 460 個以 Reddit 為基礎的查詢;評估涵蓋 24 種查詢語言。研究指出,資訊可及性會隨查詢框架和語言而異,這種差異可能加劇迴音室、語言篩選泡泡及資訊落差。

正文

Large language models (LLMs) increasingly mediate how people seek and consume information, including accounts that differ across languages and regions, especially on contested topics. Supporting diverse information seeking requires models to help users navigate competing narratives across languages and information streams. We define six capabilities necessary for diverse multilingual information seeking: three foundational capabilities for narrative inclusion, narrative exclusion, and missing narrative identification; and three higher-level capabilities for presenting diverse narratives, preserving narrative coverage under confirmatory queries, and maintaining information parity across languages. To guide the development of those information seeking capabilities, we introduce NarrativeBench, a benchmark comprising 1,333 news articles in 23 publication languages across 23 contested topics and 460 Reddit-grounded queries. Evaluating 14 LLMs across 24 query languages, we find that current models lack the capabilities needed to reliably navigate diverse narratives, limiting users’ control over the perspectives they receive and leaving substantial gaps in exposure to competing accounts even when diversity is explicitly requested. Information access also differs across query framings and languages, risking echo chambers, linguistic filter bubbles, and information disparities that weaken the common ground needed for democratic discourse. NarrativeBench provides a foundation for developing information systems that give users across languages and regions agency to navigate diverse narratives.

來源:Cohere Labs:官方研究博客 · cohere.com