跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 3 天前AI 評分37

一再出現的批評:LLM 時代同行評審的逐項主張同質化

Twice-Told Critiques: Claim-Level Homogenization of Peer Review in the LLM Era

AI 導讀

研究發現,同行評審中的批評重疊度上升,而被 MELD 標記為 LLM 生成的評審彼此更相似,顯示單篇論文評審意見的多樣性下降。在 ICLR,同一評審階段的重疊度由 2026 年的 12.0% 升至 2027 年的 21.3%;第三份評審新增問題則由 6.12 個減至 5.46 個。

正文

Published on Nov 19

Authors:

Abstract

Critique overlap among peer reviews is rising, and reviews identified as LLM-generated are less distinct from each other, indicating decreasing diversity of critiques.

Peer review relies on several readers finding different problems. We measure critique overlap in conference and journal reviews. At ICLR, measured overlap rose from 12.0% in 2026 to 21.3% in 2027, in reviews from the same stage of the review process, with year-on-year rises at NeurIPS, ICML and the F1000 and PLOS journals. A third ICLR review of a paper added 5.46 new problems to the other two in 2027, against 6.12 in 2026. We apply MELD, a detector of LLM-generated text, to all reviews. Within a paper, two reviews that MELD flags overlap more than two unflagged reviews: by 3.0 points at ICLR in 2024-2025, by 4.5 points in 2026-2027, and by 5.4 points across five journal sources. These results provide evidence that LLM-flagged reviews of one paper are less distinct from each other than unflagged reviews, and suggest that the diversity of critiques among reviews of a single paper is falling.

View arXiv page View PDF GitHub 0 Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.26286 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.26286 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.26286 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co