跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 19 天前AI 評分34

HERIT 透過緩解時間偏差,促進漢字至英文歷史翻譯的全球使用

HERIT: Enabling Global Access to Hanja-to-English Historical Translation by Mitigating Temporal Bias

AI 導讀

HERIT 利用結合檢索增強生成(RAG)的領域適配流程,從大量漢字—韓語語料生成偽標註數據,減輕時間偏差並提升不同歷史時期的翻譯準確度。模型亦翻譯了檔案中此前未有譯文的部分,讓全球研究人員能夠取用相關史料。

正文

Published on Nov 3

Authors:

Abstract

HERIT adapts machine translation to historical archives via retrieval-augmented pseudo-labeling, improving accuracy across time periods and unlocking global access.

Historical archives are invaluable for multidisciplinary research but remain inaccessible globally due to severe language barriers. While manual translation is prohibitively expensive and time-consuming, simply applying existing machine translation models is inadequate due to unique linguistic nuances and the temporal bias inherent in scarce human-labeled corpora. To address these challenges, we propose HERIT, a systematic domain-adaptation pipeline that leverages retrieval-augmented generation (RAG) to generate high-quality pseudo-labeled data from abundant Hanja-Korean corpora. This approach substantially expands the training dataset, mitigating both data scarcity and temporal overfitting across different historical periods. Extensive automated and human evaluations demonstrate that HERIT consistently outperforms baselines. Finally, we translate previously untranslated portions of the archives using our model, thereby enabling global access to these resources for researchers.

View arXiv page View PDF GitHub 1 Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.04949 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.04949 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.04949 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co