Source Identification Is Not Fitness Testing: Measuring the Limits of Synthetic-Data Attribution
Source Identification Is Not Fitness Testing: Measuring the Limits of Synthetic-Data Attribution
一項以金融風險文本進行的研究發現,生成內容的來源歸因準確率由原文的 98.7%,在改寫後降至 53.1%,風格重寫後則降至 29.0%。研究比較按來源資訊及參考模型評分選取生成樣本,未檢測到兩種方法對模型退化造成穩定差異,顯示辨認數據來源與判斷其訓練價值是不同問題。
Published on Sep 30
Authors:
Abstract
Repeated training on model-generated data can degrade later models. One possible response is to use provenance when deciding which generated examples to reuse. We test both how reliably that provenance can be recovered and whether it helps identify better training data. Using financial-risk text, we first identify the source of generated passages and then repeat the test after rewriting them. Generator attribution is 98.7% accurate on the original passages but falls to 53.1% after paraphrasing and 29.0% after style rewriting. Generated-versus-human detection remains close to perfect against the tested human comparison set. We then compare two ways of selecting generated examples over three rounds of generation and retraining. One uses source information. The other uses a score from a separate reference model. The two rules select different examples, but the planned comparison does not detect a stable difference in the degradation of the resulting models. The results show that identifying where data came from and identifying which data are useful for training are separate problems. The experiment therefore separates source identity, criterion-facing selection, and recursive training outcome: neither the provenance score nor the tested criterion-facing proxy is established as sufficient for future recursive behaviour.
View arXiv page View PDF Project page Add to collection
Get this paper in your agent:
hf papers read 2610.00417
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.00417 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.00417 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.00417 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co