Do LLMs Understand Sequential Structure? A Controlled Study of Inference and Generation
Do LLMs Understand Sequential Structure? A Controlled Study of Inference and Generation
研究以雙人石頭剪刀布互動和單人隨機 n-gram 延續任務,測試大語言模型能否識別潛在策略、遵循簡單 Markov 規則並維持高階條件依賴。結果顯示,較長上下文未能改善識別;正確辨認規則不代表能忠實模擬,高階依賴亦會大幅降低規則恢復能力。表面上符合行為模式,仍可能掩蓋錯誤的生成機制。
Published on Oct 4
Authors:
,
,
,
,
Abstract
Large language models (LLMs) are increasingly used as interactive agents and simulators, yet it remains unclear whether they can recover latent sequential structure beyond surface action frequencies. This distinction is critical for behavioral simulation, where actions are often shaped by prior context rather than marginal frequencies alone. We study this question using controlled two-player Rock--Paper--Scissors interactions and a one-player stochastic n-gram continuation task. Across these experiments, we test whether LLMs can identify latent strategies, follow simple Markov rules, and sustain higher-order conditional dependencies. Our framework separates distribution matching from conditional rule following. Results show that longer context does not improve identification, correct recognition does not ensure faithful simulation, and higher-order dependencies substantially degrade rule recovery. Apparent behavioral fidelity can therefore mask incorrect generative mechanisms.
View arXiv page View PDF Add to collection
Get this paper in your agent:
hf papers read 2610.04977
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.04977 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.04977 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.04977 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co