跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 21 天前AI 評分47

FinForesight:金融預測深度研究系統的診斷式回測基準

FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting

AI 導讀

FinForesight 是一項診斷式回測基準,用於評估金融深度研究系統的預測能力,並比較歷史、截點後及即時表現。基準涵蓋中國、美國及香港市場的四項預測任務,並將反事實推理和金融計算作為獨立診斷任務評分。研究發現,預訓練時期的分數在大多數時間比較中高於截點後分數;程式碼及基準數據已公開。

正文

Published on Nov 1

Authors:

,

,

,

,

,

,

Abstract

FinForesight is a diagnostic backtesting benchmark that evaluates financial deep research forecasting under time-restricted retrieval and compares historical, post-cutoff, and live performance.

Anticipating financial outcomes requires synthesizing evolving evidence and reasoning under uncertainty, making deep research systems promising tools for forecasting. Yet evaluating forecasting ability is challenging because historical backtests may reward memorized outcomes or information retrieved after the forecast date. Live forecasting avoids direct access to realized outcomes, but feedback arrives only after events resolve. To obtain timely feedback and assess historical scores, we introduce FinForesight, a diagnostic backtesting benchmark for financial deep research systems. Across the Chinese, U.S., and Hong Kong markets, the benchmark evaluates four forecasting tasks: valuation, return ranking, event direction, and future financial fundamentals. Two capability diagnostic tasks assess counterfactual reasoning and financial calculation, scored separately from forecasting performance. Our harness-compatible framework restricts retrieved evidence to information available at the forecast date. We compare pretraining-era, resolved post-cutoff, and live evaluations to test whether controlled backtests approximate future performance. Pretraining-era scores exceed post-cutoff scores in most temporal comparisons, and stronger retrieval controls narrow the gap between post-cutoff backtests and live results. Forecasting attribution and robustness analyses reveal how scores respond to retrieval policy and how predictions respond to prompt rewrites and numerical perturbations. The code and benchmark data are publicly available.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2611.01621

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.01621 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.01621 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.01621 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co