時序基礎模型的循環式領域增量適應
Recurrent Domain Incremental Adaptation of Time-Series Foundation Models
PACT 將預訓練時序基礎模型的嵌入空間劃分為局部區域,透過殘差傳輸適應新運行條件,同時保留已學習條件的表現。每個新條件只需 5% 標註校準數據,在測試時無須提供條件身份;在四種軸承故障條件的序列中,平均 macro-F1 維持在 0.95 以上。編碼器、分類器及先前學習的傳輸模組保持固定。
Published on Nov 18
Authors:
,
,
,
Abstract
PACT adapts a pretrained time-series foundation model to new operating conditions by partitioning its frozen embedding space into local charts and learning gated residual transports that preserve previously learned conditions, achieving high macro-F1 with limited labeled calibration data and no condition identity at test time.
Pretrained Time-Series Foundation Models (TSFMs) provide strong representations for downstream classification tasks. Yet adapting a TSFM under changing operating conditions remains challenging. A model must improve on each newly observed condition without sacrificing conditions it has already learned, often from only a small labeled calibration set and without knowing the operating condition at inference time. We find that this difficulty has an important geometric structure. Under an operating-condition shift, the embedding space of a TSFM does not move uniformly: some local regions change substantially, while others remain nearly unchanged. Consequently, a global adaptation can unnecessarily move embeddings that were already correctly classified. To address this, we propose the novel PACT (Piecewise Adaptation via Chart Transport). PACT partitions the frozen source embedding space into local charts and learns lightweight residual transports for the regions affected by each new condition. An explicit identity path is always retained, and a learned gate softly selects among the identity and accumulated transports for each input. The pretrained TSFM encoder, classifier head, and previously learned transports remain fixed. With only 5% labeled calibration data per arriving condition and no condition identity at test time, PACT maintains an average macro-F1 above 0.95 across a four-condition bearing-fault stream. Under homogeneous tasks and label spaces, similar retention-adaptation behavior is observed across public benchmarks. Code is available at https://github.com/Sachithx/PACT.
View arXiv page View PDF Project page GitHub 0 Add to collection
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2611.24075 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2611.24075 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.24075 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co