English
Related papers

Related papers: Position: Universal Time Series Foundation Models …

200 papers

Despite the increasing relevance of forecasting methods, causal implications of these algorithms remain largely unexplored. This is concerning considering that, even under simplifying assumptions such as causal sufficiency, the statistical…

In this paper, we obtain generic bounds on the variances of estimation and prediction errors in time series analysis via an information-theoretic approach. It is seen in general that the error bounds are determined by the conditional…

Information Theory · Computer Science 2021-05-12 Song Fang , Mikael Skoglund , Karl Henrik Johansson , Hideaki Ishii , Quanyan Zhu

The recent development of foundation models for time series data has generated considerable interest in using such models across a variety of applications. Although foundation models achieve state-of-the-art predictive performance, their…

Machine Learning · Computer Science 2026-05-29 Coen Adler , Yuxin Chang , Felix Draxler , Samar Abdi , Padhraic Smyth

AI models, including both time-series-specific and general-purpose Foundation Models (FMs), have demonstrated strong potential in time-series forecasting across sectors like finance. However, these models are highly sensitive to input…

Transformer-based foundation models have emerged as a dominant paradigm in time series analysis, offering unprecedented capabilities in tasks such as forecasting, anomaly detection, classification, trend analysis and many more time series…

Time series foundation models have shown impressive performance on a variety of tasks, across a wide range of domains, even in zero-shot settings. However, most of these models are designed to handle short univariate time series as an…

Machine Learning · Computer Science 2024-09-23 Nina Żukowska , Mononito Goswami , Michał Wiliński , Willa Potosnak , Artur Dubrawski

Time-series foundation models (TSFMs) achieve strong forecast accuracy, yet accuracy alone does not determine practical value. The form of a forecast -- point, quantile, parametric, or trajectory ensemble -- fundamentally constrains which…

Machine Learning · Computer Science 2025-10-23 Alvaro Perez-Diaz , James C. Loach , Danielle E. Toutoungi , Lee Middleton

Exposure bias refers to the train-test discrepancy that seemingly arises when an autoregressive generative model uses only ground-truth contexts at training time but generated ones at test time. We separate the contributions of the model…

Machine Learning · Computer Science 2019-11-11 Florian Schmidt

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Time series anomaly detection (TSAD) is a critical task, but developing models that generalize to unseen data in a zero-shot manner remains a major challenge. Prevailing foundation models for TSAD predominantly rely on reconstruction-based…

Machine Learning · Computer Science 2026-05-29 Tian Lan , Hao Duong Le , Jinbo Li , Wenjun He , Meng Wang , Chenghao Liu , Chen Zhang

In this paper we propose a general framework to analyze prediction in time series models and show how a wide class of popular time series models satisfies this framework. We postulate a set of high-level assumptions, and formally verify…

Econometrics · Economics 2019-02-06 Eric Beutner , Alexander Heinemann , Stephan Smeekes

Time series foundation models excel at diverse time series forecasting tasks, but their capacity for continuous improvement through incremental learning remains unexplored. We present the first comprehensive study investigating these…

Machine Learning · Computer Science 2025-04-22 Jia Liu , Cheng Jinguo , Xia Fang , Zhenyuan Ma , Yuankai Wu

Using a time series model to mimic an observed time series has a long history. However, with regard to this objective, conventional estimation methods for discrete-time dynamical models are frequently found to be wanting. In fact, they are…

Statistics Theory · Mathematics 2015-03-19 Yingcun Xia , Howell Tong

We derive universal upper estimates for model-prediction error under moderate but otherwise unknown model uncertainty. Our estimates give upper bounds on the leading order trajectory-uncertainty arising along model trajectories, solely as…

Chaotic Dynamics · Physics 2021-02-03 Bálint Kaszás , George Haller

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Machine Learning · Computer Science 2025-08-15 Luca-Andrei Fechete , Mohamed Sana , Fadhel Ayed , Nicola Piovesan , Wenjie Li , Antonio De Domenico , Tareq Si Salem

Despite the excelling performance of machine learning models, understanding their decisions remains a long-standing goal. Although commonly used attribution methods from explainable AI attempt to address this issue, they typically rely on…

Machine Learning · Computer Science 2025-11-20 Juan Miguel Lopez Alcaraz , Nils Strodthoff

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

Time series forecasting has become a critical task due to its high practicality in real-world applications such as traffic, energy consumption, economics and finance, and disease analysis. Recent deep-learning-based approaches have shown…

Machine Learning · Computer Science 2023-05-30 Youngin Cho , Daejin Kim , Dongmin Kim , Mohammad Azam Khan , Jaegul Choo

In real-world applications, machine learning models often become obsolete due to shifts in the joint distribution arising from underlying temporal trends, a phenomenon known as the "concept drift". Existing works propose model-specific…

Machine Learning · Computer Science 2023-10-04 Chia-Yuan Chang , Yu-Neng Chuang , Zhimeng Jiang , Kwei-Herng Lai , Anxiao Jiang , Na Zou

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. These models are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series…

Risk Management · Quantitative Finance 2025-05-19 Anubha Goel , Puneet Pasricha , Martin Magris , Juho Kanniainen