English
Related papers

Related papers: Toto: Time Series Optimized Transformer for Observ…

200 papers

The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the performance of Time…

Machine Learning · Computer Science 2025-07-15 Sami Achour , Yassine Bouher , Duong Nguyen , Nicolas Chesneau

Machine learning models have made significant progress in load forecasting, but their forecast accuracy is limited in cases where historical load data is scarce. Inspired by the outstanding performance of large language models (LLMs) in…

Machine Learning · Computer Science 2024-12-02 Wenlong Liao , Fernando Porte-Agel , Jiannong Fang , Christian Rehtanz , Shouxiang Wang , Dechang Yang , Zhe Yang

Recent advances in time-series forecasting increasingly rely on pre-trained foundation-style models. While these models often claim broad generalization, existing evaluation protocols provide limited evidence. Indeed, most current…

Time series foundation models excel in zero-shot forecasting, handling diverse tasks without explicit training. However, the advancement of these models has been hindered by the lack of comprehensive benchmarks. To address this gap, we…

Machine Learning · Computer Science 2024-11-12 Taha Aksu , Gerald Woo , Juncheng Liu , Xu Liu , Chenghao Liu , Silvio Savarese , Caiming Xiong , Doyen Sahoo

Large pre-trained models have demonstrated remarkable capabilities across domains, but their effectiveness in time series forecasting remains understudied. This work empirically examines whether pre-trained large-scale time series models…

Machine Learning · Computer Science 2025-07-08 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz

Three challenges limit the progress of robot learning research: robots are expensive (few labs can participate), everyone uses different robots (findings do not generalize across labs), and we lack internet-scale robotics data. We take on…

Climate change stands as one of the most pressing global challenges of the twenty-first century, with far-reaching consequences such as rising sea levels, melting glaciers, and increasingly extreme weather patterns. Accurate forecasting is…

Machine Learning · Computer Science 2025-06-17 Tajamul Ashraf , Janibul Bashir

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…

We present a joint forecasting framework for time series prediction that contrasts with traditional direct or recursive methods. This framework achieves state-of-the-art performance for our designed foundation model, YingLong, and reveals a…

Machine Learning · Computer Science 2025-06-16 Xue Wang , Tian Zhou , Jinyang Gao , Bolin Ding , Jingren Zhou

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

Machine Learning · Computer Science 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Inspired by recent advances in large language models, foundation models have been developed for zero-shot time series forecasting, enabling prediction on datasets unseen during pretraining. These large-scale models, trained on vast…

Machine Learning · Computer Science 2025-12-01 Morad Laglil , Emilie Devijver , Eric Gaussier , Bertrand Pracca

The recent surge in Time Series Foundation Models has rapidly advanced the field, yet the heterogeneous training setups across studies make it difficult to attribute improvements to architectural innovations versus data engineering. In this…

Machine Learning · Computer Science 2026-02-09 Yunshi Wen , Wesley M. Gifford , Chandra Reddy , Lam M. Nguyen , Jayant Kalagnanam , Anak Agung Julius

Time series foundation models have recently gained a lot of attention due to their ability to model complex time series data encompassing different domains including traffic, energy, and weather. Although they exhibit strong average…

Machine Learning · Computer Science 2026-01-21 Shivani Tomar , Seshu Tirupathi , Elizabeth Daly , Ivana Dusparic

Any industrial system goes along with objectives to be met (e.g. economic performance), disturbances to handle (e.g. market fluctuations, catalyst decay, unexpected variations in uncontrolled flow rates and compositions,...), and…

Optimization and Control · Mathematics 2021-08-20 Aris Papasavvas

Time series forecasting has various applications, such as meteorological rainfall prediction, traffic flow analysis, financial forecasting, and operational load monitoring for various systems. Due to the sparsity of time series data,…

Machine Learning · Computer Science 2025-10-01 Xiaojian Wang , Chaoli Zhang , Zhonglong Zheng , Yunliang Jiang

Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models. The concept of universal forecasting,…

Machine Learning · Computer Science 2024-05-24 Gerald Woo , Chenghao Liu , Akshat Kumar , Caiming Xiong , Silvio Savarese , Doyen Sahoo

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Time series forecasting is prevalent in extensive real-world applications, such as financial analysis and energy planning. Previous studies primarily focus on time series modality, endeavoring to capture the intricate variations and…

Machine Learning · Computer Science 2024-10-08 Jiaxiang Dong , Haixu Wu , Yuxuan Wang , Li Zhang , Jianmin Wang , Mingsheng Long

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Transformers have shown great power in time series forecasting due to their global-range modeling ability. However, their performance can degenerate terribly on non-stationary real-world data in which the joint distribution changes over…

Machine Learning · Computer Science 2023-11-27 Yong Liu , Haixu Wu , Jianmin Wang , Mingsheng Long