English
Related papers

Related papers: Reverso: Efficient Time Series Foundation Models f…

200 papers

While recent advancements in foundation models have significantly impacted machine learning, rigorous tests on the performance of time series foundation models (TSFMs) remain largely underexplored. This paper presents an empirical study…

Machine Learning · Computer Science 2025-01-09 Syamantak Datta Gupta

Time series forecasting is critical in numerous real-world applications, requiring accurate predictions of future values based on observed patterns. While traditional forecasting techniques work well in in-domain scenarios with ample data,…

Machine Learning · Computer Science 2024-11-26 Liran Nochumsohn , Michal Moshkovitz , Orly Avner , Dotan Di Castro , Omri Azencot

Large models support great zero-shot and few-shot capabilities. However, updating these models on new tasks can break performance on previous seen tasks and their zero/few-shot unseen tasks. Our work explores how to update zero/few-shot…

Machine Learning · Computer Science 2023-01-30 Siddhartha Datta , Nigel Shadbolt

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

Machine Learning · Computer Science 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

We introduce the Cisco Time Series Model, a univariate zero-shot forecaster. This time series foundation model is the result of a general architectural innovation to a time series model enabling it to accept multiresolution input, applied…

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

Machine Learning · Computer Science 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

Time series forecasting plays a crucial role in data mining, driving rapid advancements across numerous industries. With the emergence of large models, time series foundation models (TSFMs) have exhibited remarkable generalization…

Machine Learning · Computer Science 2024-12-31 Huanyu Zhang , Chang Xu , Yi-Fan Zhang , Zhang Zhang , Liang Wang , Jiang Bian , Tieniu Tan

Motivated by recent advances in large language models for Natural Language Processing (NLP), we design a time-series foundation model for forecasting whose out-of-the-box zero-shot performance on a variety of public datasets comes close to…

Computation and Language · Computer Science 2024-04-19 Abhimanyu Das , Weihao Kong , Rajat Sen , Yichen Zhou

Accurate household electricity short-term load forecasting (STLF) is key to future and sustainable energy systems. While various studies have analyzed statistical, machine learning, or deep learning approaches for household electricity…

Computational Engineering, Finance, and Science · Computer Science 2026-01-09 Marcel Meyer , David Zapata , Sascha Kaltenpoth , Oliver Müller

Time series foundation models (TSFMs) have become increasingly popular for zero-shot forecasting. However, for a new time series domain not fully covered by the pretraining set, performance can suffer. Therefore, when a practitioner cares…

Machine Learning · Computer Science 2026-03-04 Thomas L. Lee , Edoardo M. Ponti , Amos Storkey

Time series forecasting at scale presents significant challenges for modern prediction systems, particularly when dealing with large sets of synchronized series, such as in a global payment network. In such systems, three key challenges…

Scaling laws motivate the development of Time Series Foundation Models (TSFMs) that pre-train vast parameters and achieve remarkable zero-shot forecasting performance. Surprisingly, even after fine-tuning, TSFMs cannot consistently…

Machine Learning · Computer Science 2025-12-23 Lifan Zhao , Yanyan Shen , Zhaoyang Liu , Xue Wang , Jiaji Deng

Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training, yet fine-tuning remains critical for boosting performance in domains with limited public data. With the growing number of TSFMs,…

Machine Learning · Computer Science 2025-09-30 Qingren Yao , Ming Jin , Chengqi Zhang , Chao-Han Huck Yang , Jun Qi , Shirui Pan

Foundation models for zero-shot time series forecasting face challenges in efficient long-horizon prediction and reproducibility, with existing synthetic-only approaches underperforming on challenging benchmarks. This paper presents…

Machine Learning · Computer Science 2026-02-06 Vladyslav Moroshan , Julien Siems , Arber Zela , Timur Carstensen , Frank Hutter

As global energy systems transit to clean energy, accurate renewable generation and renewable demand forecasting is imperative for effective grid management. Foundation Models (FMs) can help improve forecasting of renewable generation and…

Systems and Control · Electrical Eng. & Systems 2025-08-01 Md Meftahul Ferdaus , Tanmoy Dam , Md Rasel Sarkar , Moslem Uddin , Sreenatha G. Anavatti

We investigate input normalization methods for Time-Series Foundation Models (TSFMs). While normalization is well-studied in dataset-specific time-series models, it remains overlooked in TSFMs where generalization is critical. Time-series…

Machine Learning · Computer Science 2026-01-30 Ihab Ahmed , Denis Krompaß , Cheng Feng , Volker Tresp

This study investigates zero-shot forecasting capabilities of Time Series Foundation Models (TSFMs) for macroeconomic indicators. We apply TSFMs to forecasting economic indicators under univariate conditions, bypassing the need for train…

Machine Learning · Computer Science 2025-11-05 Jittarin Jetwiriyanon , Teo Susnjak , Surangika Ranathunga

Existing data-driven approaches in modeling and predicting time series data include ARIMA (Autoregressive Integrated Moving Average), Transformer-based models, LSTM (Long Short-Term Memory) and TCN (Temporal Convolutional Network). These…

Machine Learning · Computer Science 2025-12-09 Saroj Gopali , Bipin Chhetri , Deepika Giri , Sima Siami-Namini , Akbar Siami Namin

The ability to forecast far into the future is highly beneficial to many applications, including but not limited to climatology, energy consumption, and logistics. However, due to noise or measurement error, it is questionable how far into…

Machine Learning · Computer Science 2022-05-26 Fan-Keng Sun , Duane S. Boning