English
Related papers

Related papers: Enhancing Transformer-Based Foundation Models for …

200 papers

Advances in time-series forecasting are driving a shift from conventional machine learning models to foundation models (FMs) that are trained with generalized knowledge. However, existing FMs still perform poorly in the energy fields, such…

Machine Learning · Computer Science 2024-12-24 Rui Liang , Yang Deng , Donghua Xie , Fang He , Dan Wang

Large-scale renewable energy deployment introduces pronounced volatility into the electricity system, turning grid operation into a complex stochastic optimization problem. Accurate electricity price forecasting (EPF) is essential not only…

Machine Learning · Computer Science 2026-04-17 Jan Niklas Lettner , Hadeer El Ashhab , Veit Hagenmeyer , Benjamin Schäfer

Time-Series Foundation Models (TSFMs) are rapidly transitioning from research prototypes to core components of critical decision-making systems, driven by their impressive zero-shot forecasting capabilities. However, as their deployment…

Machine Learning · Computer Science 2025-12-09 Jiawen Zhang , Zhenwei Zhang , Shun Zheng , Xumeng Wen , Jia Li , Jiang Bian

Financial time series forecasting is particularly challenging for transformer-based time series foundation models (TSFMs) due to non-stationarity, heavy-tailed distributions, and high-frequency noise present in data. Low-rank adaptation…

Machine Learning · Computer Science 2026-02-02 Anthony Bolton , Wuyang Zhou , Zehua Chen , Giorgos Iacovides , Danilo Mandic

Time series (TS) data are ubiquitous across various application areas, rendering time series forecasting (TSF) a fundamental task. With the astounding advances in large language models (LLMs), a variety of methods have been developed to…

Artificial Intelligence · Computer Science 2025-08-25 Zhuomin Chen , Dan Li , Jiahui Zhou , Shunyu Wu , Haozheng Ye , Jian Lou , See-Kiong Ng

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

Machine Learning · Computer Science 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon

Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet, it remains largely a dataset-specific task, requiring comprehensive training data,…

Machine Learning · Computer Science 2026-04-27 Marco Obermeier , Marco Pruckner , Florian Haselbeck , Andreas Zeiselmair

This study introduces a framework for the forecasting, reconstruction and feature engineering of multivariate processes along with its renewable energy applications. We integrate derivative-free optimization with an ensemble of…

Machine Learning · Computer Science 2020-03-03 Mohammad Pirhooshyaran , Katya Scheinberg , Lawrence V. Snyder

Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying…

Time series data is a prevalent form of data found in various fields. It consists of a series of measurements taken over time. Forecasting is a crucial application of time series models, where future values are predicted based on historical…

Machine Learning · Computer Science 2025-09-23 Sahar Koohfar , Wubeshet Woldemariam

Time series forecasting is a challenging problem particularly when a time series expresses multiple seasonality, nonlinear trend and varying variance. In this work, to forecast complex time series, we propose ensemble learning which is…

Machine Learning · Computer Science 2022-03-03 Grzegorz Dudek

Time series forecasting is a long-standing and highly challenging research topic. Recently, driven by the rise of large language models (LLMs), research has increasingly shifted from purely time series methods toward harnessing textual…

Artificial Intelligence · Computer Science 2025-09-03 Shiqiao Zhou , Holger Schöner , Huanbo Lyu , Edouard Fouché , Shuo Wang

Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve strong performance, they require domain-specific training, feature engineering, and ongoing…

Machine Learning · Computer Science 2026-05-26 Kavin Soni , Debanshu Das , Vamshi Guduguntla

Scaling laws motivate the development of Time Series Foundation Models (TSFMs) that pre-train vast parameters and achieve remarkable zero-shot forecasting performance. Surprisingly, even after fine-tuning, TSFMs cannot consistently…

Machine Learning · Computer Science 2025-12-23 Lifan Zhao , Yanyan Shen , Zhaoyang Liu , Xue Wang , Jiaji Deng

Time Series Foundation Models (TSFMs) have recently achieved state-of-the-art performance in univariate forecasting on new time series simply by conditioned on a brief history of past values. Their success demonstrates that large-scale…

Machine Learning · Computer Science 2025-09-18 Afrin Dange , Sunita Sarawagi

Existing data-driven approaches in modeling and predicting time series data include ARIMA (Autoregressive Integrated Moving Average), Transformer-based models, LSTM (Long Short-Term Memory) and TCN (Temporal Convolutional Network). These…

Machine Learning · Computer Science 2025-12-09 Saroj Gopali , Bipin Chhetri , Deepika Giri , Sima Siami-Namini , Akbar Siami Namin

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Time Series Foundation Models (TSFMs) leverage extensive pretraining to accurately predict unseen time series during inference, without the need for task-specific fine-tuning. Through large-scale evaluations on standard benchmarks, we find…

Machine Learning · Computer Science 2026-02-03 Anthony Bao , Venkata Hasith Vattikuti , Jeffrey Lai , William Gilpin

Time series foundation models (TSFMs) require diverse, real-world datasets to adapt across varying domains and temporal frequencies. However, current large-scale datasets predominantly focus on low-frequency time series with sampling…

Machine Learning · Computer Science 2026-04-22 Subina Khanal , Seshu Tirupathi , Merim Dzaferagic , Marco Ruffini , Torben Bach Pedersen