中文
相关论文

相关论文: Enhancing Transformer-Based Foundation Models for …

200 篇论文

Advances in time-series forecasting are driving a shift from conventional machine learning models to foundation models (FMs) that are trained with generalized knowledge. However, existing FMs still perform poorly in the energy fields, such…

机器学习 · 计算机科学 2024-12-24 Rui Liang , Yang Deng , Donghua Xie , Fang He , Dan Wang

Large-scale renewable energy deployment introduces pronounced volatility into the electricity system, turning grid operation into a complex stochastic optimization problem. Accurate electricity price forecasting (EPF) is essential not only…

机器学习 · 计算机科学 2026-04-17 Jan Niklas Lettner , Hadeer El Ashhab , Veit Hagenmeyer , Benjamin Schäfer

Time-Series Foundation Models (TSFMs) are rapidly transitioning from research prototypes to core components of critical decision-making systems, driven by their impressive zero-shot forecasting capabilities. However, as their deployment…

机器学习 · 计算机科学 2025-12-09 Jiawen Zhang , Zhenwei Zhang , Shun Zheng , Xumeng Wen , Jia Li , Jiang Bian

Financial time series forecasting is particularly challenging for transformer-based time series foundation models (TSFMs) due to non-stationarity, heavy-tailed distributions, and high-frequency noise present in data. Low-rank adaptation…

机器学习 · 计算机科学 2026-02-02 Anthony Bolton , Wuyang Zhou , Zehua Chen , Giorgos Iacovides , Danilo Mandic

Time series (TS) data are ubiquitous across various application areas, rendering time series forecasting (TSF) a fundamental task. With the astounding advances in large language models (LLMs), a variety of methods have been developed to…

人工智能 · 计算机科学 2025-08-25 Zhuomin Chen , Dan Li , Jiahui Zhou , Shunyu Wu , Haozheng Ye , Jian Lou , See-Kiong Ng

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

机器学习 · 计算机科学 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

机器学习 · 计算机科学 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon

Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet, it remains largely a dataset-specific task, requiring comprehensive training data,…

机器学习 · 计算机科学 2026-04-27 Marco Obermeier , Marco Pruckner , Florian Haselbeck , Andreas Zeiselmair

This study introduces a framework for the forecasting, reconstruction and feature engineering of multivariate processes along with its renewable energy applications. We integrate derivative-free optimization with an ensemble of…

机器学习 · 计算机科学 2020-03-03 Mohammad Pirhooshyaran , Katya Scheinberg , Lawrence V. Snyder

Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying…

Time series data is a prevalent form of data found in various fields. It consists of a series of measurements taken over time. Forecasting is a crucial application of time series models, where future values are predicted based on historical…

机器学习 · 计算机科学 2025-09-23 Sahar Koohfar , Wubeshet Woldemariam

Time series forecasting is a challenging problem particularly when a time series expresses multiple seasonality, nonlinear trend and varying variance. In this work, to forecast complex time series, we propose ensemble learning which is…

机器学习 · 计算机科学 2022-03-03 Grzegorz Dudek

Time series forecasting is a long-standing and highly challenging research topic. Recently, driven by the rise of large language models (LLMs), research has increasingly shifted from purely time series methods toward harnessing textual…

人工智能 · 计算机科学 2025-09-03 Shiqiao Zhou , Holger Schöner , Huanbo Lyu , Edouard Fouché , Shuo Wang

Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve strong performance, they require domain-specific training, feature engineering, and ongoing…

机器学习 · 计算机科学 2026-05-26 Kavin Soni , Debanshu Das , Vamshi Guduguntla

Scaling laws motivate the development of Time Series Foundation Models (TSFMs) that pre-train vast parameters and achieve remarkable zero-shot forecasting performance. Surprisingly, even after fine-tuning, TSFMs cannot consistently…

机器学习 · 计算机科学 2025-12-23 Lifan Zhao , Yanyan Shen , Zhaoyang Liu , Xue Wang , Jiaji Deng

Time Series Foundation Models (TSFMs) have recently achieved state-of-the-art performance in univariate forecasting on new time series simply by conditioned on a brief history of past values. Their success demonstrates that large-scale…

机器学习 · 计算机科学 2025-09-18 Afrin Dange , Sunita Sarawagi

Existing data-driven approaches in modeling and predicting time series data include ARIMA (Autoregressive Integrated Moving Average), Transformer-based models, LSTM (Long Short-Term Memory) and TCN (Temporal Convolutional Network). These…

机器学习 · 计算机科学 2025-12-09 Saroj Gopali , Bipin Chhetri , Deepika Giri , Sima Siami-Namini , Akbar Siami Namin

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

计算与语言 · 计算机科学 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Time Series Foundation Models (TSFMs) leverage extensive pretraining to accurately predict unseen time series during inference, without the need for task-specific fine-tuning. Through large-scale evaluations on standard benchmarks, we find…

机器学习 · 计算机科学 2026-02-03 Anthony Bao , Venkata Hasith Vattikuti , Jeffrey Lai , William Gilpin

Time series foundation models (TSFMs) require diverse, real-world datasets to adapt across varying domains and temporal frequencies. However, current large-scale datasets predominantly focus on low-frequency time series with sampling…

机器学习 · 计算机科学 2026-04-22 Subina Khanal , Seshu Tirupathi , Merim Dzaferagic , Marco Ruffini , Torben Bach Pedersen