中文
相关论文

相关论文: Transformer Training Strategies for Forecasting Mu…

200 篇论文

Load forecasting is essential for the efficient, reliable, and cost-effective management of power systems. Load forecasting performance can be improved by learning the similarities among multiple entities (e.g., regions, buildings).…

机器学习 · 统计学 2025-02-07 Onintze Zaballa , Verónica Álvarez , Santiago Mazuelas

This study investigates the application of Transfer Learning (TL) on Transformer architectures to enhance building energy consumption forecasting. Transformers are a relatively new deep learning architecture, which has served as the…

机器学习 · 计算机科学 2024-11-22 Robert Spencer , Surangika Ranathunga , Mikael Boulic , Andries van Heerden , Teo Susnjak

Neural networks have revolutionized many empirical fields, yet their application to financial time series forecasting remains controversial. In this study, we demonstrate that the conventional practice of estimating models locally in…

计量经济学 · 经济学 2025-02-21 Chen Liu , Minh-Ngoc Tran , Chao Wang , Richard Gerlach , Robert Kohn

Load-forecasting problems have already been widely addressed with different approaches, granularities and objectives. Recent studies focus not only on deep learning methods but also on forecasting loads on single building level. This study…

系统与控制 · 电气工程与系统科学 2020-07-15 Thomas Steens , Jan-Simon Telle , Benedikt Hanke , Karsten von Maydell , Carsten Agert , Gian-Luca di Modica , Bernd Engel , Matthias Grottke

Deep learning models, particularly Transformers, have achieved impressive results in various domains, including time series forecasting. While existing time series literature primarily focuses on model architecture modifications and data…

机器学习 · 计算机科学 2023-12-01 Valentino Assandri , Sam Heshmati , Burhaneddin Yaman , Anton Iakovlev , Ariel Emiliano Repetur

A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness against dynamic learning environments. This paper proposes…

Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models. The concept of universal forecasting,…

机器学习 · 计算机科学 2024-05-24 Gerald Woo , Chenghao Liu , Akshat Kumar , Caiming Xiong , Silvio Savarese , Doyen Sahoo

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

机器学习 · 计算机科学 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Machine learning models have made significant progress in load forecasting, but their forecast accuracy is limited in cases where historical load data is scarce. Inspired by the outstanding performance of large language models (LLMs) in…

Simultaneous load forecasting across multiple entities (e.g., regions, buildings) is crucial for the efficient, reliable, and cost-effective operation of power systems. Accurate load forecasting is a challenging problem due to the inherent…

机器学习 · 计算机科学 2026-01-21 Onintze Zaballa , Verónica Álvarez , Santiago Mazuelas

Solar forecasting from ground-based sky images has shown great promise in reducing the uncertainty in solar power generation. With more and more sky image datasets open sourced in recent years, the development of accurate and reliable deep…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Yuhao Nie , Quentin Paletta , Andea Scott , Luis Martin Pomares , Guillaume Arbod , Sgouris Sgouridis , Joan Lasenby , Adam Brandt

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

机器学习 · 计算机科学 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Short-Term Load Forecasting (STLF) is a fundamental component in the efficient management of power systems, which has been studied intensively over the past 50 years. The emerging development of smart grid technologies is posing new…

最优化与控制 · 数学 2017-02-28 The-Hien Dang-Ha , Filippo Maria Bianchi , Roland Olsson

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

机器学习 · 计算机科学 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Understanding trajectory diversity is a fundamental aspect of addressing practical traffic tasks. However, capturing the diversity of trajectories presents challenges, particularly with traditional machine learning and recurrent neural…

人工智能 · 计算机科学 2023-12-04 Ruyi Feng , Zhibin Li , Bowen Liu , Yan Ding

Forecasting load in power transmission networks is essential across various hierarchical levels, from the system level down to individual points of delivery (PoD). While intuitive and locally accurate, traditional local forecasting models…

机器学习 · 计算机科学 2025-07-17 Amirhossein Ahmadi , Hamidreza Zareipour , Henry Leung

Spatial-temporal prediction is a fundamental problem for constructing smart city, which is useful for tasks such as traffic control, taxi dispatching, and environmental policy making. Due to data collection mechanism, it is common to see…

机器学习 · 计算机科学 2020-08-25 Huaxiu Yao , Yiding Liu , Ying Wei , Xianfeng Tang , Zhenhui Li

With the employment of smart meters, massive data on consumer behaviour can be collected by retailers. From the collected data, the retailers may obtain the household profile information and implement demand response. While retailers prefer…

机器学习 · 计算机科学 2022-10-19 Yi Dong , Yang Chen , Xingyu Zhao , Xiaowei Huang

Task embeddings in multi-layer perceptrons for multi-task learning and inductive transfer learning in renewable power forecasts have recently been introduced. In many cases, this approach improves the forecast error and reduces the required…

机器学习 · 计算机科学 2022-05-02 Jens Schreiber , Stephan Vogt , Bernhard Sick

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

机器学习 · 计算机科学 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang