English
Related papers

Related papers: Transformer Training Strategies for Forecasting Mu…

200 papers

In this paper, we propose an environment sensing-aided beam prediction model for smart factory that can be transferred from given environments to a new environment. In particular, we first design a pre-training model that predicts the…

Signal Processing · Electrical Eng. & Systems 2024-05-27 Yuan Feng , Chuanbing Zhao , Feifei Gao , Yong Zhang , Shaodan Ma

Considering the multimodal nature of transport systems and potential cross-modal correlations, there is a growing trend of enhancing demand forecasting accuracy by learning from multimodal data. These multimodal forecasting models can…

Machine Learning · Computer Science 2022-06-10 Can Li , Lei Bai , Wei Liu , Lina Yao , S Travis Waller

In practical machine learning settings, the data on which a model must make predictions often come from a different distribution than the data it was trained on. Here, we investigate the problem of unsupervised multi-source domain…

Machine Learning · Computer Science 2020-09-17 Dustin Wright , Isabelle Augenstein

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

Machine Learning · Computer Science 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

As global energy systems transit to clean energy, accurate renewable generation and renewable demand forecasting is imperative for effective grid management. Foundation Models (FMs) can help improve forecasting of renewable generation and…

Systems and Control · Electrical Eng. & Systems 2025-08-01 Md Meftahul Ferdaus , Tanmoy Dam , Md Rasel Sarkar , Moslem Uddin , Sreenatha G. Anavatti

As a key component of power system production simulation, load forecasting is critical for the stable operation of power systems. Machine learning methods prevail in this field. However, the limited training data can be a challenge. This…

Systems and Control · Electrical Eng. & Systems 2024-12-18 Linna Xu , Yongli Zhu

Deep learning has contributed remarkably to the advancement of time series analysis. Still, deep models can encounter performance bottlenecks in real-world data-scarce scenarios, which can be concealed due to the performance saturation with…

Machine Learning · Computer Science 2024-10-21 Yong Liu , Haoran Zhang , Chenyu Li , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Human intention prediction provides an augmented solution for the design of assistants and collaboration between the human driver and intelligent vehicles. In this study, a multi-task sequential learning framework is developed to predict…

Human-Computer Interaction · Computer Science 2022-07-04 Yang Xing , Wenbo Li , Xiaoyu Mo , Chen Lv

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

Artificial Intelligence · Computer Science 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu

The operational effectiveness of digital-twin technology in motorway traffic management depends on the availability of a continuous flow of high-resolution real-time traffic data. To function as a proactive decision-making support layer…

Artificial Intelligence · Computer Science 2026-02-06 Krešimir Kušić , Vinny Cahill , Ivana Dusparic

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Accurate electrical load forecasting is of great importance for the efficient operation and control of modern power systems. In this work, a hybrid long short-term memory (LSTM)-based model with online correction is developed for day-ahead…

Systems and Control · Electrical Eng. & Systems 2024-03-07 Nan Lu , Quan Ouyang , Yang Li , Changfu Zou

Rapid global urbanization is a double-edged sword, heralding promises of economical prosperity and public health while also posing unique environmental and humanitarian challenges. Smart and connected communities (S&CCs) apply data-centric…

Machine Learning · Computer Science 2022-11-22 Alexander C. DeRieux , Walid Saad , Wangda Zuo , Rachmawan Budiarto , Mochamad Donny Koerniawan , Dwi Novitasari

Electricity load forecasting enables the grid operators to optimally implement the smart grid's most essential features such as demand response and energy efficiency. Electricity demand profiles can vary drastically from one region to…

Machine Learning · Computer Science 2023-05-15 Abdul Wahab , Muhammad Anas Tahir , Naveed Iqbal , Faisal Shafait , Syed Muhammad Raza Kazmi

Short-term load forecasting is one of the crucial sections in smart grid. Precise forecasting enables system operators to make reliable unit commitment and power dispatching decisions. With the advent of big data, a number of artificial…

Signal Processing · Electrical Eng. & Systems 2018-09-27 Tiantian Li , Bo Wang , Min Zhou , Junzo Watada

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Data privacy and security have become a non-negligible factor in load forecasting. Previous researches mainly focus on training stage enhancement. However, once the model is trained and deployed, it may need to `forget' (i.e., remove the…

Machine Learning · Computer Science 2024-03-12 Wangkun Xu , Fei Teng

Electric vehicles (EVs) have the potential to reduce grid stress through smart charging strategies while simultaneously meeting user demand. This requires accurate forecasts of key charging parameters, such as energy demand and connection…

Systems and Control · Electrical Eng. & Systems 2025-08-26 Parnian Alikhani , Nico Brinkel , Wouter Schram , Ioannis Lampropoulos , Wilfried van Sark

Scaling transformers has led to significant breakthroughs in many domains, leading to a paradigm in which larger versions of existing models are trained and released on a periodic basis. New instances of such models are typically trained…

Floods are the most common form of natural disaster and accurate flood forecasting is essential for early warning systems. Previous work has shown that machine learning (ML) models are a promising way to improve flood predictions when…

Machine Learning · Computer Science 2025-04-18 Emil Ryd , Grey Nearing