English
Related papers

Related papers: Benchmarking State Space Models, Transformers, and…

200 papers

Accurate short-term energy consumption forecasting is essential for efficient power grid management, resource allocation, and market stability. Traditional time-series models often fail to capture the complex, non-linear dependencies and…

Computers and Society · Computer Science 2026-01-27 Abhishek Maity , Viraj Tukarul

Recent works have demonstrated that attention-based transformer and large language model (LLM) architectures can achieve strong channel state prediction (CSP) performance by capturing long-range temporal dependencies across channel state…

Information Theory · Computer Science 2026-04-27 Aladin Djuhera , Haris Gacanin , Holger Boche

Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tao Zhang , Haobo Yuan , Lu Qi , Jiangning Zhang , Qianyu Zhou , Shunping Ji , Shuicheng Yan , Xiangtai Li

Recent developments related to the energy transition pose particular challenges for distribution grids. Hence, precise load forecasts become more and more important for effective grid management. Novel modeling approaches such as the…

Machine Learning · Computer Science 2023-05-19 Elena Giacomazzi , Felix Haag , Konstantin Hopf

Accurate electrical load forecasting is crucial for optimizing power system operations, planning, and management. As power systems become increasingly complex, traditional forecasting methods may fail to capture the intricate patterns and…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Elias Raffoul , Mingjian Tuo , Cunzhi Zhao , Tianxia Zhao , Meng Ling , Xingpeng Li

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

Ensuring sustainability demands more efficient energy management with minimized energy wastage. Therefore, the power grid of the future should provide an unprecedented level of flexibility in energy management. To that end, intelligent…

Neural and Evolutionary Computing · Computer Science 2018-11-29 Daniel L. Marino , Kasun Amarasinghe , Milos Manic

Monitoring the spatiotemporal dynamics of forest CO$_2$ uptake (Gross Primary Production, GPP), remains a central challenge in terrestrial ecosystem research. While Eddy Covariance (EC) towers provide high-frequency estimates, their limited…

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Road traffic forecasting is crucial in real-world intelligent transportation scenarios like traffic dispatching and path planning in city management and personal traveling. Spatio-temporal graph neural networks (STGNNs) stand out as the…

Machine Learning · Computer Science 2025-01-03 Yuchen Fang , Yuxuan Liang , Bo Hui , Zezhi Shao , Liwei Deng , Xu Liu , Xinke Jiang , Kai Zheng

This paper improves wind power prediction via weather forecast-contextualized Long Short-Term Memory Neural Network (LSTM) models. Initially, only wind power data was fed to a generic LSTM, but this model performed poorly, with erratic and…

Machine Learning · Computer Science 2019-08-06 Maximilian Du

State Space Models (SSMs) have emerged as efficient alternatives to Vision Transformers (ViTs), with VMamba standing out as a pioneering architecture designed for vision tasks. However, their generalization performance degrades…

Load data from power network clusters indicates economic development in each area, crucial for predicting regional trends and guiding power enterprise decisions. The Transformer model, a leading method for load prediction, faces challenges…

Machine Learning · Computer Science 2024-07-31 Cheng Jiang , Gang Lu , Xue Ma , Di Wu

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Energy forecasting has a vital role to play in smart grid (SG) systems involving various applications such as demand-side management, load shedding, and optimum dispatch. Managing efficient forecasting while ensuring the least possible…

Machine Learning · Computer Science 2022-05-25 Devinder Kaur , Shama Naz Islam , Md. Apel Mahmud , Md. Enamul Haque , ZhaoYang Dong

Reliable forecasting of Global Horizontal Irradiance (GHI) is essential for mitigating the variability of solar energy in power grids. This study presents a comprehensive benchmark of ten deep learning architectures for short-term (1-hour…

Machine Learning · Computer Science 2026-01-01 Tin Hoang

As the energy landscape changes quickly, grid operators face several challenges, especially when integrating renewable energy sources with the grid. The most important challenge is to balance supply and demand because the solar and wind…

Machine Learning · Computer Science 2025-01-24 Kamal Sarkar

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

Accurate traffic prediction plays a vital role in intelligent transportation systems by enabling efficient routing, congestion mitigation, and proactive traffic control. However, forecasting is challenging due to the combined effects of…

Machine Learning · Computer Science 2025-07-08 Mohamed Hamad , Mohamed Mabrok , Nizar Zorba

The reliable operation of modern power grids requires probabilistic load forecasts with well-calibrated uncertainty estimates. However, existing deep learning models produce overconfident point predictions that fail catastrophically under…

Machine Learning · Computer Science 2026-03-10 Sajib Debnath , Md. Uzzal Mia