English
Related papers

Related papers: SegRNN: Segment Recurrent Neural Network for Long-…

200 papers

Neural Forecasters (NFs) have become a cornerstone of Long-term Time Series Forecasting (LTSF). However, recent progress has been hampered by an overemphasis on architectural complexity at the expense of fundamental forecasting structures.…

Machine Learning · Computer Science 2026-05-15 Yihang Lu , Xianwei Meng , Enhong Chen

Recurrent neural networks have achieved great success in many NLP tasks. However, they have difficulty in parallelization because of the recurrent structure, so it takes much time to train RNNs. In this paper, we introduce sliced recurrent…

Computation and Language · Computer Science 2018-07-09 Zeping Yu , Gongshen Liu

Wind power forecasting helps with the planning for the power systems by contributing to having a higher level of certainty in decision-making. Due to the randomness inherent to meteorological events (e.g., wind speeds), making highly…

Machine Learning · Computer Science 2023-01-04 Syed Kazmi , Berk Gorgulu , Mucahit Cevik , Mustafa Gokce Baydogan

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

Machine Learning · Computer Science 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De

Optimal decision-making in social settings is often based on forecasts from time series (TS) data. Recently, several approaches using deep neural networks (DNNs) such as recurrent neural networks (RNNs) have been introduced for TS…

Machine Learning · Computer Science 2020-11-17 Philippe Chatigny , Jean-Marc Patenaude , Shengrui Wang

The stable periodic patterns present in time series data serve as the foundation for conducting long-horizon forecasts. In this paper, we pioneer the exploration of explicitly modeling this periodicity to enhance the performance of models…

Machine Learning · Computer Science 2024-10-16 Shengsheng Lin , Weiwei Lin , Xinyi Hu , Wentai Wu , Ruichao Mo , Haocheng Zhong

Recurrent Neural Networks (RNNs) have become the state-of-the-art choice for extracting patterns from temporal sequences. However, current RNN models are ill-suited to process irregularly sampled data triggered by events generated in…

Machine Learning · Computer Science 2016-11-01 Daniel Neil , Michael Pfeiffer , Shih-Chii Liu

Long-term Time Series Forecasting (LTSF) is critical for numerous real-world applications, such as electricity consumption planning, financial forecasting, and disease propagation analysis. LTSF requires capturing long-range dependencies…

Machine Learning · Computer Science 2024-10-04 Aitian Ma , Dongsheng Luo , Mo Sha

Long short-term memory (LSTM) and recurrent neural network (RNN) has achieved great successes on time-series prediction. In this paper, a methodology of using LSTM-based deep-RNN for two-phase flow regime prediction is proposed, motivated…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Zhuoran Dang , Mamoru Ishii

Accurate short-term energy consumption forecasting is essential for efficient power grid management, resource allocation, and market stability. Traditional time-series models often fail to capture the complex, non-linear dependencies and…

Computers and Society · Computer Science 2026-01-27 Abhishek Maity , Viraj Tukarul

Long-term time series forecasting (LTSF) offers broad utility in practical settings like energy consumption and weather prediction. Accurately predicting long-term changes, however, is demanding due to the intricate temporal patterns and…

Machine Learning · Computer Science 2025-05-19 Boshi Gao , Qingjian Ni , Fanbo Ju , Yu Chen , Ziqi Zhao

Short-term load forecasting (STLF) is challenging due to complex time series (TS) which express three seasonal patterns and a nonlinear trend. This paper proposes a novel hybrid hierarchical deep learning model that deals with multiple…

Machine Learning · Computer Science 2021-12-07 Slawek Smyl , Grzegorz Dudek , Paweł Pełka

This is part III of three-part work. In parts I and II, we have presented eight variants for simplified Long Short Term Memory (LSTM) recurrent neural networks (RNNs). It is noted that fast computation, specially in constrained computing…

Neural and Evolutionary Computing · Computer Science 2017-07-18 Atra Akandeh , Fathi M. Salem

We describe recurrent neural networks (RNNs), which have attracted great attention on sequential tasks, such as handwriting recognition, speech recognition and image to text. However, compared to general feedforward neural networks, RNNs…

Machine Learning · Computer Science 2018-01-16 Gang Chen

Forecasting high-dimensional spatiotemporal systems remains computationally challenging for recurrent neural networks (RNNs) and long short-term memory (LSTM) models due to gradient-based training and memory bottlenecks. Reservoir Computing…

Machine Learning · Computer Science 2026-01-05 Ata Akbari Asanjan , Filip Wudarski , Daniel O'Connor , Shaun Geaney , Elena Strbac , P. Aaron Lott , Davide Venturelli

Recurrent Neural Networks (RNNs) have become an integral part of modeling and forecasting frameworks in areas like natural language processing and high-dimensional dynamical systems such as turbulent fluid flows. To improve the accuracy of…

Machine Learning · Computer Science 2023-02-23 Pantelis R. Vlachas , Petros Koumoutsakos

Making accurate motion prediction of surrounding agents such as pedestrians and vehicles is a critical task when robots are trying to perform autonomous navigation tasks. Recent research on multi-modal trajectory prediction, including…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 YingQiao Wang

The advantage of recurrent neural networks (RNNs) in learning dependencies between time-series data has distinguished RNNs from other deep learning models. Recently, many advances are proposed in this emerging field. However, there is a…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Hojjat Salehinejad

Many real-world ubiquitous applications, such as parking recommendations and air pollution monitoring, benefit significantly from accurate long-term spatio-temporal forecasting (LSTF). LSTF makes use of long-term dependency between spatial…

Machine Learning · Computer Science 2022-09-02 Wei Shao , Zhiling Jin , Shuo Wang , Yufan Kang , Xiao Xiao , Hamid Menouar , Zhaofeng Zhang , Junshan Zhang , Flora Salim

Recurrent neural networks (RNNs) have been extraordinarily successful for prediction with sequential data. To tackle highly variable and noisy real-world data, we introduce Particle Filter Recurrent Neural Networks (PF-RNNs), a new RNN…

Machine Learning · Computer Science 2019-12-03 Xiao Ma , Peter Karkus , David Hsu , Wee Sun Lee