English
Related papers

Related papers: Seasonal Encoder-Decoder Architecture for Forecast…

200 papers

Recurrent and convolutional neural networks are the most common architectures used for time series forecasting in deep learning literature. These networks use parameter sharing by repeating a set of fixed architectures with fixed parameters…

Machine Learning · Computer Science 2020-11-30 Joel Janek Dabrowski , YiFan Zhang , Ashfaqur Rahman

Multivariate time series are routinely encountered in real-world applications, and in many cases, these time series are strongly correlated. In this paper, we present a deep learning structural time series model which can (i) handle…

Machine Learning · Statistics 2020-01-03 Changwei Hu , Yifan Hu , Sungyong Seo

Climate models (CM) are used to evaluate the impact of climate change on the risk of floods and strong precipitation events. However, these numerical simulators have difficulties representing precipitation events accurately, mainly due to…

Computational Engineering, Finance, and Science · Computer Science 2021-02-15 Rilwan Adewoyin , Peter Dueben , Peter Watson , Yulan He , Ritabrata Dutta

In time-varying fading channels, channel coefficients are estimated using pilot symbols that are transmitted every coherence interval. For channels with high Doppler spread, the rapid channel variations over time will require considerable…

Information Theory · Computer Science 2022-03-24 Sandesh Rao Mattu , Lakshmi Narasimhan T , A. Chockalingam

Time series forecasting plays a crucial role in contemporary engineering information systems for supporting decision-making across various industries, where Recurrent Neural Networks (RNNs) have been widely adopted due to their capability…

Machine Learning · Computer Science 2026-01-14 Xin Lai , Shiming Deng , Lu Yu , Yumin Lai , Shenghao Qiao , Xinze Zhang

Recurrent neural networks (RNNs) are a vital modeling technique that rely on internal states learned indirectly by optimization of a supervised, unsupervised, or reinforcement training loss. RNNs are used to model dynamic processes that are…

Learning time-dependent partial differential equations (PDEs) that govern evolutionary observations is one of the core challenges for data-driven inference in many fields. In this work, we propose to capture the essential dynamics of…

Numerical Analysis · Mathematics 2021-09-07 Ricardo A. Delgadillo , Jingwei Hu , Haizhao Yang

Despite the recent popularity of deep generative state space models, few comparisons have been made between network architectures and the inference steps of the Bayesian filtering framework -- with most models simultaneously approximating…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Stefan Zohren , Stephen Roberts

Neural architectures such as Recurrent Neural Networks (RNNs), Transformers, and State-Space Models have shown great success in handling sequential data by learning temporal dependencies. Decision Trees (DTs), on the other hand, remain a…

Machine Learning · Computer Science 2025-02-07 Sascha Marton , Moritz Schneider

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

Deep learning has been a groundbreaking technology in various fields as well as in communications systems. In spite of the notable advancements of deep neural network (DNN) based technologies in recent years, the high computational…

Information Theory · Computer Science 2018-08-08 Minhoe Kim , Woonsup Lee , Jungmin Yoon , Ohyun Jo

In this paper, we propose a new short-term load forecasting (STLF) model based on contextually enhanced hybrid and hierarchical architecture combining exponential smoothing (ES) and a recurrent neural network (RNN). The model is composed of…

Machine Learning · Computer Science 2022-12-20 Slawek Smyl , Grzegorz Dudek , Paweł Pełka

Recurrent neural networks (RNNs) are more suitable for learning non-linear dependencies in dynamical systems from observed time series data. In practice all the external variables driving such systems are not known a priori, especially in…

Machine Learning · Computer Science 2020-06-02 Mhlasakululeka Mvubu , Emmanuel Kabuga , Christian Plitz , Bubacarr Bah , Ronnie Becker , Hans Georg Zimmermann

Numerous deep learning architectures have been developed to accommodate the diversity of time series datasets across different domains. In this article, we survey common encoder and decoder designs used in both one-step-ahead and…

Machine Learning · Statistics 2021-04-28 Bryan Lim , Stefan Zohren

Accurate electricity consumption forecasting is essential for demand management and smart grid operations. This paper introduces a unified deep learning framework that integrates cyclical temporal encoding with hybrid LSTM-CNN architectures…

Machine Learning · Computer Science 2025-12-04 Salim Khazem , Houssam Kanso

Although Recurrent Neural Network (RNN) has been a powerful tool for modeling sequential data, its performance is inadequate when processing sequences with multiple patterns. In this paper, we address this challenge by introducing a novel…

Machine Learning · Computer Science 2019-02-28 Kui Zhao , Yuechuan Li , Chi Zhang , Cheng Yang , Huan Xu

The study of deep recurrent neural networks (RNNs) and, in particular, of deep Reservoir Computing (RC) is gaining an increasing research attention in the neural networks community. The recently introduced Deep Echo State Network (DeepESN)…

Machine Learning · Computer Science 2020-09-28 Claudio Gallicchio , Alessio Micheli

Time series forecasting based on deep architectures has been gaining popularity in recent years due to their ability to model complex non-linear temporal dynamics. The recurrent neural network is one such model capable of handling…

Machine Learning · Computer Science 2021-06-28 Zexuan Yin , Paolo Barucca

Deep learning became the method of choice in recent year for solving a wide variety of predictive analytics tasks. For sequence prediction, recurrent neural networks (RNN) are often the go-to architecture for exploiting sequential…

Machine Learning · Computer Science 2016-11-09 Kin Gwn Lore , Daniel Stoecklein , Michael Davies , Baskar Ganapathysubramanian , Soumik Sarkar

Cyber-physical systems often consist of entities that interact with each other over time. Meanwhile, as part of the continued digitization of industrial processes, various sensor technologies are deployed that enable us to record…

Machine Learning · Computer Science 2018-09-03 Razvan-Gabriel Cirstea , Darius-Valer Micu , Gabriel-Marcel Muresan , Chenjuan Guo , Bin Yang