English
Related papers

Related papers: Euler State Networks: Non-dissipative Reservoir Co…

200 papers

Reservoir computers (RC) are a form of recurrent neural network (RNN) used for forecasting timeseries data. As with all RNNs, selecting the hyperparameters presents a challenge when training onnew inputs. We present a method based on…

Computational Physics · Physics 2022-01-05 Jason A. Platt , Adrian S. Wong , Randall Clark , Stephen G. Penny , Henry D. I. Abarbanel

The design of recurrent neural networks (RNNs) to accurately process sequential inputs with long-time dependencies is very challenging on account of the exploding and vanishing gradient problem. To overcome this, we propose a novel RNN…

Machine Learning · Computer Science 2021-08-19 T. Konstantin Rusch , Siddhartha Mishra

In this paper, we elaborate over the well-known interpretability issue in echo state networks. The idea is to investigate the dynamics of reservoir neurons with time-series analysis techniques taken from research on complex systems.…

Data Analysis, Statistics and Probability · Physics 2016-11-21 Filippo Maria Bianchi , Lorenzo Livi , Cesare Alippi

Reservoir computing is a recent trend in neural networks which uses the dynamical perturbations on the phase space of a system to compute a desired target function. We present how one can formulate an expectation of system performance in a…

Neural and Evolutionary Computing · Computer Science 2014-09-02 Alireza Goudarzi , Darko Stefanovic

An iterated multistep forecasting scheme based on recurrent neural networks (RNN) is proposed for the time series generated by causal chains with infinite memory. This forecasting strategy contains, as a particular case, the iterative…

Dynamical Systems · Mathematics 2025-03-21 Lyudmila Grigoryeva , James Louw , Juan-Pablo Ortega

Reservoir computing (RC), first applied to temporal signal processing, is a recurrent neural network in which neurons are randomly connected. Once initialized, the connection strengths remain unchanged. Such a simple structure turns RC into…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Heng Zhang , Danilo Vasconcellos Vargas

The Reservoir Computing (RC) paradigm utilizes a dynamical system, i.e., a reservoir, and a linear classifier, i.e., a read-out layer, to process data from sequential classification tasks. In this paper the usage of Cellular Automata (CA)…

Emerging Technologies · Computer Science 2017-02-14 Stefano Nichele , Magnus S. Gundersen

This work presents the design of nonlinear stabilization techniques for the finite element discretization of Euler equations in both steady and transient form. Implicit time integration is used in the case of the transient form. A…

Numerical Analysis · Mathematics 2020-08-26 Santiago Badia , Jesús Bonilla , Sibusiso Mabuza , John N. Shadid

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep…

Machine Learning · Statistics 2021-02-18 Jonathan Dong , Ruben Ohana , Mushegh Rafayelyan , Florent Krzakala

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

Statistical Mechanics · Physics 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

Macroeconomic forecasting has recently started embracing techniques that can deal with large-scale datasets and series with unequal release periods. MIxed-DAta Sampling (MIDAS) and Dynamic Factor Models (DFM) are the two main…

Euler's elastica is a classical model of flexible slender structures, relevant in many industrial applications. Static equilibrium equations can be derived via a variational principle. The accurate approximation of solutions of this problem…

Reservoir Computing (RC) is a well-known strategy for designing Recurrent Neural Networks featured by striking efficiency of training. The crucial aspect of RC is to properly instantiate the hidden recurrent layer that serves as dynamical…

Machine Learning · Computer Science 2020-06-05 Claudio Gallicchio

Reservoir Computing has found many potential applications in the field of complex dynamics. In this article, we exploit the exceptional capability of the echo-state network (ESN) model to make it learn a unidirectional coupling scheme from…

Machine Learning · Computer Science 2023-06-21 Swarnendu Mandal , Manish Dev Shrimali

Recent developments in quantum computing and machine learning have propelled the interdisciplinary study of quantum machine learning. Sequential modeling is an important task with high scientific and commercial value. Existing VQC or…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Samuel Yen-Chi Chen , Daniel Fry , Amol Deshmukh , Vladimir Rastunkov , Charlee Stefanski

Reservoir Computing (RC) provides an efficient way for designing dynamical recurrent neural models. While training is restricted to a simple output component, the recurrent connections are left untrained after initialization, subject to…

Neural and Evolutionary Computing · Computer Science 2019-09-25 Claudio Gallicchio

Deep neural networks have achieved state-of-the-art performance in a variety of fields. Recent works observe that a class of widely used neural networks can be viewed as the Euler method of numerical discretization. From the numerical…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Byungjoo Kim , Bryce Chudomelka , Jinyoung Park , Jaewoo Kang , Youngjoon Hong , Hyunwoo J. Kim

In the present work, a high order finite element type residual distribution scheme is designed in the framework of multidimensional compressible Euler equations of gas dynamics. The strengths of the proposed approximation rely on the…

Numerical Analysis · Mathematics 2023-01-16 Remi Abgrall , Paola Bacigaluppi , Tokareva Svetlana

Real-time accurate solutions of large-scale complex dynamical systems are critically needed for control, optimization, uncertainty quantification, and decision-making in practical engineering and science applications, particularly in…

Machine Learning · Statistics 2024-12-06 Hai V. Nguyen , Jau-Uei Chen , Tan Bui-Thanh

Reservoir Computing (RC), a type of recurrent random neural network, is a powerful framework for modeling complex and chaotic dynamics. However, its autonomous (closed-loop) operation is often plagued by inherent instability. Moreover,…

Chaotic Dynamics · Physics 2026-02-12 Satoshi Oishi , Hiroshi Yamashita , Hideyuki Suzuki , Sho Shirasaka