English
Related papers

Related papers: On Dominant Manifolds in Reservoir Computing Netwo…

200 papers

This paper focuses on the construction of accurate and predictive data-driven reduced models of large-scale numerical simulations with complex dynamics and sparse training datasets. In these settings, standard, single-domain approaches may…

Numerical Analysis · Mathematics 2024-09-26 Ionut-Gabriel Farcas , Rayomand P. Gundevia , Ramakanth Munipalli , Karen E. Willcox

Recently, reinforcement learning models have achieved great success, completing complex tasks such as mastering Go and other games with higher scores than human players. Many of these models collect considerable data on the tasks and…

Machine Learning · Computer Science 2019-07-19 Hanten Chang , Katsuya Futagami

Classification of multivariate time series (MTS) has been tackled with a large variety of methodologies and applied to a wide range of scenarios. Reservoir Computing (RC) provides efficient tools to generate a vectorial, fixed-size…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Filippo Maria Bianchi , Simone Scardapane , Sigurd Løkse , Robert Jenssen

Determining hidden shared patterns behind dynamic phenomena can be a game-changer in multiple areas of research. Here we present the principles and show a method to identify hidden shared dynamics from time series by a two-module,…

Neural and Evolutionary Computing · Computer Science 2024-12-04 Zsigmond Benkő , Zoltán Somogyvári

Ability of deep networks to extract high level features and of recurrent networks to perform time-series inference have been studied. In view of universality of one hidden layer network at approximating functions under weak constraints, the…

Neural and Evolutionary Computing · Computer Science 2014-12-19 Sharat C. Prasad , Piyush Prasad

Reservoir Computing is a relatively new framework created to allow the usage of powerful but complex systems as computational mediums. The basic approach consists in training only a readout layer, exploiting the innate separation and…

Robotics · Computer Science 2022-06-23 Paolo Baldini

We study the dynamics of discrete-time regulatory networks on random digraphs. For this we define ensembles of deterministic orbits of random regulatory networks, and introduce some statistical indicators related to the long-term dynamics…

Dynamical Systems · Mathematics 2009-11-13 Anne Cros , Antonio Morante , Edgardo Ugalde

Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during…

Machine Learning · Computer Science 2023-06-13 Peter DelMastro , Rushiv Arora , Edward Rietman , Hava T. Siegelmann

Reservoir computing derived from recurrent neural networks is more applicable to real world systems than deep learning because of its low computational cost and potential for physical implementation. Specifically, physical reservoir…

Emerging Technologies · Computer Science 2019-12-03 Hiroyasu Ando , Hanten Chang

An emerging paradigm proposes that neural computations can be understood at the level of dynamical systems that govern low-dimensional trajectories of collective neural activity. How the connectivity structure of a network determines the…

Neurons and Cognition · Quantitative Biology 2021-05-28 Manuel Beiran , Alexis Dubreuil , Adrian Valente , Francesca Mastrogiuseppe , Srdjan Ostojic

The extension of deep learning towards temporal data processing is gaining an increasing research interest. In this paper we investigate the properties of state dynamics developed in successive levels of deep recurrent neural networks…

Machine Learning · Computer Science 2018-02-05 Claudio Gallicchio

The prediction of complex dynamics remains an open problem across many domains of physics, where nonlinearities and multiscale interactions severely limit the reliability of conventional forecasting methods. Quantum reservoir computing…

We show that connectivity within the high-dimensional recurrent layer of a reservoir network is crucial for its performance. To this end, we systematically investigate the impact of network connectivity on its performance, i.e., we examine…

Neural and Evolutionary Computing · Computer Science 2025-12-01 Shailendra K. Rathor , Martin Ziegler , Jörg Schumacher

Any model order reduced dynamical system that evolves a modal decomposition to approximate the discretized solution of a stochastic PDE can be related to a vector field tangent to the manifold of fixed rank matrices. The Dynamically…

Dynamical Systems · Mathematics 2018-04-04 Florian Feppon , Pierre F. J. Lermusiaux

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

This study presents a novel representation learning model tailored for dynamic networks, which describes the continuously evolving relationships among individuals within a population. The problem is encapsulated in the dimension reduction…

Machine Learning · Statistics 2024-12-17 Haixu Wang , Jiguo Cao , Jian Pei

Training reinforcement learning (RL) agents to control fluid dynamics systems is computationally expensive due to the high cost of direct numerical simulations (DNS) of the governing equations. Surrogate models offer a promising alternative…

Machine Learning · Computer Science 2026-03-31 Tim Plotzki , Sebastian Peitz

The simulation of turbulent flow requires many degrees of freedom to resolve all the relevant times and length scales. However, due to the dissipative nature of the Navier-Stokes equations, the long-term dynamics are expected to lie on a…

Fluid Dynamics · Physics 2025-10-15 C. Ricardo Constante-Amores , Alec J. Linot , Michael D. Graham

We present a simple and scalable implementation of next-generation reservoir computing (NGRC) for modeling dynamical systems from time-series data. The method uses a pseudorandom nonlinear projection of time-delay embedded inputs, allowing…

Machine Learning · Statistics 2026-01-12 Rok Cestnik , Erik A. Martens

Animals often demonstrate a remarkable ability to adapt to their environments during their lifetime. They do so partly due to the evolution of morphological and neural structures. These structures capture features of environments shared…

Machine Learning · Computer Science 2024-01-30 Corentin Léger , Gautier Hamon , Eleni Nisioti , Xavier Hinaut , Clément Moulin-Frier