English
Related papers

Related papers: Beyond Lipschitz Continuity and Monotonicity: Frac…

200 papers

Echo-State Networks (ESNs) distil a key neurobiological insight: richly recurrent but fixed circuitry combined with adaptive linear read-outs can transform temporal streams with remarkable efficiency. Yet fundamental questions about…

Neural and Evolutionary Computing · Computer Science 2025-07-25 Pradeep Singh , Lavanya Sankaranarayanan , Balasubramanian Raman

The echo state property (ESP) represents a fundamental concept in the reservoir computing (RC) framework that ensures output-only training of reservoir networks by being agnostic to the initial states and far past inputs. However, the…

Quantum Physics · Physics 2024-09-04 Shumpei Kobayashi , Quoc Hoan Tran , Kohei Nakajima

Reservoir Computing (RC) provides an efficient way for designing dynamical recurrent neural models. While training is restricted to a simple output component, the recurrent connections are left untrained after initialization, subject to…

Neural and Evolutionary Computing · Computer Science 2019-09-25 Claudio Gallicchio

Echo state property (ESP) is a fundamental property that allows an input-driven dynamical system to perform information processing tasks. Recently, extensions of ESP to potentially nonstationary systems and subsystems, that is,…

Quantum Physics · Physics 2024-09-24 Shumpei Kobayashi , Quoc Hoan Tran , Kohei Nakajima

Much effort has been devoted in the last two decades to characterize the situations in which a reservoir computing system exhibits the so-called echo state (ESP) and fading memory (FMP) properties. These important features amount, in…

Neural and Evolutionary Computing · Computer Science 2019-03-25 Lyudmila Grigoryeva , Juan-Pablo Ortega

The Echo State Network (ESN) is a specific recurrent network, which has gained popularity during the last years. The model has a recurrent network named reservoir, that is fixed during the learning process. The reservoir is used for…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Sebastián Basterrech

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

Physical computing exploits unconventional physical substrates to overcome limitations such as the high energy consumption inherent in digital computation. However, intrinsic noise and temporal fluctuations (e.g., oscillations) generally…

Dynamical Systems · Mathematics 2026-01-30 Yuma Nakamura , Tomoyuki Kubota , Yusuke Imai , Sumito Tsunegi , Hirofumi Notsu , Kohei Nakajima

Echo State Networks (ESNs) are typically presented as efficient, readout-trained recurrent models, yet their dynamics and design are often guided by heuristics rather than first principles. We recast ESNs explicitly as state-space models…

Machine Learning · Computer Science 2025-09-05 Pradeep Singh , Balasubramanian Raman

Reservoir Computing is a class of Recurrent Neural Networks with internal weights fixed at random. Stability relates to the sensitivity of the network state to perturbations. It is an important property in Reservoir Computing as it directly…

Neural and Evolutionary Computing · Computer Science 2022-06-09 Jonathan Dong , Erik Börve , Mushegh Rafayelyan , Michael Unser

This work advances the theoretical foundations of reservoir computing (RC) by providing a unified treatment of fading memory and the echo state property (ESP) in both deterministic and stochastic settings. We investigate state-space…

Machine Learning · Statistics 2026-05-15 Juan-Pablo Ortega , Florian Rossmannek

A recurrent neural network (RNN) possesses the echo state property (ESP) if, for a given input sequence, it ``forgets'' any internal states of the driven (nonautonomous) system and asymptotically follows a unique, possibly complex…

Dynamical Systems · Mathematics 2020-06-26 Andrea Ceni , Peter Ashwin , Lorenzo Livi , Claire Postlethwaite

The Lipschitz constant is a key measure for certifying the robustness of neural networks to input perturbations. However, computing the exact constant is NP-hard, and standard approaches to estimate the Lipschitz constant involve solving a…

Machine Learning · Computer Science 2026-04-14 Yuezhu Xu , S. Sivaranjani

Reservoir computing is a form of machine learning that utilizes nonlinear dynamical systems to perform complex tasks in a cost-effective manner when compared to typical neural networks. Many recent advancements in reservoir computing, in…

Machine Learning · Computer Science 2025-04-03 Peter J. Ehlers , Hendra I. Nurdin , Daniel Soh

A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained. In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and…

Dynamical Systems · Mathematics 2021-12-28 Allen G Hart

The Lipschitz constant of a neural network is connected to several important properties of the network such as its robustness and generalization. It is thus useful in many settings to estimate the Lipschitz constant of a model. Prior work…

Machine Learning · Computer Science 2026-03-02 Giannis Nikolentzos , Konstantinos Skianis

Spiking reservoir computing provides an energy-efficient approach to temporal processing, but reliably tuning reservoirs to operate at the edge-of-chaos is challenging due to experimental uncertainty. This work bridges abstract notions of…

Machine Learning · Computer Science 2026-04-09 Ruggero Freddi , Nicolas Seseri , Diana Nigrisoli , Alessio Basti

Synchronous oscillations of neuronal populations support resting-state cortical activity. Recent studies indicate that resting-state functional connectivity is not static, but exhibits complex dynamics. The mechanisms underlying the complex…

Neurons and Cognition · Quantitative Biology 2020-07-31 Steve Mehrkanoon

Reservoir computing (RC) represents a class of state-space models (SSMs) characterized by a fixed state transition mechanism (the reservoir) and a flexible readout layer that maps from the state space. It is a paradigm of computational…

Machine Learning · Computer Science 2025-04-17 Pradeep Singh , Ashutosh Kumar , Sutirtha Ghosh , Hrishit B P , Balasubramanian Raman

Physical reservoir computing is a framework for brain-inspired information processing that utilizes nonlinear and high-dimensional dynamics in non-von-Neumann systems. In recent years, spintronic devices have been proposed for use as…

Mesoscale and Nanoscale Physics · Physics 2023-10-11 Kaito Kobayashi , Yukitoshi Motome
‹ Prev 1 2 3 10 Next ›