English
Related papers

Related papers: Causal Influences Decouple From Their Underlying N…

200 papers

Echo state networks (ESNs) are a class of recurrent neural networks in which only the readout layer is trainable, while the recurrent and input layers are fixed. This architectural constraint enables computationally efficient processing of…

Machine Learning · Computer Science 2025-07-31 Taiki Yamada , Yuichi Katori , Kantaro Fujiwara

In recent years, more and more researchers in the field of neural networks are interested in creating hardware implementations where neurons and the connection between them are realized physically. The physical implementation of ANN…

Neural and Evolutionary Computing · Computer Science 2023-07-24 V. M. Moskvitin , N. Semenova

Identifying causal relationships among distinct brain areas, known as effective connectivity, holds key insights into the brain's information processing and cognitive functions. Electroencephalogram (EEG) signals exhibit intricate dynamics…

Signal Processing · Electrical Eng. & Systems 2023-07-20 Peizhen Yang , Xinke Shen , Zongsheng Li , Zixiang Luo , Kexin Lou , Quanying Liu

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tasks. To understand the success and limitations of RNNs, it is…

Information Theory · Computer Science 2017-01-30 Adam Charles , Dong Yin , Christopher Rozell

The study of deep recurrent neural networks (RNNs) and, in particular, of deep Reservoir Computing (RC) is gaining an increasing research attention in the neural networks community. The recently introduced Deep Echo State Network (DeepESN)…

Machine Learning · Computer Science 2020-09-28 Claudio Gallicchio , Alessio Micheli

The goal of this paper is to investigate the theoretical properties, the training algorithm, and the predictive control applications of Echo State Networks (ESNs), a particular kind of Recurrent Neural Networks. First, a condition…

Systems and Control · Computer Science 2019-02-06 Luca Bugliari Armenio , Enrico Terzi , Marcello Farina , Riccardo Scattolini

Many natural and physical processes can be understood by analyzing multiple system variables evolving, forming a multivariate time series. Predicting such time series is challenging due to the inherent noise and interdependencies among…

Chaotic Dynamics · Physics 2025-12-11 S. Hariharan , R. Suresh , V. K. Chandrasekar

The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo state network (ESN) is a class of recurrent neural networks…

Machine Learning · Computer Science 2025-03-04 Abdullah M. Zyarah , Alaa M. Abdul-Hadi , Dhireesha Kudithipudi

Echo-State Networks (ESNs) distil a key neurobiological insight: richly recurrent but fixed circuitry combined with adaptive linear read-outs can transform temporal streams with remarkable efficiency. Yet fundamental questions about…

Neural and Evolutionary Computing · Computer Science 2025-07-25 Pradeep Singh , Lavanya Sankaranarayanan , Balasubramanian Raman

Dynamic effective connectivity networks (dECNs) reveal the changing directed brain activity and the dynamic causal influences among brain regions, which facilitate the identification of individual differences and enhance the understanding…

Machine Learning · Computer Science 2025-02-03 Faming Xu , Yiding Wang , Chen Qiao , Gang Qu , Vince D. Calhoun , Julia M. Stephen , Tony W. Wilson , Yu-Ping Wang

Inspired by recent theoretical arguments, physics-informed echo state network (ESN) is discussed on the attempt to train a reservoir model absolutely in physics-informed manner. As the plainest work on such a purpose, an ODE (ordinary…

Machine Learning · Computer Science 2020-11-16 Dong Keun Oh

Claiming causal inferences in network settings necessitates careful consideration of the often complex dependency between outcomes for actors. Of particular importance are treatment spillover or outcome interference effects. We consider…

Methodology · Statistics 2022-07-18 Duncan A. Clark , Mark S. Handcock

This article introduces a robust hybrid method for solving supervised learning tasks, which uses the Echo State Network (ESN) model and the Particle Swarm Optimization (PSO) algorithm. An ESN is a Recurrent Neural Network with the…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Sebastián Basterrech , Enrique Alba , Václav Snášel

Echo State Networks (ESN) are a class of Recurrent Neural Networks (RNN) that has gained substantial popularity due to their effectiveness, ease of use and potential for compact hardware implementation. An ESN contains the three network…

Machine Learning · Computer Science 2018-07-26 Luca Carcano , Emanuele Plebani , Danilo Pietro Pau , Marco Piastra

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

In reservoir computing, an input sequence is processed by a recurrent neural network, the reservoir, which transforms it into a spatial pattern that a shallow readout network can then exploit for tasks such as memorization and time-series…

Neural and Evolutionary Computing · Computer Science 2025-12-30 Denis Kleyko , Christopher J. Kymn , E. Paxon Frady , Amy Loutfi , Friedrich T. Sommer

A recurrent neural network (RNN) possesses the echo state property (ESP) if, for a given input sequence, it ``forgets'' any internal states of the driven (nonautonomous) system and asymptotically follows a unique, possibly complex…

Dynamical Systems · Mathematics 2020-06-26 Andrea Ceni , Peter Ashwin , Lorenzo Livi , Claire Postlethwaite

At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences? While deep learning has brought notable progress,…

Machine Learning · Computer Science 2025-11-18 Hongbo Liu , Jia Xu

Deep Neural Networks (DNNs) are often examined at the level of their response to input, such as analyzing the mutual information between nodes and data sets. Yet DNNs can also be examined at the level of causation, exploring "what does…

Machine Learning · Computer Science 2020-10-28 Simon Mattsson , Eric J. Michaud , Erik Hoel

The prefrontal cortex is known to be involved in many high-level cognitive functions, in particular, working memory. Here, we study to what extent a group of randomly connected units (namely an Echo State Network, ESN) can store and…

Neurons and Cognition · Quantitative Biology 2018-06-19 Anthony Strock , Nicolas Rougier , Xavier Hinaut