English
Related papers

Related papers: Role of assortativity in predicting burst synchron…

200 papers

Aero-engine fault prediction aims to accurately predict the development trend of the future state of aero-engines, so as to diagnose faults in advance. Traditional aero-engine parameter prediction methods mainly use the nonlinear mapping…

Machine Learning · Computer Science 2024-06-21 Mo-Ran Liu , Tao Sun , Xi-Ming Sun

We investigate the effect of network architecture on burst and spike synchronization in a directed scale-free network (SFN) of bursting neurons, evolved via two independent $\alpha-$ and $\beta-$processes. The $\alpha-$process corresponds…

Neurons and Cognition · Quantitative Biology 2015-10-05 Sang-Yoon Kim , Woochang Lim

We present a rigorous asymptotic analysis of Echo State Networks (ESNs) in a teacher student setting with a linear teacher with oracle weights. Leveraging random matrix theory, we derive closed form expressions for the asymptotic bias,…

Machine Learning · Statistics 2025-09-29 Yessin Moakher , Malik Tiomoko , Cosme Louart , Zhenyu Liao

We report an improvement to the conventional Echo State Network (ESN) across three benchmark chaotic time-series prediction tasks using fruit fly connectome data alone. We also investigate the impact of key connectome-derived structural…

Machine Learning · Computer Science 2023-02-13 Jacob Morra , Mark Daley

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

Spatio-temporal area-level datasets play a critical role in official statistics, providing valuable insights for policy-making and regional planning. Accurate modeling and forecasting of these datasets can be extremely useful for…

Machine Learning · Computer Science 2026-01-06 Zhenhua Wang , Scott H. Holan , Christopher K. Wikle

Despite the superiority of convolutional neural networks demonstrated in time series modeling and forecasting, it has not been fully explored on the design of the neural network architecture and the tuning of the hyper-parameters. Inspired…

Machine Learning · Computer Science 2022-02-14 Xinze Zhang , Kun He , Yukun Bao

By employing a recently introduced optimization algorithm we explicitely design optimally synchronizable (unweighted) networks for any given scale-free degree distribution. We explore how the optimization process affects degree-degree…

Disordered Systems and Neural Networks · Physics 2009-11-13 Luca Donetti , Pablo I. Hurtado , Miguel A. Munoz

Inspired by recent theoretical arguments, physics-informed echo state network (ESN) is discussed on the attempt to train a reservoir model absolutely in physics-informed manner. As the plainest work on such a purpose, an ODE (ordinary…

Machine Learning · Computer Science 2020-11-16 Dong Keun Oh

Echo state networks are computationally lightweight reservoir models inspired by the random projections observed in cortical circuitry. As interest in reservoir computing has grown, networks have become deeper and more intricate. While…

Signal Processing · Electrical Eng. & Systems 2019-08-23 Zachariah Carmichael , Humza Syed , Dhireesha Kudithipudi

We propose that negative degree correlation among nodes in a network of nonlinear oscillators, often detected in real world networks, is motivated by its positive effects on synchronizability. In so doing, we use a novel methodology to…

Disordered Systems and Neural Networks · Physics 2007-12-08 Mario di Bernardo , Franco Garofalo , Francesco Sorrentino

Recurrent Neural Networks (RNNs) have demonstrated their outstanding ability in sequence tasks and have achieved state-of-the-art in wide range of applications, such as industrial, medical, economic and linguistic. Echo State Network (ESN)…

Machine Learning · Computer Science 2020-12-08 Chenxi Sun , Moxian Song , Shenda Hong , Hongyan Li

We propose automatic speech recognition (ASR) models inspired by echo state network (ESN), in which a subset of recurrent neural networks (RNN) layers in the models are randomly initialized and untrained. Our study focuses on RNN-T and…

Computation and Language · Computer Science 2021-02-19 Harsh Shrivastava , Ankush Garg , Yuan Cao , Yu Zhang , Tara Sainath

Echo State Networks (ESN) are versatile recurrent neural network models in which the hidden layer remains unaltered during training. Interactions among nodes of this static backbone produce diverse representations of the given stimuli that…

Machine Learning · Computer Science 2022-05-25 Kayson Fakhar , Fatemeh Hadaeghi , Claus C. Hilgetag

Data are often sampled irregularly in time. Dealing with this using Recurrent Neural Networks (RNNs) traditionally involved ignoring the fact, feeding the time differences as additional inputs, or resampling the data. All these methods have…

Machine Learning · Computer Science 2024-07-03 Mantas Lukoševičius , Arnas Uselis

The highly irregular spiking activity of cortical neurons and behavioral variability suggest that the brain could operate in a fundamentally probabilistic way. Mimicking how the brain implements and learns probabilistic computation could be…

Neural and Evolutionary Computing · Computer Science 2024-04-23 Yang Qi , Zhichao Zhu , Yiming Wei , Lu Cao , Zhigang Wang , Jie Zhang , Wenlian Lu , Jianfeng Feng

Spiking neural networks (SNNs) are receiving increased attention because they mimic synaptic connections in biological systems and produce spike trains, which can be approximated by binary values for computational efficiency. Recently, the…

Neural and Evolutionary Computing · Computer Science 2024-03-26 Nathan Lutes , Venkata Sriram Siddhardh Nadendla , K. Krishnamurthy

We propose an approximation of Echo State Networks (ESN) that can be efficiently implemented on digital hardware based on the mathematics of hyperdimensional computing. The reservoir of the proposed integer Echo State Network (intESN) is a…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Denis Kleyko , E. Paxon Frady , Mansour Kheffache , Evgeny Osipov

Mixing patterns in large self-organizing networks, such as the Internet, the World Wide Web, social and biological networks are often characterized by degree-degree dependencies between neighbouring nodes. In this paper we propose a new way…

Physics and Society · Physics 2015-06-04 Nelly Litvak , Remco van der Hofstad

We investigate the ability of an ensemble reservoir computing approach to predict the long-term behaviour of the phase-space region in which the motion of charged particles in hadron storage rings is bounded, the so-called dynamic aperture.…

Accelerator Physics · Physics 2023-01-18 Maxime Casanova , Barbara Dalena , Luca Bonaventura , Massimo Giovannozzi