中文
相关论文

相关论文: Recursive Least Squares Policy Control with Echo S…

200 篇论文

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

统计力学 · 物理学 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

This paper explores the problem of training a recurrent neural network from noisy data. While neural network based dynamic predictors perform well with noise-free training data, prediction with noisy inputs during training phase poses a…

系统与控制 · 电气工程与系统科学 2023-04-04 Debdipta Goswami

This paper investigates the performance of Echo State Networks (ESNs) for univariate time series forecasting using a subset of the M4 Forecasting Competition dataset. Focusing on monthly and quarterly time series, we evaluate whether a…

机器学习 · 计算机科学 2026-04-08 Alexander Häußer

Echo state networks (ESNs) are a class of recurrent neural networks in which only the readout layer is trainable, while the recurrent and input layers are fixed. This architectural constraint enables computationally efficient processing of…

机器学习 · 计算机科学 2025-07-31 Taiki Yamada , Yuichi Katori , Kantaro Fujiwara

Extremum seeking (ES) optimization approach has been very popular due to its non-model based analysis and implementation. This approach has been mostly used with gradient based search algorithms. Since least squares (LS) algorithms are…

系统与控制 · 电气工程与系统科学 2020-03-10 Nursefa Zengin , Baris Fidan

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tasks. To understand the success and limitations of RNNs, it is…

信息论 · 计算机科学 2017-01-30 Adam Charles , Dong Yin , Christopher Rozell

Echo State Networks (ESNs) are recurrent neural networks that only train their output layer, thereby precluding the need to backpropagate gradients through time, which leads to significant computational gains. Nevertheless, a common issue…

神经与进化计算 · 计算机科学 2019-03-13 Jacob Reinier Maat , Nikos Gianniotis , Pavlos Protopapas

The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo state network (ESN) is a class of recurrent neural networks…

机器学习 · 计算机科学 2025-03-04 Abdullah M. Zyarah , Alaa M. Abdul-Hadi , Dhireesha Kudithipudi

Echo state network (ESN), a kind of recurrent neural networks, consists of a fixed reservoir in which neurons are connected randomly and recursively and obtains the desired output only by training output connection weights. First-order…

机器学习 · 计算机科学 2024-01-22 Yansong Li , Kai Hu , Kohei Nakajima , Yongping Pan

Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of…

机器学习 · 计算机科学 2022-05-11 Peter Steiner , Azarakhsh Jalalvand , Peter Birkholz

Echo State Networks (ESNs) are a particular type of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) framework, popular for their fast and efficient learning. However, traditional ESNs often struggle with…

机器学习 · 计算机科学 2026-01-30 Matteo Pinna , Andrea Ceni , Claudio Gallicchio

We propose automatic speech recognition (ASR) models inspired by echo state network (ESN), in which a subset of recurrent neural networks (RNN) layers in the models are randomly initialized and untrained. Our study focuses on RNN-T and…

计算与语言 · 计算机科学 2021-02-19 Harsh Shrivastava , Ankush Garg , Yuan Cao , Yu Zhang , Tara Sainath

The Echo State Network (ESN) is a class of Recurrent Neural Network with a large number of hidden-hidden weights (in the so-called reservoir). Canonical ESN and its variations have recently received significant attention due to their…

神经与进化计算 · 计算机科学 2022-09-30 Sebastian Basterrech , Gerardo Rubino

Echo State Networks (ESNs) are a special type of the temporally deep network model, the Recurrent Neural Network (RNN), where the recurrent matrix is carefully designed and both the recurrent and input matrices are fixed. An ESN uses the…

机器学习 · 计算机科学 2013-11-14 Hamid Palangi , Li Deng , Rabab K Ward

Inspired by recent theoretical arguments, physics-informed echo state network (ESN) is discussed on the attempt to train a reservoir model absolutely in physics-informed manner. As the plainest work on such a purpose, an ODE (ordinary…

机器学习 · 计算机科学 2020-11-16 Dong Keun Oh

Data are often sampled irregularly in time. Dealing with this using Recurrent Neural Networks (RNNs) traditionally involved ignoring the fact, feeding the time differences as additional inputs, or resampling the data. All these methods have…

机器学习 · 计算机科学 2024-07-03 Mantas Lukoševičius , Arnas Uselis

Recursive least squares (RLS) algorithms were once widely used for training small-scale neural networks, due to their fast convergence. However, previous RLS algorithms are unsuitable for training deep neural networks (DNNs), since they…

机器学习 · 计算机科学 2021-09-08 Chunyuan Zhang , Qi Song , Hui Zhou , Yigui Ou , Hongyao Deng , Laurence Tianruo Yang

A method is provided for designing and training noise-driven recurrent neural networks as models of stochastic processes. The method unifies and generalizes two known separate modeling approaches, Echo State Networks (ESN) and Linear…

适应与自组织系统 · 物理学 2014-04-14 Mathieu N. Galtier , Camille Marini , Gilles Wainrib , Herbert Jaeger

Convolutional neural networks (CNNs) have succeeded in many practical applications. However, their high computation and storage requirements often make them difficult to deploy on resource-constrained devices. In order to tackle this issue,…

机器学习 · 计算机科学 2022-01-14 Tianzong Yu , Chunyuan Zhang , Yuan Wang , Meng Ma , Qi Song

An approach to the time-accurate prediction of chaotic solutions is by learning temporal patterns from data. Echo State Networks (ESNs), which are a class of Reservoir Computing, can accurately predict the chaotic dynamics well beyond the…

机器学习 · 计算机科学 2021-03-16 Alberto Racca , Luca Magri