English
Related papers

Related papers: Optimal Neuron Selection: NK Echo State Networks f…

200 papers

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

Machine learning with artificial neural networks is revolutionizing science. The most advanced challenges require discovering answers autonomously. This is the domain of reinforcement learning, where control strategies are improved…

Quantum Physics · Physics 2018-10-03 Thomas Fösel , Petru Tighineanu , Talitha Weiss , Florian Marquardt

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Cristiano Capone , Paolo Muratore

p-spin glasses, characterized by frustrated many-body interactions beyond the conventional pairwise case (p>2), are prototypical disordered systems whose ground-state search is NP-hard and computationally prohibitive for large instances.…

Disordered Systems and Neural Networks · Physics 2026-02-19 Li Zeng , Mutian Shen , Tianle Pu , Zohar Nussinov , Qing Feng , Chao Chen , Zhong Liu , Changjun Fan

In this work we present a novel approach to hierarchical reinforcement learning for linearly-solvable Markov decision processes. Our approach assumes that the state space is partitioned, and the subtasks consist in moving between the…

Machine Learning · Computer Science 2024-06-04 Guillermo Infante , Anders Jonsson , Vicenç Gómez

We propose reinforcement learning on simple networks consisting of random connections of spiking neurons (both recurrent and feed-forward) that can learn complex tasks with very little trainable parameters. Such sparse and randomly…

Machine Learning · Computer Science 2019-06-06 Wachirawit Ponghiran , Gopalakrishnan Srinivasan , Kaushik Roy

We explore the use of policy gradient methods in reinforcement learning for quantum control via energy landscape shaping of XX-Heisenberg spin chains in a model agnostic fashion. Their performance is compared to finding controllers using…

Quantum Physics · Physics 2022-07-19 I. Khalid , C. A. Weidner , E. A. Jonckheere , S. G. Schirmer , F. C. Langbein

This paper formulates a stochastic optimal control problem for linear networked control systems featuring stochastic packet disordering with a unique stabilizing solution certified. The problem is solved by proposing reinforcement learning…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Wenqian Xue , Yi Jiang , Frank L. Lewis , Bosen Lian

As one of the most important paradigms of recurrent neural networks, the echo state network (ESN) has been applied to a wide range of fields, from robotics to medicine, finance, and language processing. A key feature of the ESN paradigm is…

Machine Learning · Computer Science 2020-02-26 Pau Vilimelis Aceituno , Yan Gang , Yang-Yu Liu

Many machine learning methods operate by inverting a neural network at inference time, which has become a popular technique for solving inverse problems in computer vision, robotics, and graphics. However, these methods often involve…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Chengzhi Mao , Purva Tendulkar , Hao Wang , Carl Vondrick

Serving as an essential prerequisite for modern power system operation, robust state estimation (RSE) could effectively resist noises and outliers in measurements. The emerging neural network (NN) based end-to-end (E2E) learning framework…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Yibo Ding , Wenzhuo Shi , Mengzhao Duan , Yuhong Zhao , Jiaqi Ruan , Jian Zhao , Zhao Xu

Reservoir computing, using nonlinear dynamical systems, offers a cost-effective alternative to neural networks for complex tasks involving processing of sequential data, time series modeling, and system identification. Echo state networks…

Machine Learning · Computer Science 2025-01-14 Peter J. Ehlers , Hendra I. Nurdin , Daniel Soh

Recurrent neural networks (RNNs) have recently achieved remarkable successes in a number of applications. However, the huge sizes and computational burden of these models make it difficult for their deployment on edge devices. A practically…

Machine Learning · Computer Science 2019-12-10 Liangjian Wen , Xuanyang Zhang , Haoli Bai , Zenglin Xu

End-to-end reinforcement learning agents learn a state representation and a policy at the same time. Recurrent neural networks (RNNs) have been trained successfully as reinforcement learning agents in settings like dialogue that require…

Machine Learning · Computer Science 2019-06-25 Layla El Asri , Adam Trischler

Learning to Optimize is a recently proposed framework for learning optimization algorithms using reinforcement learning. In this paper, we explore learning an optimization algorithm for training shallow neural nets. Such high-dimensional…

Machine Learning · Computer Science 2017-12-01 Ke Li , Jitendra Malik

Autonomous learning of robotic skills can allow general-purpose robots to learn wide behavioral repertoires without requiring extensive manual engineering. However, robotic skill learning methods typically make one of several trade-offs to…

Machine Learning · Computer Science 2016-10-07 William Montgomery , Anurag Ajay , Chelsea Finn , Pieter Abbeel , Sergey Levine

This article proposes a sparse computation-based method for optimizing neural networks for reinforcement learning (RL) tasks. This method combines two ideas: neural network pruning and taking into account input data correlations; it makes…

Machine Learning · Computer Science 2022-04-11 Dmitry Ivanov , Mikhail Kiselev , Denis Larionov

This paper addresses the general problem of reinforcement learning (RL) in partially observable environments. In 2013, our large RL recurrent neural networks (RNNs) learned from scratch to drive simulated cars from high-dimensional video…

Artificial Intelligence · Computer Science 2015-12-01 Juergen Schmidhuber

Among the various architectures of Recurrent Neural Networks, Echo State Networks (ESNs) emerged due to their simplified and inexpensive training procedure. These networks are known to be sensitive to the setting of hyper-parameters, which…

Neural and Evolutionary Computing · Computer Science 2019-09-23 Pietro Verzelli , Cesare Alippi , Lorenzo Livi

This paper considers a class of reinforcement learning problems, which involve systems with two types of states: stochastic and pseudo-stochastic. In such systems, stochastic states follow a stochastic transition kernel while the…

Machine Learning · Computer Science 2023-11-09 Honghao Wei , Xin Liu , Weina Wang , Lei Ying