English
Related papers

Related papers: Random Projection in Neural Episodic Control

200 papers

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

A growing body of evidence suggests that neural networks employed in deep reinforcement learning (RL) gradually lose their plasticity, the ability to learn from new data; however, the analysis and mitigation of this phenomenon is hampered…

Machine Learning · Computer Science 2023-10-05 Evgenii Nikishin , Junhyuk Oh , Georg Ostrovski , Clare Lyle , Razvan Pascanu , Will Dabney , André Barreto

We introduce a novel artificial neural network architecture that integrates robustness to adversarial input in the network structure. The main idea of our approach is to force the network to make predictions on what the given instance of…

Machine Learning · Computer Science 2016-07-15 Harm Berntsen , Wouter Kuijper , Tom Heskes

Learning to control an environment without hand-crafted rewards or expert data remains challenging and is at the frontier of reinforcement learning research. We present an unsupervised learning algorithm to train agents to achieve…

Machine Learning · Computer Science 2018-11-29 David Warde-Farley , Tom Van de Wiele , Tejas Kulkarni , Catalin Ionescu , Steven Hansen , Volodymyr Mnih

Deep Deterministic Policy Gradient (DDPG) has been proved to be a successful reinforcement learning (RL) algorithm for continuous control tasks. However, DDPG still suffers from data insufficiency and training inefficiency, especially in…

Machine Learning · Computer Science 2019-03-05 Zhizheng Zhang , Jiale Chen , Zhibo Chen , Weiping Li

Humans excel in continuously learning with small data without forgetting how to solve old problems. However, neural networks require large datasets to compute latent representations across different tasks while minimizing a loss function.…

Machine Learning · Computer Science 2019-11-21 Omar U. Florez , Erik Mueller

Deep neural networks continue to show improved performance with increasing depth, an encouraging trend that implies an explosion in the possible permutations of network architectures and hyperparameters for which there is little intuitive…

Machine Learning · Statistics 2017-09-27 Emmanuel Dufourq , Bruce A. Bassett

Despite the recent successes of reinforcement learning in games and robotics, it is yet to become broadly practical. Sample efficiency and unreliable performance in rare but challenging scenarios are two of the major obstacles. Drawing…

Machine Learning · Computer Science 2021-01-08 Elmira Amirloo Abolfathi , Jun Luo , Peyman Yadmellat , Kasra Rezaee

Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new…

The current dominant paradigm in sensorimotor control, whether imitation or reinforcement learning, is to train policies directly in raw action spaces such as torque, joint angle, or end-effector position. This forces the agent to make…

Machine Learning · Computer Science 2020-12-07 Shikhar Bahl , Mustafa Mukadam , Abhinav Gupta , Deepak Pathak

We introduce and detail an atypical neural network architecture, called time elastic neural network (teNN), for multivariate time series classification. The novelty compared to classical neural network architecture is that it explicitly…

Neural and Evolutionary Computing · Computer Science 2024-06-14 Pierre-François Marteau

In this paper, we propose a novel ensembling technique for deep neural networks, which is able to drastically reduce the required memory compared to alternative approaches. In particular, we propose to extract multiple sub-networks from a…

Machine Learning · Computer Science 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini

For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network…

Neural and Evolutionary Computing · Computer Science 2022-11-14 Sebastián Basterrech , Tarun Kumar Sharma

While deep reinforcement learning has shown important empirical success, it tends to learn relatively slow due to slow propagation of rewards information and slow update of parametric neural networks. Non-parametric episodic memory, on the…

Machine Learning · Computer Science 2023-04-25 Zhao Yang , Thomas. M. Moerland , Mike Preuss , Aske Plaat

The loss of plasticity in learning agents, analogous to the solidification of neural pathways in biological brains, significantly impedes learning and adaptation in reinforcement learning due to its non-stationary nature. To address this…

Machine Learning · Computer Science 2025-06-03 Jiashun Liu , Johan Obando-Ceron , Aaron Courville , Ling Pan

Complex environments and tasks pose a difficult problem for holistic end-to-end learning approaches. Decomposition of an environment into interacting controllable and non-controllable objects allows supervised learning for non-controllable…

Machine Learning · Computer Science 2019-01-30 Andrew Melnik , Sascha Fleer , Malte Schilling , Helge Ritter

In this paper, we propose a novel control architecture, inspired from neuroscience, for adaptive control of continuous-time systems. The proposed architecture, in the setting of standard Neural Network (NN) based adaptive control, augments…

Systems and Control · Computer Science 2021-10-11 Deepan Muthirayan , Pramod P. Khargonekar

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

In this article, we propose a backpropagation-free approach to robotic control through the neuro-cognitive computational framework of neural generative coding (NGC), designing an agent built completely from powerful predictive…

Robotics · Computer Science 2022-09-20 Alexander Ororbia , Ankur Mali