English
Related papers

Related papers: Is High Variance Unavoidable in RL? A Case Study i…

200 papers

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on…

Machine Learning · Computer Science 2019-05-15 Richard Cheng , Abhinav Verma , Gabor Orosz , Swarat Chaudhuri , Yisong Yue , Joel W. Burdick

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

Machine Learning · Computer Science 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

We provide a new perspective to understand why reinforcement learning (RL) struggles with robustness and generalization. We show, by examples, that local optimal policies may contain unstable control for some dynamic parameters and…

Robotics · Computer Science 2023-11-03 Bing Song , Jean-Jacques Slotine , Quang-Cuong Pham

Lack of reliability is a well-known issue for reinforcement learning (RL) algorithms. This problem has gained increasing attention in recent years, and efforts to improve it have grown substantially. To aid RL researchers and production…

Machine Learning · Statistics 2020-02-14 Stephanie C. Y. Chan , Samuel Fishman , John Canny , Anoop Korattikara , Sergio Guadarrama

As reinforcement learning (RL) achieves more success in solving complex tasks, more care is needed to ensure that RL research is reproducible and that algorithms herein can be compared easily and fairly with minimal bias. RL results are,…

Machine Learning · Computer Science 2019-09-12 Nicolai A. Lynnerup , Laura Nolling , Rasmus Hasle , John Hallam

Training an agent to solve control tasks directly from high-dimensional images with model-free reinforcement learning (RL) has proven difficult. A promising approach is to learn a latent representation together with the control policy.…

Machine Learning · Computer Science 2020-07-10 Denis Yarats , Amy Zhang , Ilya Kostrikov , Brandon Amos , Joelle Pineau , Rob Fergus

A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic…

Machine Learning · Computer Science 2022-03-10 Yikun Cheng , Pan Zhao , Manan Gandhi , Bo Li , Evangelos Theodorou , Naira Hovakimyan

Recent years have witnessed significant progresses in deep Reinforcement Learning (RL). Empowered with large scale neural networks, carefully designed architectures, novel training algorithms and massively parallel computing devices,…

Machine Learning · Computer Science 2018-04-23 Chiyuan Zhang , Oriol Vinyals , Remi Munos , Samy Bengio

Reinforcement learning (RL) enables simulations of HCI tasks, yet their validity is questionable when performance is driven by visual rendering artifacts distinct from interaction design. We provide the first systematic analysis of how…

Human-Computer Interaction · Computer Science 2026-03-03 Hannah Selder , Charlotte Beylier , Nico Scherf , Arthur Fleig

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

In recent years, significant progress has been made in solving challenging problems across various domains using deep reinforcement learning (RL). Reproducing existing work and accurately judging the improvements offered by novel methods is…

Machine Learning · Computer Science 2019-01-31 Peter Henderson , Riashat Islam , Philip Bachman , Joelle Pineau , Doina Precup , David Meger

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Plasticity, the ability of a neural network to evolve with new data, is crucial for high-performance and sample-efficient visual reinforcement learning (VRL). Although methods like resetting and regularization can potentially mitigate…

Machine Learning · Computer Science 2024-05-21 Guozheng Ma , Lu Li , Sen Zhang , Zixuan Liu , Zhen Wang , Yixin Chen , Li Shen , Xueqian Wang , Dacheng Tao

This work identifies a common flaw of deep reinforcement learning (RL) algorithms: a tendency to rely on early interactions and ignore useful evidence encountered later. Because of training on progressively growing datasets, deep RL agents…

Machine Learning · Computer Science 2022-05-17 Evgenii Nikishin , Max Schwarzer , Pierluca D'Oro , Pierre-Luc Bacon , Aaron Courville

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

We show that deep reinforcement learning algorithms can retain their ability to learn without resetting network parameters in settings where the number of gradient updates greatly exceeds the number of environment samples by combatting…

Machine Learning · Computer Science 2024-08-06 Marcel Hussing , Claas Voelcker , Igor Gilitschenski , Amir-massoud Farahmand , Eric Eaton

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song

Adversarial examples resulting from instability of current computer vision models are an extremely important topic due to their potential to compromise any application. In this paper we demonstrate that instability is inevitable due to a)…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Oliver Turnbull , George Cevora

Reinforcement learning (RL) has become widely adopted in robot control. Despite many successes, one major persisting problem can be very low data efficiency. One solution is interactive feedback, which has been shown to speed up RL…

Robotics · Computer Science 2026-04-29 Daniel Harnack , Julie Pivin-Bachler , Nicolás Navarro-Guerrero
‹ Prev 1 2 3 10 Next ›