English
Related papers

Related papers: GRAC: Self-Guided and Self-Regularized Actor-Criti…

200 papers

Deep Reinforcement Learning (DRL) is a powerful framework for solving complex sequential decision-making problems, particularly in robotic control. However, its practical deployment is often hindered by the substantial amount of experience…

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

A widely-studied deep reinforcement learning (RL) technique known as Prioritized Experience Replay (PER) allows agents to learn from transitions sampled with non-uniform probability proportional to their temporal-difference (TD) error.…

Machine Learning · Computer Science 2022-09-02 Baturay Saglam , Furkan B. Mutlu , Dogan C. Cicek , Suleyman S. Kozat

The rapid increase in the number of cyber-attacks in recent years raises the need for principled methods for defending networks against malicious actors. Deep reinforcement learning (DRL) has emerged as a promising approach for mitigating…

Machine Learning · Computer Science 2024-09-30 Gregory Palmer , Chris Parry , Daniel J. B. Harrold , Chris Willis

Development of autonomous cyber system defense strategies and action recommendations in the real-world is challenging, and includes characterizing system state uncertainties and attack-defense dynamics. We propose a data-driven deep…

Machine Learning · Computer Science 2023-02-06 Ashutosh Dutta , Samrat Chatterjee , Arnab Bhattacharya , Mahantesh Halappanavar

Deep Reinforcement Learning (DRL) has achieved remarkable success, ranging from complex computer games to real-world applications, showing the potential for intelligent agents capable of learning in dynamic environments. However, its…

Robotics · Computer Science 2024-07-08 I Lee , Hoang-Giang Cao , Cong-Tinh Dao , Yu-Cheng Chen , I-Chen Wu

Deep Reinforcement Learning (DRL) algorithms are known to be data inefficient. One reason is that a DRL agent learns both the feature and the policy tabula rasa. Integrating prior knowledge into DRL algorithms is one way to improve learning…

Machine Learning · Computer Science 2019-04-05 Gabriel V. de la Cruz , Yunshu Du , Matthew E. Taylor

In this paper, we place deep Q-learning into a control-oriented perspective and study its learning dynamics with well-established techniques from robust control. We formulate an uncertain linear time-invariant model by means of the neural…

Machine Learning · Computer Science 2022-11-08 Balazs Varga , Balazs Kulcsar , Morteza Haghir Chehreghani

With the implementation of reinforcement learning (RL) algorithms, current state-of-art autonomous vehicle technology have the potential to get closer to full automation. However, most of the applications have been limited to game domains…

Robotics · Computer Science 2020-01-14 Wenhui Huang , Francesco Braghin , Zhuo Wang

Federated reinforcement learning (FRL) has emerged as a promising paradigm, enabling multiple agents to collaborate and learn a shared policy adaptable across heterogeneous environments. Among the various reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-25 Ye Zhu , Xiaowen Gong

Goal-Conditioned Reinforcement Learning (GCRL) can enable agents to spontaneously set diverse goals to learn a set of skills. Despite the excellent works proposed in various fields, reaching distant goals in temporally extended tasks…

Robotics · Computer Science 2023-07-21 Zhifeng Qian , Mingyu You , Hongjun Zhou , Xuanhui Xu , Bin He

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

Machine Learning · Computer Science 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

In offline reinforcement learning, it is necessary to manage out-of-distribution actions to prevent overestimation of value functions. One class of methods, the policy-regularized method, addresses this problem by constraining the target…

Machine Learning · Computer Science 2025-02-26 Linjiajie Fang , Ruoxue Liu , Jing Zhang , Wenjia Wang , Bing-Yi Jing

Meta Reinforcement Learning (RL) methods focus on automating the design of RL algorithms that generalize to a wide range of environments. The framework introduced in (Anonymous, 2020) addresses the problem by representing different RL…

Machine Learning · Computer Science 2021-01-19 Juan Jose Garau Luis

Model-based reinforcement learning (MBRL) and model-free reinforcement learning (MFRL) evolve along distinct paths but converge in the design of Dyna-Q [1]. However, modern RL methods still struggle with effective transferability across…

Machine Learning · Computer Science 2025-12-18 Quanxi Zhou , Wencan Mao , Manabu Tsukada , John C. S. Lui , Yusheng Ji

In value-based reinforcement learning methods such as deep Q-learning, function approximation errors are known to lead to overestimated value estimates and suboptimal policies. We show that this problem persists in an actor-critic setting…

Artificial Intelligence · Computer Science 2018-10-23 Scott Fujimoto , Herke van Hoof , David Meger

We propose a deep reinforcement learning approach for solving a mapless navigation problem in warehouse scenarios. In our approach, an automation guided vehicle is equipped with LiDAR and frontal RGB sensors and learns to perform a targeted…

Robotics · Computer Science 2022-03-17 Honghu Xue , Benedikt Hein , Mohamed Bakr , Georg Schildbach , Bengt Abel , Elmar Rueckert

Actor-critic methods integrating target networks have exhibited a stupendous empirical success in deep reinforcement learning. However, a theoretical understanding of the use of target networks in actor-critic methods is largely missing in…

Machine Learning · Computer Science 2022-02-24 Anas Barakat , Pascal Bianchi , Julien Lehmann

While Goal-Conditioned Reinforcement Learning (GCRL) has gained attention, its algorithmic robustness against adversarial perturbations remains unexplored. The attacks and robust representation training methods that are designed for…

Machine Learning · Computer Science 2023-12-21 Xiangyu Yin , Sihao Wu , Jiaxu Liu , Meng Fang , Xingyu Zhao , Xiaowei Huang , Wenjie Ruan

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

Machine Learning · Computer Science 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta