English
Related papers

Related papers: Gradient-based Regularization for Action Smoothnes…

200 papers

Lagrangian methods are widely used algorithms for constrained optimization problems, but their learning dynamics exhibit oscillations and overshoot which, when applied to safe reinforcement learning, leads to constraint-violating behavior…

Optimization and Control · Mathematics 2020-07-09 Adam Stooke , Joshua Achiam , Pieter Abbeel

Entropy regularization is an efficient technique for encouraging exploration and preventing a premature convergence of (vanilla) policy gradient methods in reinforcement learning (RL). However, the theoretical understanding of…

Machine Learning · Computer Science 2024-07-16 Yuhao Ding , Junzi Zhang , Hyunin Lee , Javad Lavaei

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Continuous reinforcement learning such as DDPG and A3C are widely used in robot control and autonomous driving. However, both methods have theoretical weaknesses. While DDPG cannot control noises in the control process, A3C does not satisfy…

Machine Learning · Computer Science 2019-08-09 Tianhao Chen , Limei Cheng , Yang Liu , Wenchuan Jia , Shugen Ma

Reinforcement learning (RL) is a dominant paradigm for training autonomous agents, yet these agents often exhibit poor generalization, failing to adapt to scenarios not seen during training. In this work, we identify a fundamental cause of…

Artificial Intelligence · Computer Science 2026-01-16 Jingyu Liu , Xiaopeng Wu , Jingquan Peng , Kehan Chen , Chuan Yu , Lizhong Ding , Yong Liu

Deep Reinforcement Learning (DRL) is a powerful framework for solving complex sequential decision-making problems, particularly in robotic control. However, its practical deployment is often hindered by the substantial amount of experience…

Deep Reinforcement Learning (DRL) has gained prominence as an effective approach for control systems. However, its practical deployment is impeded by state perturbations that can severely impact system performance. Addressing this critical…

Artificial Intelligence · Computer Science 2023-12-18 Dapeng Zhi , Peixin Wang , Cheng Chen , Min Zhang

Despite significant advancements in robotic manipulation, achieving consistent and stable grasping remains a fundamental challenge, often limiting the successful execution of complex tasks. Our analysis reveals that even state-of-the-art…

Artificial Intelligence · Computer Science 2025-03-20 Sungjae Lee , Yeonjoo Hong , Kwang In Kim

Reinforcement Learning, particularly through policy gradient methods, has played a central role in enabling reasoning capabilities of Large Language Models. However, the optimization stability of policy gradients in this setting remains…

Machine Learning · Computer Science 2026-03-03 Luckeciano C. Melo , Alessandro Abate , Yarin Gal

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

Although deep Reinforcement Learning (RL) has proven successful in a wide range of tasks, one challenge it faces is interpretability when applied to real-world problems. Saliency maps are frequently used to provide interpretability for deep…

Machine Learning · Computer Science 2022-05-19 Jinwei Xing , Takashi Nagata , Xinyun Zou , Emre Neftci , Jeffrey L. Krichmar

Deep Reinforcement Learning (DRL) has been applied successfully to many robotic applications. However, the large number of trials needed for training is a key issue. Most of existing techniques developed to improve training efficiency (e.g.…

Robotics · Computer Science 2018-12-13 Linhai Xie , Sen Wang , Stefano Rosa , Andrew Markham , Niki Trigoni

While most current research in Reinforcement Learning (RL) focuses on improving the performance of the algorithms in controlled environments, the use of RL under constraints like those met in the video game industry is rarely studied.…

Machine Learning · Computer Science 2019-12-25 Olivier Delalleau , Maxim Peter , Eloi Alonso , Adrien Logut

Recent studies have revealed that, beyond conventional accuracy, calibration should also be considered for training modern deep neural networks. To address miscalibration during learning, some methods have explored different penalty…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Bingyuan Liu , Jérôme Rony , Adrian Galdran , Jose Dolz , Ismail Ben Ayed

This paper presents a novel neural network training approach for faster convergence and better generalization abilities in deep reinforcement learning. Particularly, we focus on the enhancement of training and evaluation performance in…

Machine Learning · Computer Science 2020-05-26 Mohammed Sharafath Abdul Hameed , Gavneet Singh Chadha , Andreas Schwung , Steven X. Ding

When using a tool, the grasps used for picking it up, reposing, and holding it in a suitable pose for the desired task could be distinct. Therefore, a key challenge for autonomous in-hand tool manipulation is finding a sequence of grasps…

Robotics · Computer Science 2023-04-06 Ethan K. Gordon , Rana Soltani Zarrin

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

We aim to develop off-policy DRL algorithms that not only exceed state-of-the-art performance but are also simple and minimalistic. For standard continuous control benchmarks, Soft Actor-Critic (SAC), which employs entropy maximization,…

Machine Learning · Computer Science 2020-12-08 Che Wang , Yanqiu Wu , Quan Vuong , Keith Ross

This paper introduces an information-theoretic constraint on learned policy complexity in the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm. Previous research with a related approach in continuous…

Artificial Intelligence · Computer Science 2025-05-16 Tailia Malloy , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro , Chris R. Sims

Recent advancements in off-policy Reinforcement Learning (RL) have significantly improved sample efficiency, primarily due to the incorporation of various forms of regularization that enable more gradient update steps than traditional…

Machine Learning · Computer Science 2024-06-21 Michal Nauman , Michał Bortkiewicz , Piotr Miłoś , Tomasz Trzciński , Mateusz Ostaszewski , Marek Cygan