English
Related papers

Related papers: Dynamic Entropy Tuning in Reinforcement Learning L…

200 papers

Off-policy learning allows us to learn about possible policies of behavior from experience generated by a different behavior policy. Temporal difference (TD) learning algorithms can become unstable when combined with function approximation…

Machine Learning · Computer Science 2021-06-23 Ray Jiang , Tom Zahavy , Zhongwen Xu , Adam White , Matteo Hessel , Charles Blundell , Hado van Hasselt

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

Reinforcement learning (RL)-based quadrotor control policies have achieved impressive performance in tasks such as fast navigation in cluttered environments and drone racing, where the focus is on speed and agility. However, in several…

Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample…

Robotics · Computer Science 2025-09-08 Zhihao Zhang , Chengyang Peng , Ekim Yurtsever , Keith A. Redmill

Policy gradient algorithms have driven many recent advancements in language model reasoning. An appealing property is their ability to learn from exploration on their own trajectories, a process crucial for fostering diverse and creative…

Machine Learning · Computer Science 2026-03-13 Aleksei Petrenko , Ben Lipkin , Kevin Chen , Erik Wijmans , Marco Cusumano-Towner , Raja Giryes , Philipp Krähenbühl

This work proposes a unified control architecture that couples a Reinforcement Learning (RL)-driven controller with a disturbance-rejection Extended State Observer (ESO), complemented by an Event-Triggered Mechanism (ETM) to limit…

Optimization and Control · Mathematics 2026-01-01 Ningwei Bai , Chi Pui Chan , Qichen Yin , Tengyang Gong , Yunda Yan , Zezhi Tang

Deep reinforcement learning algorithms can perform poorly in real-world tasks due to the discrepancy between source and target environments. This discrepancy is commonly viewed as the disturbance in transition dynamics. Many existing…

Machine Learning · Computer Science 2021-12-21 Yufei Kuang , Miao Lu , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

This paper presents a robust reinforcement learning algorithm called robust deterministic policy gradient (RDPG), which reformulates the H-infinity control problem as a two-player zero-sum dynamic game between a user and an adversary. The…

Robotics · Computer Science 2025-12-04 Taeho Lee , Donghwan Lee

Soft actor-critic (SAC) is a popular algorithm for max-entropy reinforcement learning. In practice, the energy-based policies in SAC are often approximated using simple policy classes for efficiency, sacrificing the expressiveness and…

Machine Learning · Computer Science 2026-01-01 Yuyang Zhang , Yang Hu , Bo Dai , Na Li

In decision making problems for continuous state and action spaces, linear dynamical models are widely employed. Specifically, policies for stochastic linear systems subject to quadratic cost functions capture a large number of applications…

Machine Learning · Computer Science 2019-04-23 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

Model-based reinforcement learning strategies are believed to exhibit more significant sample complexity than model-free strategies to control dynamical systems,such as quadcopters.This belief that Model-based strategies that involve the…

Machine Learning · Computer Science 2019-12-02 Ashutosh Kumar Tiwari , Sandeep Varma Nadimpalli

Maximum entropy (MaxEnt) RL maximizes a combination of the original task reward and an entropy reward. It is believed that the regularization imposed by entropy, on both policy improvement and policy evaluation, together contributes to good…

Machine Learning · Computer Science 2022-02-01 Haonan Yu , Haichao Zhang , Wei Xu

Deep reinforcement learning (DRL) is a promising approach for developing legged locomotion skills. However, the iterative design process that is inevitable in practice is poorly supported by the default methodology. It is difficult to…

Robotics · Computer Science 2019-03-25 Zhaoming Xie , Patrick Clary , Jeremy Dao , Pedro Morais , Jonathan Hurst , Michiel van de Panne

Due to the sparse rewards and high degree of environment variation, reinforcement learning approaches such as Deep Deterministic Policy Gradient (DDPG) are plagued by issues of high variance when applied in complex real world environments.…

Robotics · Computer Science 2018-11-28 Linhai Xie , Yishu Miao , Sen Wang , Phil Blunsom , Zhihua Wang , Changhao Chen , Andrew Markham , Niki Trigoni

Deep Reinforcement learning has shown to be a powerful tool for developing policies in environments where an optimal solution is unclear. In this paper, we attempt to apply Twin Delayed Deep Deterministic Policy Gradients to train a neural…

Robotics · Computer Science 2024-12-20 Patrick Thomas , Kevin Schroeder , Jonathan Black

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Large language model post-training relies on reinforcement learning to improve model capability and alignment quality. However, the off-policy training paradigm introduces distribution shift, which often pushes the policy beyond the trust…

Machine Learning · Computer Science 2026-04-24 Zhenpeng Su , Leiyu Pan , Minxuan Lv , Tiehua Mei , Zijia Lin , Yuntao Li , Wenping Hu , Ruiming Tang , Kun Gai , Guorui Zhou

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

In deep Reinforcement Learning (RL), the learning rate critically influences both stability and performance, yet its optimal value shifts during training as the environment and policy evolve. Standard decay schedulers assume monotonic…

Machine Learning · Computer Science 2025-10-09 Henrique Donâncio , Antoine Barrier , Leah F. South , Florence Forbes

Evolutionary algorithms have been used to evolve a population of actors to generate diverse experiences for training reinforcement learning agents, which helps to tackle the temporal credit assignment problem and improves the exploration…

Neural and Evolutionary Computing · Computer Science 2023-04-21 Chengpeng Hu , Jiyuan Pei , Jialin Liu , Xin Yao