中文
相关论文

相关论文: Efficient On-policy Visual-RL via Stochastic Decou…

200 篇论文

Due to the sparse rewards and high degree of environment variation, reinforcement learning approaches such as Deep Deterministic Policy Gradient (DDPG) are plagued by issues of high variance when applied in complex real world environments.…

机器人学 · 计算机科学 2018-11-28 Linhai Xie , Yishu Miao , Sen Wang , Phil Blunsom , Zhihua Wang , Changhao Chen , Andrew Markham , Niki Trigoni

Reinforcement Learning (RL) can directly enhance the reasoning capabilities of large language models without extensive reliance on Supervised Fine-Tuning (SFT). In this work, we revisit the traditional Policy Gradient (PG) mechanism and…

机器学习 · 计算机科学 2026-02-04 Xiangxiang Chu , Hailang Huang , Xiao Zhang , Fei Wei , Yong Wang

Policy gradient (PG) methods are successful approaches to deal with continuous reinforcement learning (RL) problems. They learn stochastic parametric (hyper)policies by either exploring in the space of actions or in the space of parameters.…

机器学习 · 计算机科学 2024-05-31 Alessandro Montenegro , Marco Mussi , Alberto Maria Metelli , Matteo Papini

Deep Reinforcement Learning (DRL) techniques have received significant attention in control and decision-making algorithms. Most applications involve complex decision-making systems, justified by the algorithms' computational power and…

系统与控制 · 电气工程与系统科学 2024-02-28 Fatemeh Tavakkoli , Pouria Sarhadi , Benoit Clement , Wasif Naeem

Deep reinforcement learning (RL) algorithms typically parameterize the policy as a deep network that outputs either a deterministic action or a stochastic one modeled as a Gaussian distribution, hence restricting learning to a single…

机器学习 · 计算机科学 2024-06-04 Zechu Li , Rickmer Krohn , Tao Chen , Anurag Ajay , Pulkit Agrawal , Georgia Chalvatzaki

There is growing interest in reinforcement learning (RL) methods that leverage the simulator's derivatives to improve learning efficiency. While early gradient-based approaches have demonstrated superior performance compared to…

机器人学 · 计算机科学 2025-09-05 Joseph Amigo , Rooholla Khorrambakht , Elliot Chane-Sane , Nicolas Mansard , Ludovic Righetti

The sample inefficiency of reinforcement learning (RL) remains a significant challenge in robotics. RL requires large-scale simulation and can still cause long training times, slowing research and innovation. This issue is particularly…

机器人学 · 计算机科学 2026-01-16 Johannes Heeg , Yunlong Song , Davide Scaramuzza

This paper presents a robust reinforcement learning algorithm called robust deterministic policy gradient (RDPG), which reformulates the H-infinity control problem as a two-player zero-sum dynamic game between a user and an adversary. The…

机器人学 · 计算机科学 2025-12-04 Taeho Lee , Donghwan Lee

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

机器学习 · 计算机科学 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

This work introduces a toolchain for applying Reinforcement Learning (RL), specifically the Deep Deterministic Policy Gradient (DDPG) algorithm, in safety-critical real-world environments. As an exemplary application, transient load control…

机器学习 · 计算机科学 2026-02-25 Julian Bedei , Lucas Koch , Kevin Badalian , Alexander Winkler , Patrick Schaber , Jakob Andert

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

机器学习 · 计算机科学 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

We present DrQ-v2, a model-free reinforcement learning (RL) algorithm for visual continuous control. DrQ-v2 builds on DrQ, an off-policy actor-critic approach that uses data augmentation to learn directly from pixels. We introduce several…

人工智能 · 计算机科学 2021-07-21 Denis Yarats , Rob Fergus , Alessandro Lazaric , Lerrel Pinto

In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified…

系统与控制 · 电气工程与系统科学 2021-08-06 Wenqi Cai , Arash B. Kordabad , Hossein N. Esfahani , Anastasios M. Lekkas , Sebastien Gros

This paper deals with distributed policy optimization in reinforcement learning, which involves a central controller and a group of learners. In particular, two typical settings encountered in several applications are considered:…

机器学习 · 计算机科学 2021-04-21 Tianyi Chen , Kaiqing Zhang , Georgios B. Giannakis , Tamer Başar

Maximum entropy deep reinforcement learning (RL) methods have been demonstrated on a range of challenging continuous tasks. However, existing methods either suffer from severe instability when training on large off-policy data or cannot…

机器学习 · 计算机科学 2019-09-10 Wenjie Shi , Shiji Song , Cheng Wu

Effective visual representation learning is crucial for reinforcement learning (RL) agents to extract task-relevant information from raw sensory inputs and generalize across diverse environments. However, existing RL benchmarks lack the…

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

机器人学 · 计算机科学 2024-04-03 Dong Wang , Giovanni Beltrame

This paper presents a computationally efficient solution for constraint management of multi-input and multi-output (MIMO) systems. The solution, referred to as the Decoupled Reference Governor (DRG), maintains the highly-attractive…

系统与控制 · 电气工程与系统科学 2020-12-04 Yudan Liu , Joycer Osorio , Hamid R. Ossareh

Massively parallel GPU simulation environments have accelerated reinforcement learning (RL) research by enabling fast data collection for on-policy RL algorithms like Proximal Policy Optimization (PPO). To maximize throughput, it is common…

机器学习 · 计算机科学 2025-11-27 Sid Bharthulwar , Stone Tao , Hao Su

Deep Reinforcement Learning (DRL) algorithms have recently made significant strides in improving network performance. Nonetheless, their practical use is still limited in the absence of safe exploration and safe decision-making. In the…

网络与互联网体系结构 · 计算机科学 2024-01-12 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay