中文
相关论文

相关论文: Zeroth-Order Actor-Critic: An Evolutionary Framewo…

200 篇论文

Substantial advancements to model-based reinforcement learning algorithms have been impeded by the model-bias induced by the collected data, which generally hurts performance. Meanwhile, their inherent sample efficiency warrants utility for…

机器人学 · 计算机科学 2021-11-01 Andrew S. Morgan , Daljeet Nandha , Georgia Chalvatzaki , Carlo D'Eramo , Aaron M. Dollar , Jan Peters

In this paper, we propose a new reinforcement learning (RL) algorithm, called encoding distributional soft actor-critic (E-DSAC), for decision-making in autonomous driving. Unlike existing RL-based decision-making methods, E-DSAC is…

机器人学 · 计算机科学 2021-09-14 Jingliang Duan , Yangang Ren , Fawang Zhang , Yang Guan , Dongjie Yu , Shengbo Eben Li , Bo Cheng , Lin Zhao

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

机器人学 · 计算机科学 2024-04-03 Dong Wang , Giovanni Beltrame

Zeroth-order optimization (ZOO) is an important framework for stochastic optimization when gradients are unavailable or expensive to compute. A potential limitation of existing ZOO methods is the bias inherent in most gradient estimators…

机器学习 · 计算机科学 2025-10-24 Shaocong Ma , Heng Huang

Conventional Reinforcement Learning (RL) algorithms, typically focused on estimating or maximizing expected returns, face challenges when refining offline pretrained models with online experiences. This paper introduces Generative Actor…

机器学习 · 计算机科学 2025-12-29 Aoyang Qin , Deqian Kong , Wei Wang , Ying Nian Wu , Song-Chun Zhu , Sirui Xie

Traditional Reinforcement Learning (RL) policies are typically implemented with fixed control rates, often disregarding the impact of control rate selection. This can lead to inefficiencies as the optimal control rate varies with task…

机器人学 · 计算机科学 2024-08-13 Dong Wang , Giovanni Beltrame

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

最优化与控制 · 数学 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

A key aspect of intelligence is the ability to demonstrate a broad spectrum of behaviors for adapting to unexpected situations. Over the past decade, advancements in deep reinforcement learning have led to groundbreaking achievements to…

机器学习 · 计算机科学 2024-06-04 Luca Grillotti , Maxence Faldor , Borja G. León , Antoine Cully

For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network…

神经与进化计算 · 计算机科学 2022-11-14 Sebastián Basterrech , Tarun Kumar Sharma

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

机器学习 · 计算机科学 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

Multi-objective evolutionary algorithms (MOEAs) are widely used to solve multi-objective optimization problems. The algorithms rely on setting appropriate parameters to find good solutions. However, this parameter tuning could be very…

神经与进化计算 · 计算机科学 2022-11-18 Remco Coppens , Robbert Reijnen , Yingqian Zhang , Laurens Bliek , Berend Steenhuisen

Deterministic Policy Gradient (DPG) removes a level of randomness from standard randomized-action Policy Gradient (PG), and demonstrates substantial empirical success for tackling complex dynamic problems involving Markov decision…

机器学习 · 计算机科学 2020-07-14 Harshat Kumar , Dionysios S. Kalogerias , George J. Pappas , Alejandro Ribeiro

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

系统与控制 · 电气工程与系统科学 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

机器学习 · 计算机科学 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

In this study, we delve into an emerging optimization challenge involving a black-box objective function that can only be gauged via a ranking oracle-a situation frequently encountered in real-world scenarios, especially when the function…

机器学习 · 计算机科学 2024-04-16 Zhiwei Tang , Dmitry Rybin , Tsung-Hui Chang

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

机器学习 · 计算机科学 2019-12-13 Simon Ramstedt , Christopher Pal

Generalizability and stability are two key objectives for operating reinforcement learning (RL) agents in the real world. Designing RL algorithms that optimize these objectives can be a costly and painstaking process. This paper presents…

On-policy reinforcement learning (RL) algorithms are widely used for their strong asymptotic performance and training stability, but they struggle to scale with larger batch sizes, as additional parallel environments yield redundant data…

机器学习 · 计算机科学 2025-11-13 Jianren Wang , Yifan Su , Abhinav Gupta , Deepak Pathak

Safety is essential for reinforcement learning (RL) applied in real-world situations. Chance constraints are suitable to represent the safety requirements in stochastic systems. Previous chance-constrained RL methods usually have a low…

机器学习 · 计算机科学 2021-03-17 Baiyu Peng , Yao Mu , Yang Guan , Shengbo Eben Li , Yuming Yin , Jianyu Chen

Deep reinforcement learning (RL) has achieved remarkable success, yet its deployment in real-world scenarios is often limited by vulnerability to environmental uncertainties. Distributionally robust RL (DR-RL) algorithms have been proposed…

机器学习 · 计算机科学 2026-04-21 Mingxuan Cui , Duo Zhou , Yuxuan Han , Grani A. Hanasusanto , Qiong Wang , Huan Zhang , Zhengyuan Zhou