中文
相关论文

相关论文: Natural Actor-Critic for Robust Reinforcement Lear…

200 篇论文

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the…

机器学习 · 计算机科学 2021-09-27 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

机器学习 · 计算机科学 2019-12-13 Simon Ramstedt , Christopher Pal

To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the…

机器学习 · 计算机科学 2024-05-10 Laixi Shi , Eric Mazumdar , Yuejie Chi , Adam Wierman

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

机器学习 · 计算机科学 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

Reinforcement Learning (RL) techniques have drawn great attention in many challenging tasks, but their performance deteriorates dramatically when applied to real-world problems. Various methods, such as domain randomization, have been…

机器学习 · 计算机科学 2022-08-05 Wangyang Yue , Yuan Zhou , Xiaochuan Zhang , Yuchen Hua , Zhiyuan Wang , Guang Kou

Simulation-to-decision learning enables safe policy training in digital environments without risking real-world deployment, and has become essential in mission-critical domains such as supply chains and industrial systems. However,…

机器学习 · 计算机科学 2026-03-11 Hongyu Cao , Jinghan Zhang , Kunpeng Liu , Dongjie Wang , Feng Xia , Haifeng Chen , Xiaohua Hu , Yanjie Fu

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

机器学习 · 计算机科学 2025-04-03 Llewyn Salt , Marcus Gallagher

Reinforcement learning (RL) is recognized as lacking generalization and robustness under environmental perturbations, which excessively restricts its application for real-world robotics. Prior work claimed that adding regularization to the…

机器学习 · 计算机科学 2023-12-06 Yuan Zhang , Jianhong Wang , Joschka Boedecker

Reinforcement learning has gathered much attention in recent years due to its rapid development and rich applications, especially on control systems and robotics. When tackling real-world applications with reinforcement learning method, the…

机器学习 · 计算机科学 2025-10-02 Andy Wu , Chun-Cheng Lin , Rung-Tzuo Liaw , Yuehua Huang , Chihjung Kuo , Chia Tong Weng

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

系统与控制 · 电气工程与系统科学 2025-07-23 Aria Delshad , Maryam Babazadeh

Despite the empirical success of the actor-critic algorithm, its theoretical understanding lags behind. In a broader context, actor-critic can be viewed as an online alternating update algorithm for bilevel optimization, whose convergence…

机器学习 · 计算机科学 2019-07-16 Zhuoran Yang , Yongxin Chen , Mingyi Hong , Zhaoran Wang

Recently, there has been growing interest in autonomous shipping due to its potential to improve maritime efficiency and safety. The use of advanced technologies, such as artificial intelligence, can address the current navigational and…

机器学习 · 计算机科学 2024-11-08 Bavo Lesy , Ali Anwar , Siegfried Mercelis

Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm…

机器学习 · 计算机科学 2019-06-10 Patrick Nadeem Ward , Ariella Smofsky , Avishek Joey Bose

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

机器学习 · 计算机科学 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

系统与控制 · 电气工程与系统科学 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

Offline reinforcement learning (RL) addresses the challenge of expensive and high-risk data exploration inherent in RL by pre-training policies on vast amounts of offline data, enabling direct deployment or fine-tuning in real-world…

机器学习 · 计算机科学 2024-08-13 Thanh Nguyen , Tung M. Luu , Tri Ton , Chang D. Yoo

In reinforcement learning, robust policies for high-stakes decision-making problems with limited data are usually computed by optimizing the percentile criterion, which minimizes the probability of a catastrophic failure. Unfortunately,…

机器学习 · 计算机科学 2021-03-01 Elita A. Lobo , Mohammad Ghavamzadeh , Marek Petrik

We present a reinforcement learning (RL) approach for robust optimisation of risk-aware performance criteria. To allow agents to express a wide variety of risk-reward profiles, we assess the value of a policy using rank dependent expected…

机器学习 · 计算机科学 2021-12-16 Sebastian Jaimungal , Silvana Pesenti , Ye Sheng Wang , Hariom Tatsat

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

系统与控制 · 电气工程与系统科学 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

Reinforcement learning (RL) and Deep Reinforcement Learning (DRL), in particular, have the potential to disrupt and are already changing the way we interact with the world. One of the key indicators of their applicability is their ability…

机器学习 · 计算机科学 2024-08-20 Nikolai Rozanov