English
Related papers

Related papers: Robust Reinforcement Learning for Continuous Contr…

200 papers

Legged locomotion in unstructured environments demands not only high-performance control policies but also formal guarantees to ensure robustness under perturbations. Control methods often require carefully designed reference trajectories,…

Robotics · Computer Science 2026-03-23 Vrushabh Zinage , Narek Harutyunyan , Eric Verheyden , Fred Y. Hadaegh , Soon-Jo Chung

Robust reinforcement learning aims to produce policies that have strong guarantees even in the face of environments/transition models whose parameters have strong uncertainty. Existing work uses value-based methods and the usual primitive…

Artificial Intelligence · Computer Science 2018-02-12 Daniel J. Mankowitz , Timothy A. Mann , Pierre-Luc Bacon , Doina Precup , Shie Mannor

Reinforcement Learning (RL) has achieved remarkable success in sequential decision tasks. However, recent studies have revealed the vulnerability of RL policies to different perturbations, raising concerns about their effectiveness and…

Machine Learning · Computer Science 2025-07-08 Buqing Nie , Yangqing Fu , Jingtian Ji , Yue Gao

As reinforcement learning (RL) has achieved great success and been even adopted in safety-critical domains such as autonomous vehicles, a range of empirical studies have been conducted to improve its robustness against adversarial attacks.…

Machine Learning · Computer Science 2022-03-17 Fan Wu , Linyi Li , Zijian Huang , Yevgeniy Vorobeychik , Ding Zhao , Bo Li

While reinforcement learning has shown experimental success in a number of applications, it is known to be sensitive to noise and perturbations in the parameters of the system, leading to high variance in the total reward amongst different…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Erfaun Noorani , Christos Mavridis , John Baras

The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is…

Machine Learning · Computer Science 2022-05-17 Kishan Panaganti , Dileep Kalathil

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

Robotics · Computer Science 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

Multimodal Large Language Models (MLLMs) excel in vision-language reasoning but often struggle with structured perception tasks requiring precise localization and robustness. We propose a reinforcement learning framework that augments Group…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Xu Jia

We propose a novel framework for risk-sensitive reinforcement learning (RSRL) that incorporates robustness against transition uncertainty. We define two distinct yet coupled risk measures: an inner risk measure addressing state and cost…

Risk Management · Quantitative Finance 2026-01-01 Shanyu Han , Yangbo He , Yang Liu

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating…

Machine Learning · Computer Science 2020-06-02 Linfang Hou , Liang Pang , Xin Hong , Yanyan Lan , Zhiming Ma , Dawei Yin

Recently, robust reinforcement learning (RL) methods against input observation have garnered significant attention and undergone rapid evolution due to RL's potential vulnerability. Although these advanced methods have achieved reasonable…

Machine Learning · Computer Science 2024-09-04 Kosuke Nakanishi , Akihiro Kubo , Yuji Yasui , Shin Ishii

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

Machine Learning · Computer Science 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang

We provide a new perspective to understand why reinforcement learning (RL) struggles with robustness and generalization. We show, by examples, that local optimal policies may contain unstable control for some dynamic parameters and…

Robotics · Computer Science 2023-11-03 Bing Song , Jean-Jacques Slotine , Quang-Cuong Pham

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

In light of the burgeoning success of reinforcement learning (RL) in diverse real-world applications, considerable focus has been directed towards ensuring RL policies are robust to adversarial attacks during test time. Current approaches…

Machine Learning · Computer Science 2024-02-21 Xiangyu Liu , Chenghao Deng , Yanchao Sun , Yongyuan Liang , Furong Huang

Uncertainties in transition dynamics pose a critical challenge in reinforcement learning (RL), often resulting in performance degradation of trained policies when deployed on hardware. Many robust RL approaches follow two strategies:…

Machine Learning · Computer Science 2026-01-29 Xulin Chen , Ruipeng Liu , Zhenyu Gan , Garrett E. Katz

Reinforcement learning (RL) training is inherently unstable due to factors such as moving targets and high gradient variance. Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning from AI Feedback (RLAIF) can…

Machine Learning · Computer Science 2025-06-24 Ju-Seung Byun , Andrew Perrault

Traditional portfolio management methods can incorporate specific investor preferences but rely on accurate forecasts of asset returns and covariances. Reinforcement learning (RL) methods do not rely on these explicit forecasts and are…

Portfolio Management · Quantitative Finance 2022-03-23 Ruan Pretorius , Terence van Zyl

Self-supervised reinforcement learning (RL) presents a promising approach for enhancing the reasoning capabilities of Large Language Models (LLMs) without reliance on expensive human-annotated data. However, we find that existing methods…

Artificial Intelligence · Computer Science 2025-12-16 Bizhe Bai , Hongming Wu , Peng Ye , Tao Chen

Model-based Reinforcement Learning (MBRL) is a promising framework for learning control in a data-efficient manner. MBRL algorithms can be fairly complex due to the separate dynamics modeling and the subsequent planning algorithm, and as a…

Machine Learning · Computer Science 2021-03-01 Baohe Zhang , Raghu Rajan , Luis Pineda , Nathan Lambert , André Biedenkapp , Kurtland Chua , Frank Hutter , Roberto Calandra