中文
相关论文

相关论文: Robust Reinforcement Learning with Wasserstein Con…

200 篇论文

We present a Distributionally Robust Optimization (DRO) approach to estimate a robustified regression plane in a linear regression setting, when the observed samples are potentially contaminated with adversarially corrupted outliers. Our…

机器学习 · 统计学 2018-05-14 Ruidi Chen , Ioannis Ch. Paschalidis

Robust policies enable reinforcement learning agents to effectively adapt to and operate in unpredictable, dynamic, and ever-changing real-world environments. Factored representations, which break down complex state and action spaces into…

机器学习 · 计算机科学 2024-09-20 Panayiotis Panayiotou , Özgür Şimşek

Reinforcement learning provides an appealing framework for robotic control due to its ability to learn expressive policies purely through real-world interaction. However, this requires addressing real-world constraints and avoiding…

机器人学 · 计算机科学 2024-05-09 Kyle Stachowicz , Sergey Levine

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

机器学习 · 计算机科学 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

In order for reinforcement learning techniques to be useful in real-world decision making processes, they must be able to produce robust performance from limited data. Deep policy optimization methods have achieved impressive results on…

机器学习 · 计算机科学 2020-12-22 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

机器学习 · 计算机科学 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

Existing studies on constrained reinforcement learning (RL) may obtain a well-performing policy in the training environment. However, when deployed in a real environment, it may easily violate constraints that were originally satisfied…

机器学习 · 计算机科学 2024-05-06 Zhongchang Sun , Sihong He , Fei Miao , Shaofeng Zou

This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs). Our primary objectives are to adhere to physical operational constraints while reducing energy…

人工智能 · 计算机科学 2023-10-17 Harsh Patel , Yuan Zhou , Alexander P Lamb , Shu Wang , Jieliang Luo

Deep reinforcement learning is used in various domains, but usually under the assumption that the environment has stationary conditions like transitions and state distributions. When this assumption is not met, performance suffers. For this…

机器学习 · 计算机科学 2024-05-24 Zihe Liu , Jie Lu , Guangquan Zhang , Junyu Xuan

This paper presents a novel methodology for tractably solving optimal control and offline reinforcement learning problems for high-dimensional systems. This work is motivated by the ongoing challenges of safety, computation, and optimality…

最优化与控制 · 数学 2022-07-06 Aaron Kandel , Saehong Park , Scott Moura

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

系统与控制 · 电气工程与系统科学 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

系统与控制 · 电气工程与系统科学 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

We consider the problem of steering a system with unknown, stochastic dynamics to satisfy a rich, temporally layered task given as a signal temporal logic formula. We represent the system as a Markov decision process in which the states are…

系统与控制 · 计算机科学 2015-10-23 Austin Jones , Derya Aksaray , Zhaodan Kong , Mac Schwager , Calin Belta

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

机器学习 · 计算机科学 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in view of the equality of opportunity criterion. We use a type-$\infty$ Wasserstein ambiguity set centered at…

机器学习 · 计算机科学 2021-07-13 Yijie Wang , Viet Anh Nguyen , Grani A. Hanasusanto

Deep reinforcement learning has made significant progress in robotic manipulation tasks and it works well in the ideal disturbance-free environment. However, in a real-world environment, both internal and external disturbances are…

机器人学 · 计算机科学 2020-11-09 Pingcheng Jian , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

We investigate the problem of synthesizing distributionally robust control policies for stochastic systems under safety and reach-avoid specifications. Using a game-theoretical framework, we consider the setting where the probability…

系统与控制 · 电气工程与系统科学 2025-11-04 Yu Chen , Yuda Li , Shaoyuan Li , Xiang Yin

Reinforcement learning has been shown to perform a range of complex tasks through interaction with an environment or collected leveraging experience. However, many of these approaches presume optimal or near optimal experiences or the…

机器学习 · 计算机科学 2021-09-21 Chapman Siu , Jason Traish , Richard Yi Da Xu

Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment. To…

机器学习 · 计算机科学 2024-06-04 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Yifan Hu , Andreas Krause , Ilija Bogunovic

Interest in reinforcement learning (RL) for large-scale systems, comprising extensive populations of intelligent agents interacting with heterogeneous environments, has surged significantly across diverse scientific domains in recent years.…

系统与控制 · 电气工程与系统科学 2025-09-16 Wei Zhang , Jr-Shin Li