中文
相关论文

相关论文: Bring Your Own (Non-Robust) Algorithm to Solve Rob…

200 篇论文

The distributionally robust Markov Decision Process (MDP) approach asks for a distributionally robust policy that achieves the maximal expected total reward under the most adversarial distribution of uncertain parameters. In this paper, we…

系统与控制 · 计算机科学 2018-10-10 Zhi Chen , Pengqian Yu , William B. Haskell

Synthesising verifiably correct controllers for dynamical systems is crucial for safety-critical problems. To achieve this, it is important to account for uncertainty in a robust manner, while at the same time it is often of interest to…

系统与控制 · 电气工程与系统科学 2024-05-16 Luke Rickard , Alessandro Abate , Kostas Margellos

This paper proposes a multi-agent reinforcement learning based medium access framework for wireless networks. The access problem is formulated as a Markov Decision Process (MDP), and solved using reinforcement learning with every network…

机器学习 · 计算机科学 2021-04-30 Hrishikesh Dutta , Subir Biswas

Robust Markov decision processes (MDPs) aim to handle changing or partially known system dynamics. To solve them, one typically resorts to robust optimization methods. However, this significantly increases computational complexity and…

机器学习 · 计算机科学 2021-10-14 Esther Derman , Matthieu Geist , Shie Mannor

Non-stationary environments are challenging for reinforcement learning algorithms. If the state transition and/or reward functions change based on latent factors, the agent is effectively tasked with optimizing a behavior that maximizes…

机器学习 · 计算机科学 2021-05-21 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

Advances in mobile computing technologies have made it possible to monitor and apply data-driven interventions across complex systems in real time. Markov decision processes (MDPs) are the primary model for sequential decision problems with…

统计方法学 · 统计学 2018-03-20 Longshaokan Wang , Eric B. Laber , Katie Witkiewitz

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

机器学习 · 计算机科学 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

Robust Markov decision processes (MDPs) are used for applications of dynamic optimization in uncertain environments and have been studied extensively. Many of the main properties and algorithms of MDPs, such as value iteration and policy…

最优化与控制 · 数学 2023-12-14 Julien Grand-Clément , Marek Petrik

In robust Markov decision processes (RMDPs), it is assumed that the reward and the transition dynamics lie in a given uncertainty set. By targeting maximal return under the most adversarial model from that set, RMDPs address performance…

机器学习 · 计算机科学 2024-02-13 Uri Gadot , Esther Derman , Navdeep Kumar , Maxence Mohamed Elfatihi , Kfir Levy , Shie Mannor

Robust Markov decision processes (MDPs) address the challenge of model uncertainty by optimizing the worst-case performance over an uncertainty set of MDPs. In this paper, we focus on the robust average-reward MDPs under the model-free…

机器学习 · 计算机科学 2023-05-19 Yue Wang , Alvaro Velasquez , George Atia , Ashley Prater-Bennette , Shaofeng Zou

Robust reinforcement learning (RL) aims to find a policy that optimizes the worst-case performance in the face of uncertainties. In this paper, we focus on action robust RL with the probabilistic policy execution uncertainty, in which,…

机器学习 · 计算机科学 2023-07-21 Guanlin Liu , Zhihan Zhou , Han Liu , Lifeng Lai

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

人工智能 · 计算机科学 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Model-based reinforcement learning (RL) algorithms allow us to combine model-generated data with those collected from interaction with the real system in order to alleviate the data efficiency problem in RL. However, designing such…

机器学习 · 计算机科学 2020-06-25 Yinlam Chow , Brandon Cui , MoonKyung Ryu , Mohammad Ghavamzadeh

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

机器学习 · 计算机科学 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

Most reinforcement learning methods are based upon the key assumption that the transition dynamics and reward functions are fixed, that is, the underlying Markov decision process is stationary. However, in many real-world applications, this…

机器学习 · 计算机科学 2020-09-23 Yash Chandak , Georgios Theocharous , Shiv Shankar , Martha White , Sridhar Mahadevan , Philip S. Thomas

Our goal is to build robust optimization problems for making decisions based on complex data from the past. In robust optimization (RO) generally, the goal is to create a policy for decision-making that is robust to our uncertainty about…

最优化与控制 · 数学 2014-07-07 Theja Tulabandhula , Cynthia Rudin

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Processes (MDPs). While…

机器人学 · 计算机科学 2020-02-11 Gilwoo Lee , Brian Hou , Sanjiban Choudhury , Siddhartha S. Srinivasa

Learning in MDPs with highly complex state representations is currently possible due to multiple advancements in reinforcement learning algorithm design. However, this incline in complexity, and furthermore the increase in the dimensions of…

机器学习 · 计算机科学 2023-06-12 Ezgi Korkmaz , Jonah Brown-Cohen

Robust reinforcement learning is essential for deploying reinforcement learning algorithms in real-world scenarios where environmental uncertainty predominates. Traditional robust reinforcement learning often depends on rectangularity…

机器学习 · 计算机科学 2024-06-13 Adil Zouitine , David Bertoin , Pierre Clavier , Matthieu Geist , Emmanuel Rachelson

This paper presents a robust and kernelized data-enabled predictive control (RoKDeePC) algorithm to perform model-free optimal control for nonlinear systems using only input and output data. The algorithm combines robust predictive control…

系统与控制 · 电气工程与系统科学 2022-06-07 Linbin Huang , John Lygeros , Florian Dörfler