中文
相关论文

相关论文: A General Markov Decision Process Framework for Di…

200 篇论文

This paper proposes a reinforcement learning method for controller synthesis of autonomous systems in unknown and partially-observable environments with subjective time-dependent safety constraints. Mathematically, we model the system…

机器人学 · 计算机科学 2021-04-06 Yu Wang , Alper Kamil Bozkurt , Miroslav Pajic

Continuous-time Markov decision processes (CTMDPs) are canonical models to express sequential decision-making under dense-time and stochastic environments. When the stochastic evolution of the environment is only available via sampling,…

机器学习 · 计算机科学 2023-03-17 Amin Falah , Shibashis Guha , Ashutosh Trivedi

To ensure the usefulness of Reinforcement Learning (RL) in real systems, it is crucial to ensure they are robust to noise and adversarial attacks. In adversarial RL, an external attacker has the power to manipulate the victim agent's…

机器学习 · 计算机科学 2024-06-18 Jeremy McMahan , Young Wu , Xiaojin Zhu , Qiaomin Xie

The transition to autonomous material systems necessitates adaptive control methodologies to maximize structural longevity. This study frames the self-healing process as a Reinforcement Learning (RL) problem within a Markov Decision Process…

机器学习 · 计算机科学 2025-11-25 Maitreyi Chatterjee , Devansh Agarwal , Biplab Chatterjee

We study the reinforcement learning (RL) problem in a constrained Markov decision process (CMDP), where an agent explores the environment to maximize the expected cumulative reward while satisfying a single constraint on the expected total…

The agent learns to organize decision behavior to achieve a behavioral goal, such as reward maximization, and reinforcement learning is often used for this optimization. Learning an optimal behavioral strategy is difficult under the…

机器学习 · 计算机科学 2023-05-09 Kazuki Takahashi , Tomoki Fukai , Yutaka Sakai , Takashi Takekawa

In recent years, the integration of Automated Planning (AP) and Reinforcement Learning (RL) has seen a surge of interest. To perform this integration, a general framework for Sequential Decision Making (SDM) would prove immensely useful, as…

人工智能 · 计算机科学 2025-01-07 Carlos Núñez-Molina , Pablo Mesejo , Juan Fernández-Olivares

Reinforcement learning (RL) has become a foundational approach for enabling intelligent robotic behavior in dynamic and uncertain environments. This work presents an in-depth review of RL principles, advanced deep reinforcement learning…

机器人学 · 计算机科学 2026-03-17 Kumater Ter , Abolanle Adetifa , Daniel Udekwe

Sequential decision making in the presence of uncertainty and stochastic dynamics gives rise to distributions over state/action trajectories in reinforcement learning (RL) and optimal control problems. This observation has led to a variety…

机器学习 · 计算机科学 2021-09-30 Jad Rahme , Ryan P. Adams

This paper proposes a novel termination criterion, termed the advantage gap function, for finite state and action Markov decision processes (MDP) and reinforcement learning (RL). By incorporating this advantage gap function into the design…

机器学习 · 计算机科学 2026-03-24 Caleb Ju , Guanghui Lan

Reinforcement learning (RL) tasks are typically framed as Markov Decision Processes (MDPs), assuming that decisions are made at fixed time intervals. However, many applications of great importance, including healthcare, do not satisfy this…

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

机器学习 · 计算机科学 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Action-constrained reinforcement learning (ACRL) is a generic framework for learning control policies with zero action constraint violation, which is required by various safety-critical and resource-constrained applications. The existing…

机器学习 · 计算机科学 2025-03-18 Wei Hung , Shao-Hua Sun , Ping-Chun Hsieh

Robotic systems operating in dynamic and uncertain environments increasingly require planners that satisfy complex task sequences while adhering to strict temporal constraints. Metric Interval Temporal Logic (MITL) offers a formal and…

机器人学 · 计算机科学 2026-01-05 Zhaoan Wang , Junchao Li , Mahdi Mohammad , Shaoping Xiao

This paper proposes an observer-based framework for solving Partially Observable Markov Decision Processes (POMDPs) when an accurate model is not available. We first propose to use a Moving Horizon Estimation-Model Predictive Control…

系统与控制 · 电气工程与系统科学 2021-03-23 Hossein Nejatbakhsh Esfahani , Arash Bahari Kordabad , Sebastien Gros

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

系统与控制 · 电气工程与系统科学 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

Model-predictive-control (MPC) offers an optimal control technique to establish and ensure that the total operation cost of multi-energy systems remains at a minimum while fulfilling all system constraints. However, this method presumes an…

The robust $\phi$-regularized Markov Decision Process (RRMDP) framework focuses on designing control policies that are robust against parameter uncertainties due to mismatches between the simulator (nominal) model and real-world settings.…

机器学习 · 计算机科学 2024-05-10 Kishan Panaganti , Adam Wierman , Eric Mazumdar

Discrete time stochastic optimal control problems and Markov decision processes (MDPs) are fundamental models for sequential decision-making under uncertainty and as such provide the mathematical framework underlying reinforcement learning…

最优化与控制 · 数学 2025-07-01 Arnulf Jentzen , Konrad Kleinberg , Thomas Kruse

In several reinforcement learning (RL) scenarios, mainly in security settings, there may be adversaries trying to interfere with the reward generating process. In this paper, we introduce Threatened Markov Decision Processes (TMDPs), which…

机器学习 · 计算机科学 2019-10-28 Victor Gallego , Roi Naveiro , David Rios Insua