中文
相关论文

相关论文: Markov Decision Processes For Multi-Objective Sate…

200 篇论文

Safe reinforcement learning has been a promising approach for optimizing the policy of an agent that operates in safety-critical applications. In this paper, we propose an algorithm, SNO-MDP, that explores and optimizes Markov decision…

机器学习 · 计算机科学 2020-08-18 Akifumi Wachi , Yanan Sui

The problem of constrained Markov decision process (CMDP) is investigated, where an agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its utilities/costs. A new primal-dual approach is…

最优化与控制 · 数学 2021-10-22 Tianjiao Li , Ziwei Guan , Shaofeng Zou , Tengyu Xu , Yingbin Liang , Guanghui Lan

Bayesian Optimisation has gained much popularity lately, as a global optimisation technique for functions that are expensive to evaluate or unknown a priori. While classical BO focuses on where to gather an observation next, it does not…

机器人学 · 计算机科学 2017-03-14 Philippe Morere , Roman Marchant , Fabio Ramos

The Skolem problem and the related Positivity problem for linear recurrence sequences are outstanding number-theoretic problems whose decidability has been open for many decades. In this paper, the inherent mathematical difficulty of a…

计算机科学中的逻辑 · 计算机科学 2020-04-27 Jakob Piribauer , Christel Baier

In most common settings of Markov Decision Process (MDP), an agent evaluate a policy based on expectation of (discounted) sum of rewards. However in many applications this criterion might not be suitable from two perspective: first, in risk…

人工智能 · 计算机科学 2017-05-11 Yan Li , Zhaohan Sun

This paper studies motion planning of a mobile robot under uncertainty. The control objective is to synthesize a {finite-memory} control policy, such that a high-level task specified as a Linear Temporal Logic (LTL) formula is satisfied…

机器人学 · 计算机科学 2017-10-24 Meng Guo , Michael M. Zavlanos

Markov Decision Processes (MDPs) are a mathematical framework for modeling sequential decision making under uncertainty. The classical approaches for solving MDPs are well known and have been widely studied, some of which rely on…

机器学习 · 计算机科学 2018-05-18 Joshua R. Bertram , Xuxi Yang , Peng Wei

Since the next-generation satellite network consisting of various service function domains, such as communication, observation, navigation, etc., is moving towards large-scale, using single-domain resources is difficult to provide satisfied…

系统与控制 · 电气工程与系统科学 2023-12-18 Chenxi Bao , Di Zhou , Min Sheng , Yan Shi , Jiandong Li

In the current paper, we present an optimization system solving multi objective production scheduling problems (MOOPPS). The identification of Pareto optimal alternatives or at least a close approximation of them is possible by a set of…

人工智能 · 计算机科学 2008-09-08 Martin Josef Geiger

In the context of railway systems, the application performance can be very critical and the radio conditions not advantageous. Hence, the communication problem parameters include both a survival time stemming from the application layer and…

信息论 · 计算机科学 2023-03-22 Vincent Corlay , Jean-Christophe Sibel

We consider the problem of solving robust Markov decision process (MDP), which involves a set of discounted, finite state, finite action space MDPs with uncertain transition kernels. The goal of planning is to find a robust policy that…

机器学习 · 计算机科学 2023-06-13 Yan Li , Guanghui Lan , Tuo Zhao

Constrained Markov Decision Processes (CMDPs) formalize sequential decision-making problems whose objective is to minimize a cost function while satisfying constraints on various cost functions. In this paper, we consider the setting of…

机器学习 · 计算机科学 2020-09-25 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

Active classification, i.e., the sequential decision-making process aimed at data acquisition for classification purposes, arises naturally in many applications, including medical diagnosis, intrusion detection, and object tracking. In this…

系统与控制 · 计算机科学 2018-10-02 Bo Wu , Mohamadreza Ahmadi , Suda Bharadwaj , Ufuk Topcu

We propose a novel generalization of constrained Markov decision processes (CMDPs) that we call the \emph{semi-infinitely constrained Markov decision process} (SICMDP). Particularly, we consider a continuum of constraints instead of a…

机器学习 · 计算机科学 2023-05-02 Liangyu Zhang , Yang Peng , Wenhao Yang , Zhihua Zhang

Non-stationary domains, where unforeseen changes happen, present a challenge for agents to find an optimal policy for a sequential decision making problem. This work investigates a solution to this problem that combines Markov Decision…

人工智能 · 计算机科学 2017-05-04 Leonardo A. Ferreira , Reinaldo A. C. Bianchi , Paulo E. Santos , Ramon Lopez de Mantaras

Managing announced task completion times is a fundamental control problem in project management. While extensive research exists on estimating task durations and task scheduling, the problem of when and how to update completion times…

系统与控制 · 电气工程与系统科学 2026-03-17 Duncan Eddy , Esen Yel , Emma Passmore , Niles Egan , Grayson Armour , Dylan M. Asmar , Mykel J. Kochenderfer

We propose MDP-GapE, a new trajectory-based Monte-Carlo Tree Search algorithm for planning in a Markov Decision Process in which transitions have a finite support. We prove an upper bound on the number of calls to the generative models…

A constrained Markov decision process (CMDP) approach is developed for response-adaptive procedures in clinical trials with binary outcomes. The resulting CMDP class of Bayesian response -- adaptive procedures can be used to target a…

统计方法学 · 统计学 2024-01-31 Stef Baas , Aleida Braaksma , Richard J. Boucherie

This paper addresses the online motion planning problem of mobile robots under complex high-level tasks. The robot motion is modeled as an uncertain Markov Decision Process (MDP) due to limited initial knowledge, while the task is specified…

机器人学 · 计算机科学 2023-02-13 Yuyang Zhang , Meng Guo

In a Shared Mobility on Demand Service (SMoDS), dynamic pricing plays an important role in the form of an incentive for the decision of the empowered passenger on the ride offer. Strategies for determining the dynamic tariff should be…

最优化与控制 · 数学 2020-07-06 Yue Guan , Anuradha M. Annaswamy , H. Eric Tseng