中文
相关论文

相关论文: A Markov Decision Process Framework for Early Mane…

200 篇论文

Markov decision processes (MDP) are a well-established model for sequential decision-making in the presence of probabilities. In robust MDP (RMDP), every action is associated with an uncertainty set of probability distributions, modelling…

人工智能 · 计算机科学 2024-12-16 Tobias Meggendorfer , Maximilian Weininger , Patrick Wienhöft

We consider the problem of learning an unknown Markov Decision Process (MDP) that is weakly communicating in the infinite horizon setting. We propose a Thompson Sampling-based reinforcement learning algorithm with dynamic episodes (TSDE).…

机器学习 · 计算机科学 2017-09-15 Yi Ouyang , Mukul Gagrani , Ashutosh Nayyar , Rahul Jain

We present Model Predictive Planning (MPP), a trajectory planner for low-agility vehicles such as a fixed-wing aircraft to navigate obstacle-laden environments. MPP consists of (1) a multi-path planning procedure that identifies candidate…

系统与控制 · 电气工程与系统科学 2024-09-17 Matthew T. Wallace , Brett Streetman , Laurent Lessard

We consider controller synthesis for stochastic and partially unknown environments in which safety is essential. Specifically, we abstract the problem as a Markov decision process in which the expected performance is measured using a cost…

软件工程 · 计算机科学 2015-10-21 Sebastian Junges , Nils Jansen , Christian Dehnert , Ufuk Topcu , Joost-Pieter Katoen

We consider the problem of controlling a Markov decision process (MDP) with a large state space, so as to minimize average cost. Since it is intractable to compete with the optimal policy for large scale problems, we pursue the more modest…

最优化与控制 · 数学 2014-02-28 Yasin Abbasi-Yadkori , Peter L. Bartlett , Alan Malek

This study develops a robot mobility policy based on deep reinforcement learning. Since traditional methods of conventional robotic navigation depend on accurate map reproduction as well as require high-end sensors, learning-based methods…

机器人学 · 计算机科学 2020-12-22 Minh Q. Tran , Ngoc Q. Ly

We present a method for pursuit/evasion that is highly efficient and and scales to large teams of aircraft. The underlying algorithm is an efficient algorithm for solving Markov Decision Processes (MDPs) that supports fully continuous state…

人工智能 · 计算机科学 2019-09-11 Joshua R. Bertram , Peng Wei

Computation of optimal recovery decisions for community resilience assurance post-hazard is a combinatorial decision-making problem under uncertainty. It involves solving a large-scale optimization problem, which is significantly aggravated…

最优化与控制 · 数学 2018-12-19 Yugandhar Sarkale , Saeed Nozhati , Edwin K. P. Chong , Bruce Ellingwood , Hussam Mahmoud

Search and rescue missions and surveillance require finding targets in a large area. These tasks often use unmanned aerial vehicles (UAVs) with cameras to detect and move towards a target. However, common UAV approaches make two simplifying…

人工智能 · 计算机科学 2018-01-08 Aayush Gupta , Daniel Bessonov , Patrick Li

In this paper, the aim is to develop a quantum counterpart to classical Markov decision processes (MDPs). Firstly, we provide a very general formulation of quantum MDPs with state and action spaces in the quantum domain, quantum…

量子物理 · 物理学 2024-09-19 Naci Saldi , Sina Sanjari , Serdar Yuksel

In this work, we consider the regret minimization problem for reinforcement learning in latent Markov Decision Processes (LMDP). In an LMDP, an MDP is randomly drawn from a set of $M$ possible MDPs at the beginning of the interaction, but…

机器学习 · 计算机科学 2021-02-10 Jeongyeol Kwon , Yonathan Efroni , Constantine Caramanis , Shie Mannor

In many real-world decision problems there is partially observed, hidden or latent information that remains fixed throughout an interaction. Such decision problems can be modeled as Latent Markov Decision Processes (LMDPs), where a latent…

机器学习 · 计算机科学 2024-06-27 Jeongyeol Kwon , Shie Mannor , Constantine Caramanis , Yonathan Efroni

Many control problems in environments that can be modeled as Markov decision processes (MDPs) concern infinite-time horizon specifications. The classical aim in this context is to compute a control policy that maximizes the probability of…

系统与控制 · 计算机科学 2017-05-03 Ruediger Ehlers , Salar Moarref , Ufuk Topcu

Vacant taxi drivers' passenger seeking process in a road network generates additional vehicle miles traveled, adding congestion and pollution into the road network and the environment. This paper aims to employ a Markov Decision Process…

机器学习 · 计算机科学 2020-02-04 Zhenyu Shou , Xuan Di , Jieping Ye , Hongtu Zhu , Hua Zhang , Robert Hampshire

In many real-world problems, there is the possibility to configure, to a limited extent, some environmental parameters to improve the performance of a learning agent. In this paper, we propose a novel framework, Configurable Markov Decision…

人工智能 · 计算机科学 2018-06-15 Alberto Maria Metelli , Mirco Mutti , Marcello Restelli

Model Predictive Control (MPC) is widely used in robot control by optimizing a sequence of control outputs over a finite-horizon. Computational approaches for MPC include deterministic methods (e.g., iLQR and COBYLA), as well as…

机器人学 · 计算机科学 2025-11-03 Zhaoxin Li , Xiaoke Wang , Letian Chen , Rohan Paleja , Subramanya Nageshrao , Matthew Gombolay

Markov decision processes (MDPs) are widely used for modeling decision-making problems in robotics, automated control, and economics. Traditional MDPs assume that the decision maker (DM) knows all states and actions. However, this may not…

人工智能 · 计算机科学 2014-07-29 Joseph Y. Halpern , Nan Rong , Ashutosh Saxena

Markov decision processes (MDPs) are widely used for modeling decision-making problems in robotics, automated control, and economics. Traditional MDPs assume that the decision maker (DM) knows all states and actions. However, this may not…

人工智能 · 计算机科学 2010-06-14 Joseph Y. Halpern , Nan Rong , Ashutosh Saxena

A crucial challenge to efficient and robust motion planning for autonomous vehicles is understanding the intentions of the surrounding agents. Ignoring the intentions of the other agents in dynamic environments can lead to risky or…

机器人学 · 计算机科学 2019-04-05 Xin Huang , Sungkweon Hong , Andreas Hofmann , Brian C. Williams

Active debris removal (ADR) missions have garnered significant interest as means of mitigating collision risks in space. This work proposes a convex optimization-based model predictive control (MPC) approach to provide guidance for such…

最优化与控制 · 数学 2023-08-21 Minduli Wijayatunga , Roberto Armellin , Harry Holt , Laura Pirovano , Claudio Bombardelli