中文
相关论文

相关论文: Reinforcement Learning with Temporal Logic Constra…

200 篇论文

Partially observable Markov decision processes (POMDPs) are a general framework for sequential decision-making under latent state uncertainty, yet learning in POMDPs is intractable in the worst case. Motivated by sensing and probing…

机器学习 · 计算机科学 2026-01-27 Ming Shi , Yingbin Liang , Ness B. Shroff

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

机器学习 · 计算机科学 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

人工智能 · 计算机科学 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

This paper investigates the problem of designing control policies that satisfy high-level specifications described by signal temporal logic (STL) in unknown, stochastic environments. While many existing works concentrate on optimizing the…

系统与控制 · 电气工程与系统科学 2024-12-16 Siqi Wang , Shaoyuan Li , Li Yin , Xiang Yin

This paper proposes an integration of temporal logical reasoning and Partially Observable Markov Decision Processes (POMDPs) to achieve interpretable decision-making under uncertainty with macro-actions. Our method leverages a fragment of…

人工智能 · 计算机科学 2025-05-07 Celeste Veronese , Daniele Meli , Alessandro Farinelli

Recent work has considered trust-aware decision making for human-robot collaboration (HRC) with a focus on model learning. In this paper, we are interested in enabling the HRC system to complete complex tasks specified using temporal logic…

机器人学 · 计算机科学 2023-10-03 Pian Yu , Shuyang Dong , Shili Sheng , Lu Feng , Marta Kwiatkowska

Mixed observable Markov decision processes (MOMDPs) are a modeling framework for autonomous systems described by both fully and partially observable states. In this work, we study the problem of synthesizing a control policy for MOMDPs that…

系统与控制 · 电气工程与系统科学 2021-03-03 Ugo Rosolia , Mohamadreza Ahmadi , Richard M. Murray , Aaron D. Ames

We propose a novel constrained reinforcement learning method for finding optimal policies in Markov Decision Processes while satisfying temporal logic constraints with a desired probability throughout the learning process. An…

机器人学 · 计算机科学 2021-09-07 Derya Aksaray , Yasin Yazicioglu , Ahmet Semi Asarkaya

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

机器人学 · 计算机科学 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP) with unknown transition probabilities over continuous state and action spaces. Linear temporal logic (LTL) is used to…

机器学习 · 计算机科学 2022-01-25 Mingyu Cai , Mohammadhosein Hasanbeig , Shaoping Xiao , Alessandro Abate , Zhen Kan

We consider the reinforcement learning problem for the constrained Markov decision process (CMDP), which plays a central role in satisfying safety or resource constraints in sequential learning and decision-making. In this problem, we are…

机器学习 · 计算机科学 2025-11-19 Jiashuo Jiang , Yinyu Ye

Reinforcement Learning (RL) is a widely employed machine learning architecture that has been applied to a variety of control problems. However, applications in safety-critical domains require a systematic and formal approach to specifying…

机器学习 · 计算机科学 2023-06-07 Hosein Hasanbeig , Daniel Kroening , Alessandro Abate

We study reinforcement learning for partially observed Markov decision processes (POMDPs) with infinite observation and state spaces, which remains less investigated theoretically. To this end, we make the first attempt at bridging partial…

机器学习 · 计算机科学 2024-04-02 Qi Cai , Zhuoran Yang , Zhaoran Wang

The current reinforcement learning framework focuses exclusively on performance, often at the expense of efficiency. In contrast, biological control achieves remarkable performance while also optimizing computational energy expenditure and…

人工智能 · 计算机科学 2024-11-01 Devdhar Patel , Terrence Sejnowski , Hava Siegelmann

This paper proposes an observer-based framework for solving Partially Observable Markov Decision Processes (POMDPs) when an accurate model is not available. We first propose to use a Moving Horizon Estimation-Model Predictive Control…

系统与控制 · 电气工程与系统科学 2021-03-23 Hossein Nejatbakhsh Esfahani , Arash Bahari Kordabad , Sebastien Gros

Unlike traditional reinforcement learning (RL), market-based RL is in principle applicable to worlds described by partially observable Markov Decision Processes (POMDPs), where an agent needs to learn short-term memories of relevant…

人工智能 · 计算机科学 2007-05-23 Ivo Kwee , Marcus Hutter , Juergen Schmidhuber

Many physical systems have underlying safety considerations that require that the policy employed ensures the satisfaction of a set of constraints. The analytical formulation usually takes the form of a Constrained Markov Decision Process…

机器学习 · 计算机科学 2021-03-03 Aria HasanzadeZonuzy , Archana Bura , Dileep Kalathil , Srinivas Shakkottai

We propose an actor-critic, model-free, and online Reinforcement Learning (RL) framework for continuous-state continuous-action Markov Decision Processes (MDPs) when the reward is highly sparse but encompasses a high-level temporal…

机器学习 · 计算机科学 2019-11-26 Lim Zun Yuan , Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

We present a probabilistic logic programming framework to reinforcement learning, by integrating reinforce-ment learning, in POMDP environments, with normal hybrid probabilistic logic programs with probabilistic answer set seman-tics, that…

人工智能 · 计算机科学 2010-11-30 Emad Saad

Reinforcement learning algorithms are typically designed for generic Markov Decision Processes (MDPs), where any state-action pair can lead to an arbitrary transition distribution. In many practical systems, however, only a subset of the…

机器学习 · 计算机科学 2026-03-05 Davide Maran , Davide Salaorni , Marcello Restelli