English
Related papers

Related papers: Attack Impact Evaluation by Exact Convexification …

200 papers

Reinforcement Learning is a powerful framework for training agents to navigate different situations, but it is susceptible to changes in environmental dynamics. However, solving Markov Decision Processes that are robust to changes is…

Machine Learning · Computer Science 2024-06-21 Etash Kumar Guha

We consider stochastic model predictive control of a multi-agent systems with constraints on the probabilities of inter-agent collisions. We first study a sample-based approximation of the collision probabilities and use this approximation…

Systems and Control · Computer Science 2011-08-17 Daniel Lyons , Jan-P. Calliess , Uwe D. Hanebeck

This paper studies continuous-time Markov decision processes under the risk-sensitive average cost criterion. The state space is a finite set, the action space is a Borel space, the cost and transition rates are bounded, and the…

Optimization and Control · Mathematics 2015-12-22 Qingda Wei , Xian Chen

We investigate the problem of designing optimal stealthy poisoning attacks on the control channel of Markov decision processes (MDPs). This research is motivated by the recent interest of the research community for adversarial and poisoning…

Systems and Control · Electrical Eng. & Systems 2021-09-16 Alessio Russo , Alexandre Proutiere

In various game scenarios, selecting a fixed number of targets from multiple enemy units is an extremely challenging task. This difficulty stems from the complex relationship between the threat levels of enemy units and their feature…

Machine Learning · Computer Science 2025-04-28 Wuzhou Sun , Siyi Li , Qingxiang Zou , Zixing Liao

Relying on the careful study of a related problem in the calculus of variations, we study a class of optimal control problems in which the control lies on the acceleration, with state constraints on the position variable. In dimension one,…

Optimization and Control · Mathematics 2025-10-10 Yves Achdou

On a weakly Blackwell space we show how to define a Markov chain approximating problem, for the target problem. The approximating problem is proved to converge to the optimal reduced problem under different pseudometrics. A computational…

Probability · Mathematics 2009-01-14 Giacomo Aletti , Diane Saada

In this paper the connection between stochastic optimal control and reinforcement learning is investigated. Our main motivation is to apply importance sampling to sampling rare events which can be reformulated as an optimal control problem.…

Optimization and Control · Mathematics 2024-02-16 Jannes Quer , Enric Ribera Borrell

Risk-bounded motion planning is an important yet difficult problem for safety-critical tasks. While existing mathematical programming methods offer theoretical guarantees in the context of constrained Markov decision processes, they either…

Machine Learning · Computer Science 2021-08-05 Xin Huang , Meng Feng , Ashkan Jasour , Guy Rosman , Brian Williams

We study the problem of learning Markov decision processes with finite state and action spaces when the transition probability distributions and loss functions are chosen adversarially and are allowed to change with time. We introduce an…

Machine Learning · Computer Science 2013-03-14 Yasin Abbasi-Yadkori , Peter L. Bartlett , Csaba Szepesvari

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

Optimization and Control · Mathematics 2019-12-09 Ather Gattami

In a variety of applications, an agent's success depends on the knowledge that an adversarial observer has or can gather about the agent's decisions. It is therefore desirable for the agent to achieve a task while reducing the ability of an…

Optimization and Control · Mathematics 2018-09-19 Mustafa O. Karabag , Melkior Ornik , Ufuk Topcu

The paper provides an overview of the theory and applications of risk-sensitive Markov decision processes. The term 'risk-sensitive' refers here to the use of the Optimized Certainty Equivalent as a means to measure expectation and risk.…

Risk Management · Quantitative Finance 2025-09-23 Nicole Bäuerle , Anna Jaśkiewicz

This paper presents an interpretable reward design framework for reinforcement learning based constrained optimal control problems with state and terminal constraints. The problem is formalized within a standard partially observable Markov…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Jingjie Ni , Fangfei Li , Xin Jin , Xianlun Peng , Yang Tang

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

Machine Learning · Computer Science 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

We propose a novel constrained reinforcement learning method for finding optimal policies in Markov Decision Processes while satisfying temporal logic constraints with a desired probability throughout the learning process. An…

Robotics · Computer Science 2021-09-07 Derya Aksaray , Yasin Yazicioglu , Ahmet Semi Asarkaya

This paper investigates large-population stochastic control problems in which agents share their state information and cooperate to minimize a convex cost functional. The latter is decomposed into individual and coupling costs, with the…

Optimization and Control · Mathematics 2025-10-28 Elise Devey

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

Systems and Control · Computer Science 2015-04-21 Jie Fu , Ufuk Topcu

We consider the problem of learning the optimal policy for Markov decision processes with safety constraints. We formulate the problem in a reach-avoid setup. Our goal is to design online reinforcement learning algorithms that ensure safety…

Machine Learning · Computer Science 2026-01-21 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Designing policies for a network of agents is typically done by formulating an optimization problem where each agent has access to state measurements of all the other agents in the network. Such policy designs with centralized information…

Optimization and Control · Mathematics 2024-05-02 Georgios Darivianakis , Angelos Georghiou , Soroosh Shafiee , John Lygeros