English
Related papers

Related papers: Certainty Equivalent Quadratic Control for Markov …

200 papers

An optimal control problem is studied for a linear mean-field stochastic differential equation with a quadratic cost functional. The coefficients and the weighting matrices in the cost functional are all assumed to be deterministic.…

Optimization and Control · Mathematics 2016-02-26 Xun Li , Jingrui Sun , Jiongmin Yong

In this paper, we study a linear-quadratic optimal control problem for mean-field stochastic differential equations driven by a Poisson random martingale measure and a multidimensional Brownian motion. Firstly, the existence and uniqueness…

Optimization and Control · Mathematics 2016-10-12 Maoning Tang , Qingxin Meng

We study the closed-loop solvability of a stochastic linear quadratic optimal control problem for systems governed by stochastic evolution equations. This solvability is established by means of solvability of the corresponding Riccati…

Optimization and Control · Mathematics 2019-01-21 Qi Lü

Markov jump processes are widely used to model natural and engineered processes. In the context of biological or chemical applications one typically refers to the chemical master equation (CME), which models the evolution of the probability…

Optimization and Control · Mathematics 2017-07-05 Wei Zhang , Carsten Hartmann , Max von Kleist

We present a learning model predictive control (MPC) scheme for chance-constrained Markov jump systems with unknown switching probabilities. Using samples of the underlying Markov chain, ambiguity sets of transition probabilities are…

Optimization and Control · Mathematics 2023-01-06 Mathijs Schuurmans , Panagiotis Patrinos

This paper is concerned with a stochastic linear-quadratic optimal control problem of Markovian regime switching system with model uncertainty and partial information, where the information available to the control is based on a…

Optimization and Control · Mathematics 2026-01-09 Na Xiang , Jingtao Shi

We study unconstrained and constrained linear quadratic problems and investigate the suboptimality of the model predictive control (MPC) method applied to such problems. Considering MPC as an approximate scheme for solving the related fixed…

Optimization and Control · Mathematics 2023-06-06 Yuchao Li , Aren Karapetyan , John Lygeros , Karl H. Johansson , Jonas Mårtensson

In this paper, we study a stochastic linear-quadratic control problem with random coefficients and regime switching on a horizon $[0,T\wedge\tau]$, where $\tau$ is a given random jump time for the underlying state process and $T$ is a…

Optimization and Control · Mathematics 2022-01-19 Ying Hu , Xiaomin Shi , Zuo Quan Xu

In this paper, we consider the $H_{\infty}$ optimal control problem for a Markovian jump linear system (MJLS) over a lossy communication network. It is assumed that the controller communicates with each actuator through a different…

Systems and Control · Electrical Eng. & Systems 2019-11-05 Abhijit Mazumdar , Srinivasan Krishnaswamy , Somanath Majhi

In this paper, we consider the mixed optimal control of a linear stochastic system with a quadratic cost functional, with two controllers-one can choose only deterministic time functions, called the deterministic controller, while the other…

Optimization and Control · Mathematics 2017-08-23 Ying Hu , Shanjian Tang

Recent work by Mania et al. has proved that certainty equivalent control achieves nearly optimal regret for linear systems with quadratic costs. However, when parameter uncertainty is large, certainty equivalence cannot be relied upon to…

Optimization and Control · Mathematics 2020-01-01 Jack Umenberger , Thomas B. Schon

In this paper, we examine a stochastic linear-quadratic control problem characterized by regime switching and Poisson jumps. All the coefficients in the problem are random processes adapted to the filtration generated by Brownian motion and…

Optimization and Control · Mathematics 2024-12-30 Xiaomin Shi , Zuo Quan Xu

In this paper, we study the problem of optimizing the stability of positive semi-Markov jump linear systems. We specifically consider the problem of tuning the coefficients of the system matrices for maximizing the exponential decay rate of…

Systems and Control · Computer Science 2020-09-22 Chengyan Zhao , Masaki Ogura , Kenji Sugimoto

The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. The WNCSs with missing packets can be…

Systems and Control · Electrical Eng. & Systems 2021-03-22 Yuriy Zacchia Lun , Alessandro D'Innocenzo

This paper is concerned with a linear quadratic (LQ, for short) optimal control problem for mean-field backward stochastic differential equations (MF-BSDE, for short) driven by a Poisson random martingale measure and a Brownian motion.…

Optimization and Control · Mathematics 2016-11-22 Maoning Tang , Qingxin Meng

This paper is concerned with a general linear quadratic (LQ) control problem of mean-field backward stochastic differential equation (BSDE). Here, the weighting matrices in the cost functional are allowed to be indefinite. Necessary and…

Optimization and Control · Mathematics 2024-12-31 Wencan Wang , Huanjun Zhang

We propose a unified framework for robustly and adaptively stabilizing large-scale networked uncertain Markovian jump linear systems (MJLS) under external disturbances and mode switches that can change the network's topology. Adaptation is…

Systems and Control · Electrical Eng. & Systems 2024-08-29 SooJean Han , Minwoo M. Kim , Ieun Choo

In this paper, we present an optimal control problem for stochastic differential games under Markov regime-switching forward-backward stochastic differential equations with jumps and partial information. First, we prove a sufficient maximum…

Optimization and Control · Mathematics 2014-10-14 Olivier Menoukeu Pamen , Romual Herve Momeya

This research paper introduces a model-free optimal controller for discrete-time Markovian jump linear systems (MJLSs), employing principles from the methodology of reinforcement learning (RL). While Q-learning methods have demonstrated…

Systems and Control · Electrical Eng. & Systems 2024-08-07 Ehsan Badfar , Babak Tavassoli

We study a problem of utility maximization under model uncertainty with information including jumps. We prove first that the value process of the robust stochastic control problem is described by the solution of a quadratic-exponential…

Probability · Mathematics 2016-10-11 Monique Jeanblanc , Anis Matoussi , Armand Ngoupeyou