English
Related papers

Related papers: Optimal Control for Discrete-time Markov Jump Line…

200 papers

This paper gives a new solution to the output feedback H2 problem for quadratically invariant communication delay patterns. A characterization of all stabilizing controllers satisfying the delay constraints is given and the decentralized H2…

Systems and Control · Computer Science 2014-10-09 Andrew Lamperski , John C. Doyle

In this paper it is established that any jointly controllable, jointly observable, multi-channel, discrete or continuous time linear system with a strongly connected neighbor (communication) graph can be exponentially stabilized with any…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Fengjiao Liu , Lili Wang , Daniel Fullmer , A. Stephen Morse

This paper is concerned with the open-loop time-consistent solution of time-inconsistent mean-field stochastic linear-quadratic optimal control. Different from standard stochastic linear-quadratic problems, both the system matrices and the…

Optimization and Control · Mathematics 2016-08-19 Yuan-Hua Ni , Ji-Feng Zhang , Miroslav Krstic

Time delays are ubiquitous in industry, and they must be accounted for when designing control strategies. However, numerical optimal control (NOC) of delay differential equations (DDEs) is challenging because it requires specialized…

Optimization and Control · Mathematics 2024-10-22 Tobias K. S. Ritschel , Søren Stange

We study a problem of utility maximization under model uncertainty with information including jumps. We prove first that the value process of the robust stochastic control problem is described by the solution of a quadratic-exponential…

Probability · Mathematics 2016-10-11 Monique Jeanblanc , Anis Matoussi , Armand Ngoupeyou

- In this paper we introduce a new method to solve fixed-delay optimal control problems which exploits numerical homotopy procedures. It is known that solving this kind of problems via indirect methods is complex and computationally…

Optimization and Control · Mathematics 2017-03-16 Riccardo Bonalli , Bruno Hérissé , Emmanuel Trélat

We consider a class of closed loop stochastic optimal control problems in finite time horizon, in which the cost is an expectation conditional on the event that the process has not exited a given bounded domain. An important difficulty is…

Optimization and Control · Mathematics 2019-12-19 Yves Achdou , Mathieu Laurière , Pierre-Louis Lions

In this paper, we study state-feedback control of Markov jump linear systems with partial information. In particular, we assume that the controller can only access the mode signals according to a hidden-Markov observation process. Our…

Optimization and Control · Mathematics 2019-03-19 Masaki Ogura , Ahmet Cetinkaya , Tomohisa Hayakawa , Victor M. Preciado

Animal sensorimotor behavior is frequently modeled using optimal controllers. However, it is unclear how the neural circuits within the animal's nervous system implement optimal controller-like behavior. In this work, we study the question…

Systems and Control · Electrical Eng. & Systems 2025-03-21 Jing Shuang Li

The maximization of reach-avoid probabilities for stochastic systems is a central topic in the control literature. Yet, the available methods are either restricted to low-dimensional systems or suffer from conservative approximations. To…

Optimization and Control · Mathematics 2026-01-26 Niklas Schmid , Jaeyoun Choi , Oswin So , Chuchu Fan

In this paper, we consider continuous-time stochastic optimal control problems where the cost is evaluated through a coherent risk measure. We provide an explicit gradient descent-ascent algorithm which applies to problems subject to…

Optimization and Control · Mathematics 2023-06-23 Gabriel Velho , Jean Auriol , Riccardo Bonalli

In this paper, we establish a general stochastic maximum principle for optimal control for systems described by a continuous-time Markov regime-switching stochastic recursive utilities model. The control domain is postulated not to be…

Optimization and Control · Mathematics 2019-05-02 Liangquan Zhang , Xun Li

In this paper, we investigate an optimal control problem governed by parabolic equations with measure-valued controls over time. We establish the well-posedness of the optimal control problem and derive the first-order optimality condition…

Optimization and Control · Mathematics 2024-04-04 Wei Gong , Dongdong Liang

We study local structure of time-optimal controls and trajectories for a 3-dimensional control-affine system with a 2-dimensional control parameter with values in the disk. In particular, we give sufficient conditions, in terms of Lie…

Optimization and Control · Mathematics 2016-05-24 Andrei A. Agrachev , Carolina Biolo

Time-optimal control of a multi-rotor remains an open problem due to the under-actuation and nonlinearity of its dynamics, which make it difficult to solve this problem directly. In this paper, the time-optimal control problem of the…

Robotics · Computer Science 2024-01-12 Guangyu Zhang , Yongjie Zheng , Yuqing He , Liying Yang , Hongyu Nie , Chaoxiong Huang , Yiwen Zhao

Throughout this paper, we focused our aim on the problem of optimal control under a risk-sensitive performance functional, where the system is given by a fully coupled forward-backward stochastic differential equation with jump. The risk…

Optimization and Control · Mathematics 2019-03-07 Rania Khallout , Adel Chala

We consider an Ito stochastic differential equation with delay, driven by brownian motion, whose solution, by an appropriate reformulation, defines a Markov process $X$ with values in a space of continuous functions $\mathbf C$, with…

Probability · Mathematics 2013-04-10 Marco Fuhrman , Federica Masiero , Gianmario Tessitore

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

Systems and Control · Computer Science 2015-04-21 Jie Fu , Ufuk Topcu

This paper introduces a generalization of the well-known Riccati recursion for solving the discrete-time equality-constrained linear quadratic optimal control problem. The recursion can be used to compute the solutions as well as optimal…

Optimization and Control · Mathematics 2024-12-31 Lander Vanroye , Joris De Schutter , Wilm Decré

For general multi-hop queueing networks, delay optimal network control has unfortunately been an outstanding problem. The dynamic backpressure (BP) algorithm elegantly achieves throughput optimality, but does not yield good delay…

Information Theory · Computer Science 2015-04-22 Ying Cui , Edmund M. Yeh , Ran Liu