English
Related papers

Related papers: Risk-sensitive control of reflected diffusion proc…

200 papers

Reaction-diffusion systems offer a powerful framework for understanding self-organized patterns in biological systems, yet controlling these patterns remains a significant challenge. As a consequence, we present a rigorous framework of…

Optimization and Control · Mathematics 2026-04-13 Mohamed Amine Ouchdiri , Hamza Faquir , Saad Benjelloun , Mohamed Adlene Maghenem , Irene Otero-Muras , Adnane Saoud

This paper studies optimal time-bounded control in multi-mode systems with discrete costs. Multi-mode systems are an important subclass of linear hybrid systems, in which there are no guards on transitions and all invariants are global.…

Logic in Computer Science · Computer Science 2017-06-30 Mahmoud A. A. Mousa , Sven Schewe , Dominik Wojtczak

We consider the problem of finite-horizon optimal control of a discrete linear time-varying system subject to a stochastic disturbance and fully observable state. The initial state of the system is drawn from a known Gaussian distribution,…

Optimization and Control · Mathematics 2017-11-08 Maxim Goldshtein , Panagiotis Tsiotras

We consider a large family of discrete and continuous time controlled Markov processes and study an ergodic risk-sensitive minimization problem. Under a blanket stability assumption, we provide a complete analysis to this problem. In…

Optimization and Control · Mathematics 2022-07-18 Anup Biswas , Somnath Pradhan

This work concerns controlled Markov chains with finite state and action spaces. The transition law satisfies the simultaneous Doeblin condition, and the performance of a control policy is measured by the (long-run) risk-sensitive average…

Probability · Mathematics 2007-05-23 Rolando Cavazos-Cadena , Daniel Hernandez-Hernandez

We study risk-sensitive control of continuous time Markov chains taking values in discrete state space. We study both finite and infinite horizon problems. In the finite horizon problem we characterise the value function via HJB equation…

Optimization and Control · Mathematics 2014-09-16 Mrinal K. Ghosh , Subhamay Saha

This paper investigates the near optimal control for a kind of linear stochastic control systems governed by the forward backward stochastic differential equations, where both the drift and diffusion terms are allowed to depend on controls…

Optimization and Control · Mathematics 2015-01-23 Liangquan Zhang , Jianhui Huang , Xun Li

We consider the bilinear optimal control of an advection-reaction-diffusion system, where the control arises as the velocity field in the advection term. Such a problem is generally challenging from both theoretical analysis and algorithmic…

Optimization and Control · Mathematics 2021-01-08 Roland Glowinski , Yongcun Song , Xiaoming Yuan , Hangrui Yue

We consider a two-sided singular stochastic control problem with a risk-sensitive ergodic criterion. In particular, we consider a stochastic system whose uncontrolled dynamics are modelled by a linear diffusion. The control that can be…

Optimization and Control · Mathematics 2025-09-15 Justin Gwee , Mihail Zervos

This paper considers a risk-constrained infinite-horizon optimal control problem and proposes to solve it in an iterative manner. Each iteration of the algorithm generates a trajectory from the starting point to the target equilibrium state…

Optimization and Control · Mathematics 2021-11-29 Alireza Zolanvari , Ashish Cherukuri

We study the infinite-horizon distributionally robust (DR) control of linear systems with quadratic costs, where disturbances have unknown, possibly time-correlated distribution within a Wasserstein-2 ambiguity set. We aim to minimize the…

Optimization and Control · Mathematics 2024-06-12 Taylan Kargin , Joudi Hajar , Vikrant Malik , Babak Hassibi

We address the variational formulation of the risk-sensitive reward problem for non-degenerate diffusions on $\mathbb{R}^d$ controlled through the drift. We establish a variational formula on the whole space and also show that the…

Analysis of PDEs · Mathematics 2021-01-01 Ari Arapostathis , Anup Biswas , Vivek S. Borkar , K. Suresh Kumar

In this paper long-run risk sensitive optimisation problem is studied with dyadic impulse control applied to continuous-time Feller-Markov process. In contrast to the existing literature, focus is put on unbounded and non-uniformly ergodic…

Optimization and Control · Mathematics 2019-06-18 Marcin Pitera , Łukasz Stettner

We consider a controlled-diffusion process pertaining to a chain of distributed systems with random perturbations that satisfies a weak H\"ormander type condition. In particular, we consider a stochastic control problem with the following…

Optimization and Control · Mathematics 2015-09-29 Getachew K. Befekadu , Eduardo L. Pasiliao

This paper considers the problem of designing time-dependent, real-time control policies for controllable nonlinear diffusion processes, with the goal of obtaining maximally-informative observations about parameters of interest. More…

Methodology · Statistics 2014-10-16 Giles Hooker , Kevin K. Lin , Bruce Rogers

Asymptotic stability in receding horizon control is obtained under a strict pre-dissipativity assumption, in the presence of suitable state constraints. In this paper we analyze how terminal constraints can be replaced by suitable terminal…

Optimization and Control · Mathematics 2025-01-08 Mario Zanon , Lars Grüne

We consider a piecewise deterministic Markov decision process, where the expected exponential utility of total (nonnegative) cost is to be minimized. The cost rate, transition rate and post-jump distributions are under control. The state…

Optimization and Control · Mathematics 2017-11-22 Xin Guo , Yi Zhang

We study stochastic optimal control problems for (possibly degenerate) McKean-Vlasov controlled diffusions and obtain discrete-time as well as finite interacting particle approximations. (i) Under mild assumptions, we first prove the…

Optimization and Control · Mathematics 2025-10-27 Somnath Pradhan , Serdar Yuksel

We consider a classical stochastic control problem in which a diffusion process is controlled by a withdrawal process up to a termination time. The objective is to maximize the expected discounted value of the withdrawals until the…

Probability · Mathematics 2024-06-19 Hélène Guérin , Dante Mata , Jean-François Renaud , Alexandre Roch

We use one-step conditional risk mappings to formulate a risk averse version of a total cost problem on a controlled Markov process in discrete time infinite horizon. The nonnegative one step costs are assumed to be lower semi-continuous…

Optimization and Control · Mathematics 2018-06-05 Kerem Ugurlu