English
Related papers

Related papers: Ergodic Risk-Sensitive Control for Regime-Switchin…

200 papers

We study the asymptotic behavior of the principal eigenvalue of a weakly coupled, cooperative linear elliptic system in a stationary ergodic heterogeneous medium. The system arises as the so-called multigroup diffusion model for neutron…

Analysis of PDEs · Mathematics 2015-06-04 Scott N. Armstrong , Panagiotis E. Souganidis

The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar

In this paper we set up an optimal control framework for a hybrid stochastic system with dual or multiple Markov switching diffusion processes, while Markov chains governing these switching diffusions are not identical as assumed by the…

Optimization and Control · Mathematics 2020-11-02 Jianmin Shi

Risk-sensitive control has received considerable interest since the seminal work of Howard and Matheson [120] because of its ability to account for fluctuations about the mean, its connection with $H_\infty$ control, and its application to…

Optimization and Control · Mathematics 2023-01-03 Anup Biswas , Vivek S. Borkar

We study the relative value iteration for the ergodic control problem under a near-monotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasilinear parabolic Cauchy…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar , K. Suresh Kumar

In this article, we study the existence of insensitizing controls for a nonlinear reaction-diffusion equation with dynamic boundary conditions. Here, we have a partially unknown data of the system, and the problem consists in finding…

Optimization and Control · Mathematics 2024-07-16 Mauricio C. Santos , Nicolás Carreño , Roberto Morales

We study a class of ergodic BSDEs related to PDEs with Neumann boundary conditions. The randomness of the drift is given by a forward process under weakly dissipative assumptions with an invertible and bounded diffusion matrix. Furthermore,…

Probability · Mathematics 2015-01-16 Pierre-Yves Madec

In this paper we consider ergodic optimal control of a diffusion process $\{X^u_t\}_{t \geq 0}$, taking values in $\bR^n$, where both drift and volatility are controlled. We establish a novel strong duality between the existence of a unique…

Optimization and Control · Mathematics 2015-11-16 Samuel N. Cohen , Victor Fedyashov

We consider the infinite horizon risk-sensitive problem for nondegenerate diffusions with a compact action space, and controlled through the drift. We only impose a structural assumption on the running cost function, namely…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Anup Biswas

In this paper, we establish a general stochastic maximum principle for optimal control for systems described by a continuous-time Markov regime-switching stochastic recursive utilities model. The control domain is postulated not to be…

Optimization and Control · Mathematics 2019-05-02 Liangquan Zhang , Xun Li

In ergodic singular stochastic control problems, a decision-maker can instantaneously adjust the evolution of a state variable using a control of bounded variation, with the goal of minimizing a long-term average cost functional. The cost…

Optimization and Control · Mathematics 2025-10-14 Alessandro Calvia , Federico Cannerozzi , Giorgio Ferrari

This paper is devoted to an optimal control problem of fully coupled forward-backward stochastic differential equations driven by sub-diffusion, whose solutions are not Markov processes. The stochastic maximum principle is obtained, where…

Optimization and Control · Mathematics 2025-03-11 Chenhui Hao , Jingtao Shi , Shuaiqi Zhang

This paper investigates a singular stochastic control problem for a multi-dimensional regime-switching diffusion process confined in an unbounded domain. The objective is to maximize the total expected discounted rewards from exerting the…

Optimization and Control · Mathematics 2016-08-02 Qingshuo Song , Chao Zhu

We introduce and study the basic properties of two ergodic stochastic control problems associated with the quasistationary distribution (QSD) of a diffusion process $X$ relative to a bounded domain. The two problems are in some sense dual,…

Optimization and Control · Mathematics 2021-03-02 Amarjit Budhiraja , Paul Dupuis , Pierre Nyquist , Guo-Jhen Wu

We prove a sufficient stochastic maximum principle for the optimal control of a regime-switching diffusion model. We show the connection to dynamic programming and we apply the result to a quadratic loss minimization problem, which can be…

Optimization and Control · Mathematics 2014-01-31 Catherine Donnelly

In this paper, we discuss long-time behavior of sample paths for a wide range of regime-switching diffusions. Firstly, almost sure asymptotic stability is concerned (i) for regime-switching diffusions with finite state spaces by the…

Probability · Mathematics 2014-10-29 Junhao Hu , Jianhai Bao , Chenggui Yuan

This paper is concerned with a discounted stochastic optimal control problem for regime switching diffusion in an infinite horizon. First, as a preliminary with particular interests in its own right, the global well-posedness of infinite…

Optimization and Control · Mathematics 2026-02-06 Kai Ding , Xun Li , Siyu Lv , Xin Zhang

We treat the change point problem in ergodic diffusion processes from discrete observations. Tonaki et al. (2020) proposed adaptive tests for detecting changes in the diffusion and drift parameters in ergodic diffusion models. When any…

Statistics Theory · Mathematics 2021-02-16 Yozo Tonaki , Yusuke Kaino , Masayuki Uchida

We present a formulation of an optimal control problem for a two-dimensional diffusion process governed by a Fokker-Planck equation to achieve a nonequilibrium steady state with a desired circulation while accelerating convergence toward…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Norihisa Namura , Hiroya Nakao

Consider a stochastic nonlinear system controlled over a possibly noisy communication channel. An important problem is to characterize the largest class of channels for which there exist coding and control policies so that the closed-loop…

Optimization and Control · Mathematics 2021-02-11 Nicolas Garcia , Christoph Kawan , Serdar Yuksel