English
Related papers

Related papers: Classical Adjoints for Ergodic Stochastic Control

200 papers

We show the strong well-posedness of SDEs driven by general multiplicative L\'evy noises with Sobolev diffusion and jump coefficients and integrable drift. Moreover, we also study the strong Feller property, irreducibility as well as the…

Probability · Mathematics 2017-05-23 Longjie Xie , Xicheng Zhang

We consider the bilinear optimal control of an advection-reaction-diffusion system, where the control arises as the velocity field in the advection term. Such a problem is generally challenging from both theoretical analysis and algorithmic…

Optimization and Control · Mathematics 2021-01-08 Roland Glowinski , Yongcun Song , Xiaoming Yuan , Hangrui Yue

This paper deals with a stochastic recursive optimal control problem, where the diffusion coefficient depends on the control variable and the control domain is not necessarily convex. We focus on the connection between the general maximum…

Optimization and Control · Mathematics 2016-12-21 Tianyang Nie , Jingtao Shi , Zhen Wu

In ergodic physical systems, time-averaged quantities converge (for large times) to their ensemble-averaged values. Large deviation theory describes rare events where these time averages differ significantly from the corresponding ensemble…

Statistical Mechanics · Physics 2020-05-20 Robert L. Jack

In the present paper we derive, via a backward induction technique, and ad hoc maximum principle for an optimal control problem with multiple random terminal times. Therefore we apply the aforementioned result to the case of a linear…

Optimization and Control · Mathematics 2019-12-03 Francesco Cordoni , Luca Di Persio

We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…

Machine Learning · Computer Science 2024-03-27 Julius Berner , Lorenz Richter , Karen Ullrich

This paper focuses on the discrete-time backward stochastic linear quadratic (BSLQ) optimal control problem with nonhomogeneous system terms and cost function cross terms. The terminal constraint of such systems distinguishes it from…

Optimization and Control · Mathematics 2026-04-14 Hu Ligui , Meng Qingxin , Tang Maoning

This paper investigates the exact controllability problem for multi-dimensional stochastic first-order symmetric hyperbolic systems with control inputs acting in two distinct ways: an internal control applied to the diffusion term and a…

Optimization and Control · Mathematics 2026-01-27 Zengyu Li , Qi Lü , Yu Wang , Haitian Yang

Let $\alpha\in(0,2)$ and $d\in\mathbb{N}$. Consider the following stochastic differential equation (SDE) driven by $\alpha$-stable process in $\mathbb{R}^d$: $$ dX_t=b(X_t)dt+\sigma(X_{t-})d L^{\alpha}_t, \quad X_0=x\in\mathbb{R}^d, $$…

Probability · Mathematics 2022-01-26 Xiaolong Zhang , Xicheng Zhang

We study zero-sum stochastic differential games with player dynamics governed by a nondegenerate controlled diffusion process. Under the assumption of uniform stability, we establish the existence of a solution to the Isaac's equation for…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar , K. Suresh Kumar

The verification theorem serving as an optimality condition for the optimal control problem, has been expected and studied for a long time. The purpose of this paper is to establish this theorem for control systems governed by stochastic…

Optimization and Control · Mathematics 2022-09-21 Liangying Chen , Qi Lü

Let $X$ be a one dimensional positive recurrent diffusion with initial distribution $\nu$ and invariant probability $\mu$. Suppose that for some $p> 1$, $\exists a\in\R$ such that $\forall x\in\R, \E_x T_a^p<\infty$ and $\E_\nu…

Probability · Mathematics 2010-01-25 Dasha Loukianova , Oleg Loukianov , Eva Loecherbach

In this note we consider a problem of stochastic optimal control with the infinite-time horizon. We present analogues of the Seierstad sufficient conditions of overtaking optimality based on the dual variables stochastic described by BSDEs…

Optimization and Control · Mathematics 2025-04-18 Anton O. Belyakov , Yuri M. Kabanov , Ivan A. Terekhov , Maxim M. Savinov

This paper is concerned with optimal control problems for systems governed by mean-field stochastic differential equation, in which the control enters both the drift and the diffusion coefficient. We prove that the relaxed state process,…

Optimization and Control · Mathematics 2017-02-03 Khaled Bahlali , Meriem Mezerdi , Brahim Mezerdi

We consider a simple model for the fluctuating hydrodynamics of a flexible polymer in dilute solution, demonstrating geometric ergodicity for a pair of particles that interact with each other through a nonlinear spring potential while being…

Probability · Mathematics 2012-07-24 Jonathan C. Mattingly , Scott A. McKinley , Natesh S. Pillai

We consider the problem of minimum energy steering of a linear stochastic system to a final prescribed distribution over a finite horizon and to maintain a stationary distribution over an infinite horizon. We present sufficient conditions…

Systems and Control · Computer Science 2014-10-14 Yongxin Chen , Tryphon Georgiou , Michele Pavon

We prove the convergence at an exponential rate towards the invariant probability measure for a class of solutions of stochastic differential equations with finite delay. This is done, in this non-Markovian setting, using the cluster…

Probability · Mathematics 2016-07-11 Laure Pédèches

Adjoints are used in optimization to speed-up computations, simplify optimality conditions or compute sensitivities. Because time is reversed in adjoint equations with first order time derivatives, boundary conditions and transmission…

Computational Engineering, Finance, and Science · Computer Science 2011-04-12 Frederic Alauzet , Olivier Pironneau

We extend to Lipschitz continuous functionals either of the true paths or of the Euler scheme with decreasing step of a wide class of Brownian ergodic diffusions, the Central Limit Theorems formally established for their marginal empirical…

Probability · Mathematics 2013-04-03 Gilles Pagès , Fabien Panloup

We consider the nonlinear optimal control of bypass transition in a boundary layer flow subjected to a pair of free stream vortical perturbations using a receding horizon approach. The optimal control problem is solved using the Lagrange…

Fluid Dynamics · Physics 2018-09-25 Dandan Xiao , George Papadakis