English
Related papers

Related papers: State-dependent temperature control in Langevin di…

200 papers

The aim of this work is to deal with a discontinuous Hamilton-Jacobi equation in the whole euclidian N-dimensional space, associated to a possibly unbounded optimal control problem. Here, the discontinuities are located on a hyperplane and…

Optimization and Control · Mathematics 2024-05-16 Emmanuel Chasseigne , Robson Carlos Reis , Silvia Sastre-Gomez

We introduce a new numerical method to approximate the solution of a finite horizon deterministic optimal control problem. We exploit two Hamilton-Jacobi-Bellman PDE, arising by considering the dynamics in forward and backward time. This…

Optimization and Control · Mathematics 2023-04-21 Marianne Akian , Stéphane Gaubert , Shanqing Liu

In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…

Probability · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

In this article we study a finite horizon optimal control problem with monotone controls. We consider the associated Hamilton-Jacobi-Bellman (HJB) equation which characterizes the value function. We consider the totally discretized problem…

Optimization and Control · Mathematics 2014-07-08 Eduardo A. Philipp , Laura S. Aragone , Lisandro A. Parente

We derive the equations governing the protocols minimizing the heat released by a continuous-time Markov jump process on a one-dimensional countable state space during a transition between assigned initial and final probability…

Statistical Mechanics · Physics 2021-10-15 Paolo Muratore-Ginanneschi , Carlos Mejía-Monasterio , Luca Peliti

The state-dependent diffusion, which concerns the Brownian motion of a particle in inhomogeneous media has been described phenomenologically in a number of ways. Based on a system-reservoir nonlinear coupling model we present a microscopic…

Statistical Mechanics · Physics 2007-05-23 Debashis Barik , Deb Shankar Ray

This paper presents a two-stage framework for constrained near-optimal feedback control of input-affine nonlinear systems. An approximate value function for the unconstrained control problem is computed offline by solving the…

Systems and Control · Electrical Eng. & Systems 2026-03-18 Milad Alipour Shahraki , Laurent Lessard

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…

Quantum Physics · Physics 2009-03-06 Viacheslav P. Belavkin , Antonio Negretti , Klaus Molmer

We analyse the problem of estimating a scalar parameter $g$ that controls the Hamiltonian of a quantum system subject to Markovian noise. Specifically, we place bounds on the growth rate of the quantum Fisher information with respect to…

Quantum Physics · Physics 2022-08-11 Kianna Wan , Robert Lasenby

We study non-convex Hamilton-Jacobi equations in the presence of gradient constraints and produce new, optimal, regularity results for the solutions. A distinctive feature of those equations regards the existence of a lower bound to the…

Analysis of PDEs · Mathematics 2020-10-27 Héctor A. Chang-Lara , Edgard A. Pimentel

Stochastic optimal principle leads to the resolution of a partial differential equation (PDE), namely the Hamilton-Jacobi-Bellman (HJB) equation. In general, this equation cannot be solved analytically, thus numerical algorithms are the…

Numerical Analysis · Mathematics 2021-09-14 Christelle Dleuna Nyoumbi , Antoine Tambue

In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic evolution equations in Hilbert…

Probability · Mathematics 2020-09-14 Jianjun Zhou

This report concerns the inverse problem of estimating a spacially dependent coefficient of a partial differential equation from observations of the solution at the boundary. Such a problem can be formulated as an optimal control problem…

Optimization and Control · Mathematics 2008-09-23 Jesper Carlsson

Many physical systems characterized by nonlinear multiscale interactions can be effectively modeled by treating unresolved degrees of freedom as random fluctuations. However, even when the microscopic governing equations and qualitative…

Statistical Mechanics · Physics 2021-06-07 Jared L. Callaham , Jean-Christophe Loiseau , Georgios Rigas , Steven L. Brunton

In this paper we propose a new computational method for designing optimal regulators for high-dimensional nonlinear systems. The proposed approach leverages physics-informed machine learning to solve high-dimensional Hamilton-Jacobi-Bellman…

Optimization and Control · Mathematics 2021-04-09 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

Stochastic optimal control problems for Hamiltonian dynamics on graphs have wide-ranging applications in mechanics and quantum field theory, particularly in systems with graph-based structures. In this paper, we establish the existence and…

Optimization and Control · Mathematics 2025-10-01 Jianbo Cui , Tonghe Dang

We study a multiscale stochastic optimal control problem subject to state constraints on the slow variable. To address this class of problems, we develop a rigorous theoretical framework based on singular perturbation analysis, tailored to…

Optimization and Control · Mathematics 2025-08-12 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional It\^o calculus, we build the dynamic programming principle…

Optimization and Control · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

This paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation.…

Computational Finance · Quantitative Finance 2024-10-15 Ashley Davey , Harry Zheng

A gradient-enhanced functional tensor train cross approximation method for the resolution of the Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control of nonlinear dynamics is presented. The procedure uses samples…

Numerical Analysis · Mathematics 2023-02-23 Sergey Dolgov , Dante Kalise , Luca Saluzzi