English
Related papers

Related papers: Lifting partial smoothing to solve HJB equations a…

200 papers

Optimal control problems are crucial in various domains, including path planning, robotics, and humanoid control, demonstrating their broad applicability. The connection between optimal control and Hamilton-Jacobi (HJ) partial differential…

Optimization and Control · Mathematics 2024-03-06 Tingwei Meng , Siting Liu , Wuchen Li , Stanley Osher

Recent studies have extended the use of the stochastic Hamilton-Jacobi-Bellman (HJB) equation to include complex variables for deriving quantum mechanical equations. However, these studies often assume that it is valid to apply the HJB…

Quantum Physics · Physics 2024-10-14 Vasil Yordanov

In this paper we develop a new approach to stochastic evolution equations with an unbounded drift $A$ which is dependent on time and the underlying probability space in an adapted way. It is well-known that the semigroup approach to…

Probability · Mathematics 2014-02-28 Matthijs Pronk , Mark Veraar

We study non-convex Hamilton-Jacobi equations in the presence of gradient constraints and produce new, optimal, regularity results for the solutions. A distinctive feature of those equations regards the existence of a lower bound to the…

Analysis of PDEs · Mathematics 2020-10-27 Héctor A. Chang-Lara , Edgard A. Pimentel

Computing optimal feedback controls for nonlinear systems generally requires solving Hamilton-Jacobi-Bellman (HJB) equations, which are notoriously difficult when the state dimension is large. Existing strategies for high-dimensional…

Optimization and Control · Mathematics 2021-04-09 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

We address the problem of computing a control for a time-dependent nonlinear system to reach a target set in a minimal time. To solve this minimal time control problem, we introduce a hierarchy of linear semi-infinite programs, the values…

Optimization and Control · Mathematics 2023-07-04 Antoine Oustry , Matteo Tacchi

In this paper we investigate the problem of controlling a partially observed stochastic dynamical system such that its state is difficult to infer using a (fixed-interval) Bayesian smoother. This problem arises naturally in applications in…

Systems and Control · Electrical Eng. & Systems 2021-03-25 Timothy L. Molloy , Girish N. Nair

We address finding the semi-global solutions to optimal feedback control and the Hamilton--Jacobi--Bellman (HJB) equation. Using the solution of an HJB equation, a feedback optimal control law can be implemented in real-time with minimum…

Optimization and Control · Mathematics 2016-06-17 Wei Kang , Lucas C. Wilcox

In this paper, we introduce a novel approach to solve the (mean-covariance) steering problem for a fairly general class of linear continuous-time stochastic systems subject to input delays. Specifically, we aim at steering delayed linear…

Optimization and Control · Mathematics 2023-11-27 Gabriel Velho , Riccardo Bonalli , Jean Auriol , Islam Boussaada

This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential…

Robotics · Computer Science 2014-09-23 Matanya B. Horowitz , Joel W. Burdick

In this article, the notion of viscosity solution is introduced for the path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with the optimal control problems for path-dependent stochastic differential equations. We identify…

Optimization and Control · Mathematics 2020-04-07 Jianjun Zhou

We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the…

Numerical Analysis · Mathematics 2019-07-16 Athena Picarelli , Christoph Reisinger , Julen Rotaetxe Arto

In this paper, we introduce a generalized dynamical unbalanced optimal transport framework by incorporating limited control input and mass dissipation, addressing limitations in conventional optimal transport for control applications. We…

Optimization and Control · Mathematics 2025-04-07 Dongjun Wu , Anders Rantzer

This work addresses stochastic optimal control problems where the unknown state evolves in continuous time while partial, noisy, and possibly controllable measurements are only available in discrete time. We develop a framework for…

Optimization and Control · Mathematics 2025-08-19 Christian Bayer , Boualem Djehiche , Eliza Rezvanova , Raul Fidel Tempone

In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is…

Optimization and Control · Mathematics 2018-07-16 Jinniao Qiu

This paper studies stochastic control problems motivated by optimal consumption with wealth benchmark tracking. The benchmark process is modeled by a combination of a geometric Brownian motion and a running maximum process, indicating its…

Optimization and Control · Mathematics 2024-04-26 Lijun Bo , Yijie Huang , Xiang Yu

We introduce a new hybrid control strategy, which is conceptually different from the commonly used synergistic hybrid approaches, to efficiently deal with the problem of the undesired equilibria that precludes smooth vectors fields on…

Optimization and Control · Mathematics 2021-08-03 Miaomiao Wang , Abdelhamid Tayebi

In this article, we provide a numerical method based on fitted finite volume method to approximate the Hamilton-Jacobi-Bellman (HJB) equation coming from stochastic optimal control problems. The computational challenge is due to the nature…

Numerical Analysis · Mathematics 2020-02-21 Christelle Dleuna Nyoumbi , Antoine Tambue

This work focuses on the well-posedness of abstract stochastic linear systems with boundary input delay and unbounded observation operators. We use product spaces and a semigroup approach to reformulate such delay systems into free-delay…

Optimization and Control · Mathematics 2021-12-28 Said Hadd , Fatima Zahra Lahbiri

We deal with a class of semilinear parabolic PDEs on the space of continuous functions that arise, for example, as Kolmogorov equations associated to the infinite-dimensional lifting of path-dependent SDEs. We investigate existence of…

Probability · Mathematics 2019-10-14 Federica Masiero , Carlo Orrieri , Gianmario Tessitore , Giovanni Zanco