English
Related papers

Related papers: Inverse stochastic optimal controls

200 papers

In this paper, we study a stochastic optimal control problem under a type of consistent convex expectation dominated by G-expectation. By the separation theorem for convex sets, we get the representation theorems for this convex expectation…

Optimization and Control · Mathematics 2024-08-21 Xiaojuan Li , Mingshang Hu

This paper presents a novel operator-theoretic approach for optimal control of nonlinear stochastic systems within reproducing kernel Hilbert spaces. Our learning framework leverages data samples of system dynamics and stage cost functions,…

Optimization and Control · Mathematics 2025-04-28 Petar Bevanda , Nicolas Hoischen , Tobias Wittmann , Jan Brüdigam , Sandra Hirche , Boris Houska

In this paper, an open problem is solved, for the stochastic optimal control problem with delay where the control domain is nonconvex and the diffusion term contains both control and its delayed term. Inspired by previous results by \O…

Optimization and Control · Mathematics 2020-07-14 Weijun Meng , Jingtao Shi

A Deterministic affine quadratic optimal control problem is considered. Due to the nature of the problem, optimal controls exist under some very mild conditions. Further, it is shown that under some assumptions, the value function is…

Optimization and Control · Mathematics 2019-02-20 Yuanchang Wang , Jiongmin Yong

We consider a class of exit time stochastic control problems for diffusion processes with discounted criterion, where the controller can utilize a given amount of resource, called "fuel". In contrast to the vast majority of existing…

Optimization and Control · Mathematics 2015-01-30 Dmitry B. Rokhlin , Georgii Mironenko

In this paper, we investigate a sparse optimal control of continuous-time stochastic systems. We adopt the dynamic programming approach and analyze the optimal control via the value function. Due to the non-smoothness of the $L^0$ cost…

Optimization and Control · Mathematics 2021-09-17 Kaito Ito , Takuya Ikeda , Kenji Kashima

In this paper, we develop a theoretical framework for nonlinear stochastic optimal control problems with optimal stopping by establishing a density-based deterministic representation of the underlying diffusion. For state-independent…

Optimization and Control · Mathematics 2026-04-15 Akan Selim , Siddhartha Ganguly , Ali Pakniyat , Panagiotis Tsiotras

We consider a class of closed loop stochastic optimal control problems in finite time horizon, in which the cost is an expectation conditional on the event that the process has not exited a given bounded domain. An important difficulty is…

Optimization and Control · Mathematics 2019-12-19 Yves Achdou , Mathieu Laurière , Pierre-Louis Lions

A new approach to feedback control design based on optimal control is proposed. Instead of expensive computations of the value function for different penalties on the states and inputs, we use a control Lyapunov function that amounts to be…

Optimization and Control · Mathematics 2021-11-22 Taouba Jouini , Anders Rantzer

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…

Probability · Mathematics 2017-10-24 Ruoting Gong , Christian Houdré

We consider a pathwise stochastic optimal control problem and study the associated (not necessarily adapted) Hamilton-Jacobi-Bellman stochastic partial differential equation. We show that the value process is the unique solution of this…

Probability · Mathematics 2023-11-02 Neeraj Bhauryal , Ana Bela Cruzeiro , Carlos Oliveira

Optimal control of diffusion processes is intimately connected to the problem of solving certain Hamilton-Jacobi-Bellman equations. Building on recent machine learning inspired approaches towards high-dimensional PDEs, we investigate the…

Optimization and Control · Mathematics 2023-01-31 Nikolas Nüsken , Lorenz Richter

We explore the approximation of feedback control of integro-differential equations containing a fractional Laplacian term. To obtain feedback control for the state variable of this nonlocal equation we use the Hamilton--Jacobi--Bellman…

Optimization and Control · Mathematics 2022-10-19 Alessandro Alla , Marta D'Elia , Christian Glusa , Hugo Oliveira

In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is…

Optimization and Control · Mathematics 2018-07-16 Jinniao Qiu

In this paper we present a novel sampling-based numerical scheme designed to solve a certain class of stochastic optimal control problems, utilizing forward and backward stochastic differential equations (FBSDEs). By means of a nonlinear…

Systems and Control · Computer Science 2020-06-18 Ioannis Exarchos , Evangelos A. Theodorou

We consider a singular control problem with regime switching that arises in problems of optimal investment decisions of cash-constrained firms. The value function is proved to be the unique viscosity solution of the associated…

Computational Finance · Quantitative Finance 2016-10-07 Erwan Pierre , Stéphane Villeneuve , Xavier Warin

In this paper, we propose an original approach to stochastic control problems. We consider a weak formulation that is written as an optimization (minimization) problem on the space of probability measures. We then introduce a penalized…

Optimization and Control · Mathematics 2025-08-05 Thibaut Bourdais , Nadia Oudjane , Francesco Russo

This paper focuses on finding approximate solutions to stochastic optimal control problems with control domains being not necessarily convex, where the state trajectory is subject to controlled stochastic differential equations. The…

Optimization and Control · Mathematics 2025-07-15 Shaolin Ji , Rundong Xu

In this paper, we consider the stochastic optimal control problem for jump diffusion systems with state constraints. In general, the value function of such problems is a discontinuous viscosity solution of the Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2020-06-11 Jun Moon