English
Related papers

Related papers: Fully discrete schemes for monotone optimal contro…

200 papers

A numerical method is proposed for a class of stochastic control problems including singular behavior. This method solves an infinite-dimensional linear program equivalent to the stochastic control problem using a finite element type…

Probability · Mathematics 2018-06-11 Martin G. Vieten , Richard H. Stockbridge

We examine the problem of two-point boundary optimal control of nonlinear systems over finite-horizon time periods with unknown model dynamics by employing reinforcement learning. We use techniques from singular perturbation theory to…

Optimization and Control · Mathematics 2023-06-12 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker

In this paper we consider nonautonomous optimal control problems of infinite horizon type, whose control actions are given by $L^1$-functions. We verify that the value function is locally Lipschitz. The equivalence between dynamic…

Optimization and Control · Mathematics 2021-01-27 J. Baumeister , A. Leitao , G. N. Silva

We investigate in this work a fully-discrete semi-Lagrangian approximation of second order possibly degenerate Hamilton-Jacobi-Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in…

Numerical Analysis · Mathematics 2021-09-22 Elisa Calzola , Elisabetta Carlini , Xavier Dupuis , Francisco J. Silva

We study a family of optimal control problems under a set of controlled-loss constraints holding at different deterministic dates. The characterization of the associated value function by a Hamilton-Jacobi-Bellman equation usually calls for…

Optimization and Control · Mathematics 2020-07-27 Geraldine Bouveret , Athena Picarelli

We develop a discrete analogue of Hamilton-Jacobi theory in the framework of discrete Hamiltonian mechanics. The resulting discrete Hamilton-Jacobi equation is discrete only in time. We describe a discrete analogue of Jacobi's solution and…

Optimization and Control · Mathematics 2011-08-15 Tomoki Ohsawa , Anthony M. Bloch , Melvin Leok

We consider a singular control problem with regime switching that arises in problems of optimal investment decisions of cash-constrained firms. The value function is proved to be the unique viscosity solution of the associated…

Computational Finance · Quantitative Finance 2016-10-07 Erwan Pierre , Stéphane Villeneuve , Xavier Warin

We study the properties of the value function associated with an optimal control problem with uncertainties, known as average or Riemann-Stieltjes problem. Uncertainties are assumed to belong to a compact metric probability space, and…

Optimization and Control · Mathematics 2024-07-19 M. Soledad Aronna , Michele Palladino , Oscar Sierra

We present a fully discrete finite element method for the interior null controllability problem subject to the wave equation. For the numerical scheme, piece-wise affine continuous elements in space and finite differences in time are…

Numerical Analysis · Mathematics 2023-05-10 Erik Burman , Ali Feizmohammadi , Lauri Oksanen

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

This paper, which is the natural continuation of a previous paper by the same authors, studies a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes…

Optimization and Control · Mathematics 2009-07-10 Salvatore Federico , Ben Goldys , Fausto Gozzi

We consider the numerical solution of Hamilton-Jacobi-Bellman equations arising in stochastic control theory. We introduce a class of monotone approximation schemes relying on monotone interpolation. These schemes converge under very weak…

Numerical Analysis · Mathematics 2014-05-26 Kristian Debrabant , Espen R. Jakobsen

In this article, we design and analyze a Hybrid High-Order (HHO) finite element approximation for a class of strongly nonlinear boundary value problems. We consider an HHO discretization for a suitable linearized problem and show its…

Numerical Analysis · Mathematics 2023-09-26 Gouranga Mallik , Thirupathi Gudi

The Hamilton-Jacobi-Bellman equation arising from the optimal portfolio selection problem is studied by means of the maximal monotone operator method. The existence and uniqueness of a solution to the Cauchy problem for the nonlinear…

Mathematical Finance · Quantitative Finance 2023-08-08 Daniel Sevcovic , Cyril Izuchukwu Udeani

An abstract framework guaranteeing the local continuous differentiability of the value function associated with optimal stabilization problems subject to abstract semilinear parabolic equations subject to a norm constraint on the controls…

Optimization and Control · Mathematics 2023-05-19 Karl Kunisch , Buddhika Priyasad

An optimal control problem is considered for a stochastic differential equation with the cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). This kind of cost functional can cover the general…

Optimization and Control · Mathematics 2019-11-13 Hanxiao Wang , Jiongmin Yong

In this note, we study a class of indefinite stochastic McKean-Vlasov linear-quadratic (LQ in short) control problem under the control taking nonnegative values. In contrast to the conventional issue, both the classical dynamic programming…

Optimization and Control · Mathematics 2023-10-05 Xun Li , Liangquan Zhang

In optimal control problems defined on stratified domains, the dynamics and the running cost may have discontinuities on a finite union of submanifolds of RN. In [8, 5], the corresponding value function is characterized as the unique…

Optimization and Control · Mathematics 2022-07-15 Simone Cacace , Fabio Camilli

For a general entropy-regularized stochastic control problem on an infinite horizon, we prove that a policy iteration algorithm (PIA) converges to an optimal relaxed control. Contrary to the standard stochastic control literature, classical…

Optimization and Control · Mathematics 2026-05-14 Yu-Jui Huang , Zhenhua Wang , Zhou Zhou

A finite element analysis of a Dirichlet boundary control problem governed by the linear parabolic equation is presented in this article. The Dirichlet control is considered in a closed and convex subset of the energy space $H^1(\Omega…

Numerical Analysis · Mathematics 2021-11-04 Thirupathi Gudi , Gouranga Mallik , Ramesh Ch. Sau