English
Related papers

Related papers: Adaptive sparse grids for time dependent Hamilton-…

200 papers

We propose a new numerical method for solving the Hamilton-Jacobi-Bellman quasi-variational inequality associated with the combined impulse and stochastic optimal control problem over a finite time horizon. Our method corresponds to an…

Numerical Analysis · Mathematics 2015-02-05 Masashi Ieda

We present an adaptive algorithm for the computation of quantities of interest involving the solution of a stochastic elliptic PDE where the diffusion coefficient is parametrized by means of a Karhunen-Lo\`eve expansion. The approximation…

Numerical Analysis · Mathematics 2023-07-19 Uta Seidler , Michael Griebel

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

Sparse grids based on Lagrange polynomials have become one of the staple methods for approximating functions that are high-dimensional and expensive to evaluate, in the context e.g. of PDE-based parametric design exploration. They are…

Computational Engineering, Finance, and Science · Computer Science 2026-03-10 Matteo Rosellini , Filippo Fruzza , Alessandro Mariotti , Maria Vittoria Salvetti , Lorenzo Tamellini

Sparse grids are tailored to the approximation of smooth high-dimensional functions. On a $d$-dimensional tensor product space, the number of grid points is $N = \mathcal O(h^{-1} |\log h|^{d-1})$, where $h$ is a mesh parameter. The…

Numerical Analysis · Mathematics 2011-06-09 Christoph Reisinger

Sparse-grid methods have recently gained interest in reducing the computational cost of solving high-dimensional kinetic equations. In this paper, we construct adaptive and hybrid sparse-grid methods for the Vlasov-Poisson-Lenard-Bernstein…

The control of relaxation-type systems of ordinary differential equations is investigated using the Hamilton-Jacobi-Bellman equation. First, we recast the model as a singularly perturbed dynamics which we embed in a family of controlled…

Optimization and Control · Mathematics 2024-04-23 Michael Herty , Hicham Kouhkouh

We present a simple and easy to implement method for the numerical solution of a rather general class of Hamilton-Jacobi-Bellman (HJB) equations. In many cases, the considered problems have only a viscosity solution, to which, fortunately,…

Computational Finance · Quantitative Finance 2011-02-17 Jan Hendrik Witte , Christoph Reisinger

In this paper, we present a scalable deep learning approach to solve opinion dynamics stochastic optimal control problems with mean field term coupling in the dynamics and cost function. Our approach relies on the probabilistic…

Multiagent Systems · Computer Science 2022-04-19 Tianrong Chen , Ziyi Wang , Evangelos A. Theodorou

In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic differential equations. We…

Optimization and Control · Mathematics 2022-12-26 Jianjun Zhou

We study the qualitative homogenization of second order viscous Hamilton-Jacobi equations in space-time stationary ergodic random environments. Assuming that the Hamiltonian is convex and superquadratic in the momentum variable (gradient)…

Analysis of PDEs · Mathematics 2017-02-07 Wenjia Jing , Panagiotis E. Souganidis , Hung V. Tran

We investigate a distributed optimal control problem for the viscous Camassa--Holm equations with sparse controls and a general cost functional. Considering three different forms of sparsity-promoting terms, we prove the existence of…

Optimization and Control · Mathematics 2026-04-06 Giang Nguyen Hai Ha

Stochastic optimal control control problems with merely measurable coefficients are not well understood. In this manuscript, we consider fully non-linear stochastic optimal control problems in infinite horizon with measurable coefficients…

Optimization and Control · Mathematics 2026-05-21 Filippo de Feo

An advantageous feature of piecewise constant policy timestepping for Hamilton-Jacobi-Bellman (HJB) equations is that different linear approximation schemes, and indeed different meshes, can be used for the resulting linear equations for…

Numerical Analysis · Mathematics 2016-01-21 Christoph Reisinger , Peter Forsyth

We propose a second order, fully semi-Lagrangian method for the numerical solution of systems of advection-diffusion-reaction equations, which employs a semi-Lagrangian approach to approximate in time both the advective and the diffusive…

Numerical Analysis · Mathematics 2020-02-12 Luca Bonaventura , Elisabetta Carlini , Elisa Calzola , Roberto Ferretti

We show convergence rates for a sparse grid approximation of the distribution of solutions of the stochastic Landau-Lifshitz-Gilbert equation. Beyond being a frequently studied equation in engineering and physics, the stochastic…

Numerical Analysis · Mathematics 2025-06-02 Xin An , Josef Dick , Michael Feischl , Andrea Scaglioni , Thanh Tran

Deterministic interpolation and quadrature methods are often unsuitable to address Bayesian inverse problems depending on computationally expensive forward mathematical models. While interpolation may give precise posterior approximations,…

We study policy iteration (PI) for deterministic infinite-horizon discounted optimal control problems, whose value function is characterized by a stationary Hamilton--Jacobi--Bellman (HJB) equation. At the PDE level, PI is fundamentally…

Optimization and Control · Mathematics 2026-04-14 Namkyeong Cho , Yeoneung Kim

We study the convergence rates of policy iteration (PI) for nonconvex viscous Hamilton--Jacobi equations using a discrete space-time scheme, where both space and time variables are discretized. We analyze the case with an uncontrolled…

Numerical Analysis · Mathematics 2025-03-05 Xiaoqin Guo , Hung Vinh Tran , Yuming Paul Zhang

Computing optimal feedback controls for nonlinear systems generally requires solving Hamilton-Jacobi-Bellman (HJB) equations, which are notoriously difficult when the state dimension is large. Existing strategies for high-dimensional…

Optimization and Control · Mathematics 2021-04-09 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang