Related papers: Convergence of dynamic programming principles for …
We develop a discrete-time optimal control framework for systems evolving on Lie groups. Our work generalizes the original Differential Dynamic Programming method, by employing a coordinate-free, Lie-theoretic approach for its derivation. A…
In this article, we address a class of non convex, integer, non linear mathematical programs using dynamic programming. The mathematical program considered, whose properties are studied in this article, may be used to model the optimal…
The principle of optimality is a fundamental aspect of dynamic programming, which states that the optimal solution to a dynamic optimization problem can be found by combining the optimal solutions to its sub-problems. While this principle…
Using, as main tool, the convergence theorem for discrete martingales and the mean value property of harmonic functions we solve, a particular case of, Dirichlet problem.
In this paper, the convergence of the solutions for a discretized linear state-based static peridynamic system to the corresponding continuous solution is analytically proven. To obtain an implementable model, we further apply…
This paper mainly investigates the analytic solutions for the approximation of $p$-Laplacian problem. Through an approximation mechanism, we convert the nonlinear partial differential equation with Dirichlet boundary into a sequence of…
In this paper, the existence of positive strong solutions to a Dirichlet $p$-Laplacian problem with reaction both singular at zero and highly discontinuous is investigated. In particular, it is only required that the set of discontinuity…
Computing the rate-distortion function for continuous sources is commonly regarded as a standard continuous optimization problem. When numerically addressing this problem, a typical approach involves discretizing the source space and…
Approximate dynamic programming is a popular method for solving large Markov decision processes. This paper describes a new class of approximate dynamic programming (ADP) methods- distributionally robust ADP-that address the curse of…
We prove the solvability of the Dirichlet problem for the variable exponent $p$-Laplacian with boundary data in $W^{1,p(x)}(\Omega)$ on a bounded, smooth domain $\Omega \subset {\mathbb R}^n$. Our main focus will be on an a.e. finite…
In this paper we investigate possible approaches to study general time-inconsistent optimization problems without assuming the existence of optimal strategy. This leads immediately to the need to refine the concept of time-consistency as…
We propose a new monotone finite difference discretization for the variational $p$-Laplace operator, \[ \Delta_p u=\text{div}(|\nabla u|^{p-2}\nabla u), \] and present a convergent numerical scheme for related Dirichlet problems. The…
This paper studies the dynamic programming principle for general convex stochastic optimization problems introduced by Rockafellar and Wets in [30]. We extend the applicability of the theory by relaxing compactness and boundedness…
Trajectory optimization is an efficient approach for solving optimal control problems for complex robotic systems. It relies on two key components: first the transcription into a sparse nonlinear program, and second the corresponding solver…
We study discrete-time finite-horizon optimal control problems in probability spaces, whereby the state of the system is a probability measure. We show that, in many instances, the solution of dynamic programming in probability spaces…
The goal of this paper is to investigate new and simple convergence analysis of dynamic programming for linear quadratic regulator problem of discrete-time linear time-invariant systems. In particular, bounds on errors are given in terms of…
We introduce a globally convergent relaxed Kacanov scheme for the computation of the discrete minimizer to the $p$-Laplace problem with $2 \leq p < \infty$. The iterative scheme is easy to implement since each iterate results only from the…
In this work we study the stochastic recursive control problem, in which the aggregator (or called generator) of the backward stochastic differential equation describing the running cost is continuous but not necessarily Lipschitz with…
In a Hilbert setting, we introduce a new dynamical system and associated algorithms for solving monotone inclusions by rapid methods. Given a maximal monotone operator $A$, the evolution is governed by the time dependent operator $I -(I +…
In this paper, we study the relationship between general maximum principle and dynamic programming principle for risk-sensitive stochastic optimal control problems, where the control domain is not necessarily convex. The original problem is…