English
Related papers

Related papers: Dynamic Programming for Optimal Delivery Time Slot…

200 papers

We propose a model in which dividend payments occur at regular, deterministic intervals in an otherwise continuous model. This contrasts traditional models where either the payment of continuous dividends is controlled or the dynamics are…

Optimization and Control · Mathematics 2019-07-24 Jussi Keppo , Max Reppen , H. Mete Soner

A mathematical framework for Continuous Time Finance based on operator algebraic methods offers a new direct and entirely constructive perspective on the field and leads to new numerical analysis techniques. This is partly a review paper as…

Probability · Mathematics 2009-09-29 Claudio Albanese

In this paper, we first establish the dynamic programming principle for stochastic optimal control problems defined on compact Riemannian manifolds without boundary. Subsequently, we derive the associated Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2025-07-03 Dingqian Gao , Qi Lü

The linear programming (LP) approach has a long history in the theory of approximate dynamic programming. When it comes to computation, however, the LP approach often suffers from poor scalability. In this work, we introduce a relaxed…

Systems and Control · Electrical Eng. & Systems 2020-12-01 Andrea Martinelli , Matilde Gargiani , John Lygeros

This paper is concerned with the solution of the optimal stopping problem associated to the valuation of Perpetual American options driven by continuous time Markov chains. We introduce a new dynamic approach for the numerical pricing of…

Probability · Mathematics 2019-04-25 Laurent Miclo , Stéphane Villeneuve

We consider a dynamic programming problem with arbitrary state space and bounded rewards. Is it possible to define in an unique way a limit value for the problem, where the "patience" of the decision-maker tends to infinity ? We consider,…

Optimization and Control · Mathematics 2013-01-04 Jérôme Renault

The solutions to many sequential decision-making problems are characterized by dynamic programming and Bellman's principle of optimality. However, due to the inherent complexity of solving Bellman's equation exactly, there has been…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Bowen Li , Edwin K. P. Chong , Ali Pezeshki

Markov decision problems are most commonly solved via dynamic programming. Another approach is Bellman residual minimization, which directly minimizes the squared Bellman residual objective function. However, compared to dynamic…

Machine Learning · Computer Science 2026-04-28 Donghwan Lee , Hyukjun Yang

We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…

Probability · Mathematics 2017-10-24 Ruoting Gong , Christian Houdré

This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…

Optimization and Control · Mathematics 2020-04-22 Yuk-Loong Chow , Xiang Yu , Chao Zhou

In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the maximum entropy…

Optimization and Control · Mathematics 2022-03-01 Oswin So , Ziyi Wang , Evangelos A. Theodorou

Many sequential decision problems can be formulated as Markov Decision Processes (MDPs) where the optimal value function (or cost-to-go function) can be shown to satisfy a monotone structure in some or all of its dimensions. When the state…

Optimization and Control · Mathematics 2015-09-03 Daniel R. Jiang , Warren B. Powell

This paper is concerned with finite-level quantum memory systems for retaining initial dynamic variables in the presence of external quantum noise. The system variables have an algebraic structure, similar to that of the Pauli matrices, and…

Optimization and Control · Mathematics 2026-04-01 Igor G. Vladimirov , Ian R. Petersen , Guodong Shi

In pursuit of a more sustainable and cost-efficient last mile, parcel lockers have gained a firm foothold in the parcel delivery landscape. To fully exploit their potential and simultaneously ensure customer satisfaction, successful…

Artificial Intelligence · Computer Science 2024-09-13 Daniela Sailer , Robert Klein , Claudius Steinhardt

Analyzing nonlinear systems with stabilizable controlled invariant sets (CISs) requires accurate estimation of their domains of stabilization (DOS) together with associated stabilizing controllers. Despite extensive research, estimating…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Mohamed Serry , S. Sivaranjani , Jun Liu

We consider a general formulation of the Principal-Agent problem with a lump-sum payment on a finite horizon, providing a systematic method for solving such problems. Our approach is the following: we first find the contract that is optimal…

Optimization and Control · Mathematics 2017-01-10 Jakša Cvitanić , Dylan Possamaï , Nizar Touzi

We describe an abstract control-theoretic framework in which the validity of the dynamic programming principle can be established in continuous time by a verification of a small number of structural properties. As an application we treat…

Optimization and Control · Mathematics 2014-03-18 Gordan Zitkovic

In the classical static optimal reinsurance problem, the cost of capital for the insurer's risk exposure determined by a monetary risk measure is minimized over the class of reinsurance treaties represented by increasing Lipschitz retained…

Risk Management · Quantitative Finance 2020-12-18 Alexander Glauner

This article is the starting point of a series of works whose aim is the study of deterministic control problems where the dynamic and the running cost can be completely different in two (or more) complementary domains of the space $\R^N$.…

Analysis of PDEs · Mathematics 2012-09-12 Guy Barles , Ariela Briani , Emmanuel Chasseigne

We consider a profit maximization problem in an urban mobility on-demand service, of which the operator owns a fleet, provides both exclusive and shared trip services, and dynamically determines prices of offers. With knowledge of the…

Optimization and Control · Mathematics 2018-02-13 Han Qiu , Ruimin Li , Jinhua Zhao