English
Related papers

Related papers: A dynamic programming approach for controlled frac…

200 papers

The minimization of energy-like cost functionals is addressed in the context of optimal control problems. For a general class of dynamical systems, with possibly unstable and nonlinear free dynamics, it is shown that a sequence of solutions…

Optimization and Control · Mathematics 2022-12-06 Sérgio S. Rodrigues

In this article, we construct a numerical method for a stochastic version of the Susceptible Infected Susceptible (SIS) epidemic model, expressed by a suitable stochastic differential equation (SDE), by using the semi-discrete method to a…

Numerical Analysis · Mathematics 2023-07-28 Yiannis Kiouvrekis , Ioannis S. Stamatiou

In this paper we consider the fractional SIS epidemic model ($\alpha$-SIS model) in the case of constant population size. We provide a representation of the explicit solution to the fractional model and we illustrate the results by…

Optimization and Control · Mathematics 2020-07-10 Caterina Balzotti , Mirko D'Ovidio , Paola Loreti

We study a linear-quadratic, optimal control problem on a discrete, finite time horizon with distributional ambiguity, in which the cost is assessed via Conditional Value-at-Risk (CVaR). We take steps toward deriving a scalable dynamic…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Margaret P. Chapman , Laurent Lessard

We present a dynamic programming-based solution to a stochastic optimal control problem up to a hitting time for a discrete-time Markov control process. Firstly, we determine an optimal control policy to steer the process toward a compact…

Optimization and Control · Mathematics 2009-09-28 Debasish Chatterjee , Eugenio Cinquemani , Giorgos Chaloulos , John Lygeros

This paper addresses the optimal control problem for a class of nonlinear fractional systems involving Caputo derivatives and nonlocal initial conditions. The system is reformulated as an abstract Hammerstein-type operator equation,…

Optimization and Control · Mathematics 2025-04-15 Dev Prakash Jha , Raju K. George

The main aim of the present work is to study and analyze a reaction-diffusion fractional version of the SIR epidemic mathematical model by means of the non-local and non-singular ABC fractional derivative operator with complete memory…

Optimization and Control · Mathematics 2022-01-26 Moulay Rchid Sidi Ammi , Mostafa Tahiri , Delfim F. M. Torres

We consider the problem of optimal multi-modes switching in finite horizon, when the state of the system, including the switching cost functions are arbitrary ($g_{ij}(t,x)\geq 0$). We show existence of the optimal strategy, and give when…

Optimization and Control · Mathematics 2015-03-18 Brahim El Asri

In this paper, we investigate dynamic optimization problems featuring both stochastic control and optimal stopping in a finite time horizon. The paper aims to develop new methodologies, which are significantly different from those of mixed…

Portfolio Management · Quantitative Finance 2014-06-27 Xiongfei Jian , Xun Li , Fahuai Yi

When transferring a control policy from simulation to a physical system, the policy needs to be robust to variations in the dynamics to perform well. Commonly, the optimal policy overfits to the approximate model and the corresponding…

Machine Learning · Computer Science 2021-05-27 Michael Lutter , Shie Mannor , Jan Peters , Dieter Fox , Animesh Garg

Semi-lagrangian schemes for discretization of the dynamic programming principle are based on a time discretization projected on a state-space grid. The use of a structured grid makes this approach not feasible for high-dimensional problems…

Numerical Analysis · Mathematics 2023-06-09 Alessandro Alla , Hugo Oliveira , Gabriele Santin

In this paper we study a utility maximization problem with both optimal control and optimal stopping in a finite time horizon. The value function can be characterized by a variational equation that involves a free boundary problem of a…

Mathematical Finance · Quantitative Finance 2018-10-23 Jingtang Ma , Jie Xing , Harry Zheng

We study optimal control problems for interacting branching diffusion processes, a class of measure-valued dynamics capturing both spatial motion and branching mechanisms. From the perspective of the dynamic programming principle, we…

Optimization and Control · Mathematics 2026-01-19 Antonio Ocello

We consider a broad class of dynamic programming (DP) problems that involve a partially linear structure and some positivity properties in their system equation and cost function. We address deterministic and stochastic problems, possibly…

Optimization and Control · Mathematics 2026-04-21 Yuchao Li , Dimitri Bertsekas

We consider a kind of stochastic exit time optimal control problems, in which the cost function is defined through a nonlinear backward stochastic differential equation. We study the regularity of the value function for such a control…

Probability · Mathematics 2016-03-15 Rainer Buckdahn , Tianyang Nie

We investigate the dynamics of the hepatitis B virus by integrating variable-order calculus and discrete analysis. Specifically, we utilize the Caputo variable-order difference operator in this study. To establish the existence and…

Populations and Evolution · Quantitative Biology 2024-05-27 Meriem Boukhobza , Amar Debbouche , Lingeshwaran Shangerganesh , Delfim F. M. Torres

In this article, we study the classical finite-horizon optimal stopping problem for multidimensional diffusions through an approach that differs from what is typically found in the literature. More specifically, we first prove a key…

Optimization and Control · Mathematics 2025-03-05 Andrea Cosso , Laura Perelli

We present a novel approach to the study of epidemics on networks as thermodynamic phenomena, considering the thermodynamic efficiency of contagions, considered as distributed computational processes. Modelling SIS dynamics on a contact…

Populations and Evolution · Quantitative Biology 2018-10-24 Nathan Harding , Ramil Nigmatullin , Mikhail Prokopenko

We investigate conditions of optimality for an infinite horizon control problem and consider their correspondence with the value function. Assuming Lipschitz continuity of the value function, we prove that sensitivity relations plus the…

Optimization and Control · Mathematics 2016-07-20 Dmitry Khlopin

The aim of this paper is to provide a rigorous mathematical analysis of an optimal control problem of a SIR epidemic on an infinite horizon. A state constraint related to intensive care units (ICU) capacity is imposed and the objective…

Optimization and Control · Mathematics 2024-03-12 Lorenzo Freddi , Dan Goreac