English
Related papers

Related papers: Robust optimal stopping with regime switching

200 papers

We formulate an optimal stopping problem for a geometric Brownian motion where the probability scale is distorted by a general nonlinear function. The problem is inherently time inconsistent due to the Choquet integration involved. We…

Probability · Mathematics 2022-01-07 Zuo Quan Xu , Xun Yu Zhou

We examine robust output feedback control of discrete-time nonlinear systems with bounded uncertainties affecting the dynamics and measurements. Specifically, we demonstrate how to construct semi-infinite programs that produce gains to…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Jad Wehbeh , Eric C. Kerrigan

This work concerns the optimal control problem for McKean-Vlasov SDEs. We provide explicit conditions to ensure the existence of optimal Markovian feedback controls. Moreover, based on the flow property of the McKean-Vlasov SDE, the dynamic…

Probability · Mathematics 2023-10-18 Jinghai Shao

Discrete-time robust optimal control problems generally take a min-max structure over continuous variable spaces, which can be difficult to solve in practice. In this paper, we extend the class of such problems that can be solved through a…

Optimization and Control · Mathematics 2024-04-30 Jad Wehbeh , Eric C. Kerrigan

The paper concerns the infinite dimensional Hamilton-Jacobi-Bellman equation related to optimal control problem regulated by a transport equation with boundary control. A suitable viscosity solution approach is needed in view of the…

Optimization and Control · Mathematics 2007-05-23 Giorgio Fabbri

We present an algorithm for robust model predictive control with consideration of uncertainty and safety constraints. Our framework considers a nonlinear dynamical system subject to disturbances from an unknown but bounded uncertainty set.…

Optimization and Control · Mathematics 2021-04-23 Dongchan Lee , Konstantin Turitsyn , Jean-Jacques Slotine

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…

Quantum Physics · Physics 2009-03-06 Viacheslav P. Belavkin , Antonio Negretti , Klaus Molmer

We study an optimal control problem in which both the objective function and the dynamic constraint contain an uncertain parameter. Since the distribution of this uncertain parameter is not exactly known, the objective function is taken as…

Optimization and Control · Mathematics 2016-11-29 Jianxiong Ye , Lei Wang , Changzhi Wu , Jie Sun , Kok Lay Teo , Xiangyu Wang

A large number of recent studies consider a compartmental SIR model to study optimal control policies aimed at containing the diffusion of COVID-19 while minimizing the economic costs of preventive measures. Such problems are non-convex and…

Optimization and Control · Mathematics 2022-12-21 Alessandro Calvia , Fausto Gozzi , Francesco Lippi , Giovanni Zanco

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

Machine Learning · Computer Science 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

We study the structure of a simple dynamic optimization problem consisting of one state and one control variable, from a physicist's point of view. By using an analogy to a physical model, we study this system in the classical and quantum…

Mathematical Finance · Quantitative Finance 2017-04-05 Mauricio Contreras , Rely Pellicer , Marcelo Villena

This paper studies the problem of determining the optimal cut-off for pairs trading rules. We consider two correlated assets whose spread is modelled by a mean-reverting process with stochastic volatility, and the optimal pair trading rule…

Mathematical Finance · Quantitative Finance 2014-12-25 Minh Man Ngo , Huyen Pham

In this article we present a general framework for non-concave robust stochastic control problems under model uncertainty in a discrete time finite horizon setting. Our framework allows to consider a variety of different path-dependent…

Optimization and Control · Mathematics 2025-05-06 Ariel Neufeld , Julian Sester

Hybrid optimal control problems are studied for a general class of hybrid systems where autonomous and controlled state jumps are allowed at the switching instants and in addition to terminal and running costs switching between discrete…

Optimization and Control · Mathematics 2017-02-22 Ali Pakniyat , Peter E. Caines

We address the problem of making a managerial decision when the investment project is subsidized, which results in the resolution of an infinite-horizon optimal stopping problem of a switching diffusion driven by either an homogeneous or an…

Probability · Mathematics 2018-02-28 Carlos Oliveira , Nicolas Perkowski

The dynamic programming approach for the control of a 3D flow governed by the stochastic Navier-Stokes equations for incompressible fluid in a bounded domain is studied. By a compactness argument, existence of solutions for the associated…

Optimization and Control · Mathematics 2007-05-23 Luigi Manca

In this paper, we establish a general stochastic maximum principle for optimal control for systems described by a continuous-time Markov regime-switching stochastic recursive utilities model. The control domain is postulated not to be…

Optimization and Control · Mathematics 2019-05-02 Liangquan Zhang , Xun Li

Designing optimal controllers for nonlinear dynamical systems often relies on reinforcement learning and adaptive dynamic programming (ADP) to approximate solutions of the Hamilton Jacobi Bellman (HJB) equation. However, these methods…

Optimization and Control · Mathematics 2025-11-27 Akash Vyas , Shreyas Kumar , Jayant Kumar Mohanta , Ravi Prakash

We study the problem of optimal portfolio selection under stochastic volatility within a continuous time reinforcement learning framework with portfolio constraints. Exploration is modeled through entropy-regularized relaxed controls, where…

Mathematical Finance · Quantitative Finance 2026-04-27 Thai Nguyen , Pertiny Nkuize

We develop a general theoretical framework for optimal probability density control on standard measure spaces, aimed at addressing large-scale multi-agent control problems. In particular, we establish a maximum principle (MP) for control…

Optimization and Control · Mathematics 2026-03-10 Nathan Gaby , Xiaojing Ye