English
Related papers

Related papers: Time-Inconsistent Problems for Controlled Markov C…

200 papers

We establish the existence of optimal scheduling strategies for time-bounded reachability in continuous-time Markov decision processes, and of co-optimal strategies for continuous-time Markov games. Furthermore, we show that optimal control…

Formal Languages and Automata Theory · Computer Science 2010-06-07 Markus Rabe , Sven Schewe

In optimal stopping problems, a Markov structure guarantees Markovian optimal stopping times (first exit times). Surprisingly, there is no analogous result for Markovian stopping games once randomization is required. This paper addresses…

Probability · Mathematics 2024-08-02 Sören Christensen , Boy Schultz

We consider a general time-inconsistent stochastic linear-quadratic differential game. The time-inconsistency arises from the presence of quadratic terms of the expected state as well as state-dependent term in the objective functionals. We…

Mathematical Finance · Quantitative Finance 2024-05-15 Qinglong Zhou , Gaofeng Zong

A general time-inconsistent optimal control problem is considered for stochastic differential equations with deterministic coefficients. Under suitable conditions, a Hamilton-Jacobi-Bellman type equation is derived for the equilibrium value…

Optimization and Control · Mathematics 2012-04-04 Jiongmin Yong

In this paper, we study a time-inconsistent consumption-investment problem with random endowments in a possibly incomplete market under general discount functions. We provide a necessary condition and a verification theorem for an open-loop…

Probability · Mathematics 2021-07-02 Yushi Hamaguchi

Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential…

Probability · Mathematics 2018-10-11 Alexander Erreygers , Jasper De Bock

For time-inconsistent stochastic controls in discrete time and finite horizon, an open problem in Bj\"ork and Murgoci (Finance Stoch, 2014) is the existence of an equilibrium control. A nonrandomized Borel measurable Markov equilibrium…

Optimization and Control · Mathematics 2023-12-18 Erhan Bayraktar , Bingyan Han

This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution of an ordinary differential equation is shown to determine…

Systems and Control · Computer Science 2015-09-02 Manish Gupta

This paper is concerned with a time-inconsistent stochastic optimal control problem in an infinite time horizon with a non-degenerate diffusion in the state equation. A major assumption is that people become rational after a large time.…

Optimization and Control · Mathematics 2025-09-19 Qingmeng Wei , Jiongmin Yong

We present stability conditions for deterministic time-varying nonlinear discrete-time systems whose inputs aim to minimize an infinite-horizon time-dependent cost. Global asymptotic and exponential stability properties for general…

Systems and Control · Electrical Eng. & Systems 2023-08-28 Sifeddine Benahmed , Romain Postoyan , Mathieu Granzotto , Lucian Buşoniu , Jamal Daafouz , Dragan Nešić

This paper characterizes differentiable and subgame Markov perfect equilibria in a continuous time intertemporal decision problem with non-constant discounting. Capturing the idea of non commitment by letting the commitment period being…

Optimization and Control · Mathematics 2008-08-29 Ivar Ekeland , Ali Lazrak

Linear-quadratic optimal control problems are considered for mean-field stochastic differential equations with deterministic coefficients. Time-inconsistency feature of the problems is carefully investigated. Both open-loop and closed-loop…

Optimization and Control · Mathematics 2013-05-07 Jiongmin Yong

We study time-inconsistent recursive stochastic control problems, i.e., for which the Bellman principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and…

Optimization and Control · Mathematics 2024-03-14 Elisa Mastrogiacomo , Marco Tarsia

The Markowitz problem consists of finding in a financial market a self-financing trading strategy whose final wealth has maximal mean and minimal variance. We study this in continuous time in a general semimartingale model and under cone…

Portfolio Management · Quantitative Finance 2012-06-04 Christoph Czichowsky , Martin Schweizer

This paper studies a large number of homogeneous Markov decision processes where the transition probabilities and costs are coupled in the empirical distribution of states (also called mean-field). The state of each process is not known to…

Optimization and Control · Mathematics 2020-12-03 Jalal Arabneydi , Amir G. Aghdam

This paper considers time-inconsistent problems when control and stopping strategies are required to be made simultaneously (called stopping control problems by us). We first formulate the timeinconsistent stopping control problems under…

Optimization and Control · Mathematics 2023-06-21 Zongxia Liang , Fengyi Yuan

In this paper, we study a class of stochastic time-inconsistent linear-quadratic (LQ) control problems with control input constraints. These problems are investigated within the more general framework associated with random coefficients.…

Optimization and Control · Mathematics 2017-03-29 Ying Hu , Jianhui Huang , Xun Li

This paper addresses the challenge of time-inconsistent stochastic control within a continuous-time framework. Its primary focus lies in uncovering a probabilistic representation, specifically in the shape of a system of backward stochastic…

Optimization and Control · Mathematics 2026-03-24 Dylan Possamaï , Mateo Rodriguez Polo

We study the time-inconsistent linear quadratic optimal control problem for forward-backward stochastic differential equations with potentially indefinite cost weighting matrices for both the state and the control variables. Our research…

Optimization and Control · Mathematics 2023-12-15 Qi Lü , Bowen Ma

We investigate time-inconsistent portfolio problems under a broader class of monotone mean-variance (MMV) preferences. Since the optimal strategies for MMV and mean-variance (MV) preferences coincide, the MMV optimal strategies at different…

Optimization and Control · Mathematics 2026-04-21 Yike Wang , Yusha Chen , Jingzhen Liu