English
Related papers

Related papers: Policy Iteration for Exploratory Hamilton--Jacobi-…

200 papers

In this paper, we consider scaling limits of exponential utility indifference prices for European contingent claims in the Bachelier model. We show that the scaling limit can be represented in terms of the \emph{specific relative entropy},…

Probability · Mathematics 2025-09-08 Yan Dolinksy , Xin Zhang

Optimized certainty equivalents (OCEs) is a family of risk measures widely used by both practitioners and academics. This is mostly due to its tractability and the fact that it encompasses important examples, including entropic risk…

Optimization and Control · Mathematics 2022-06-07 Julio Backhoff Veraguas , A. Max Reppen , Ludovic Tangpi

In this paper, we develop a theoretical framework for nonlinear stochastic optimal control problems with optimal stopping by establishing a density-based deterministic representation of the underlying diffusion. For state-independent…

Optimization and Control · Mathematics 2026-04-15 Akan Selim , Siddhartha Ganguly , Ali Pakniyat , Panagiotis Tsiotras

This paper studies a class of partial information linear-quadratic mean-field game problems. A general stochastic large-population system is considered, where the diffusion term of the dynamic of each agent can depend on the state and…

Optimization and Control · Mathematics 2022-03-22 Min Li , Tianyang Nie , Zhen Wu

We consider the determination of the optimal stationary singular stochastic control of a linear diffusion for a class of average cumulative cost minimization problems arising in various financial and economic applications of stochastic…

Optimization and Control · Mathematics 2018-03-12 Luis H. R. Alvarez E.

We introduce Reliable Policy Iteration (RPI) and Conservative RPI (CRPI), variants of Policy Iteration (PI) and Conservative PI (CPI), that retain tabular guarantees under function approximation. RPI uses a novel Bellman-constrained…

Machine Learning · Computer Science 2026-04-03 S. R. Eshwar , Gugan Thoppe , Ananyabrata Barua , Aditya Gopalan , Gal Dalal

To investigate solutions of (near-)optimal control problems, we extend and exploit a notion of homogeneity recently proposed in the literature for discrete-time systems. Assuming the plant dynamics is homogeneous, we first derive a scaling…

Optimization and Control · Mathematics 2021-09-24 Mathieu Granzotto , Romain Postoyan , Lucian Buşoniu , Dragan Nešić , Jamal Daafouz

We consider a dynamic portfolio optimization problem that incorporates predictable returns, instantaneous transaction costs, price impact, and stochastic volatility, extending the classical results of Garleanu and Pedersen (2013), which…

Computational Finance · Quantitative Finance 2025-07-24 Patrick Chan , Ronnie Sircar , Iosif Zimbidis

This paper studies a continuous-time stochastic linear-quadratic (SLQ) optimal control problem on infinite-horizon. A data-driven policy iteration algorithm is proposed to solve the SLQ problem. Without knowing three system coefficient…

Optimization and Control · Mathematics 2022-09-30 Heng Zhang , Na Li

This paper investigates a continuous-time portfolio optimization problem with the following features: (i) a no-short selling constraint; (ii) a leverage constraint, that is, an upper limit for the sum of portfolio weights; and (iii) a…

Portfolio Management · Quantitative Finance 2022-03-08 Masashi Ieda

Contraction theory is a recently developed dynamic analysis and nonlinear control system design tool based on an exact differential analysis of convergence. This paper extends contraction theory to local and global stability analysis of…

Mathematical Physics · Physics 2007-05-23 Winfried Lohmiller , Jean-Jacques E. Slotine

We study an infinite-horizon optimal investment, consumption and insurance problem for an economic agent who consumes a perishable and a durable good. The agent trades in a risk-free asset, a risky asset, and a durable good whose price…

General Economics · Economics 2025-12-09 Aleksandar Arandjelović , Ryle S. Perera , Pavel V. Shevchenko , Tak Kuen Siu , Jin Sun

We consider stochastic control models with Borel spaces and universally measurable policies. For such models the standard policy iteration is known to have difficult measurability issues and cannot be carried out in general. We present a…

Optimization and Control · Mathematics 2016-02-26 Huizhen Yu , Dimitri P. Bertsekas

We study an optimal investment and consumption problem over a finite-time horizon, in which an individual invests in a risk-free asset and a risky asset, and evaluate utility using a general utility function that exhibits loss aversion with…

Optimization and Control · Mathematics 2025-07-08 Chonghu Guan , Xinfeng Gu , Wenhao Zhang , Xun Li

In this paper, we study a time-inconsistent stochastic optimal control problem with a recursive cost functional by a multi-person hierarchical differential game approach. An equilibrium strategy of this problem is constructed and a…

Optimization and Control · Mathematics 2016-06-13 Qingmeng Wei , Jiongmin Yong , Zhiyong Yu

This is the first in a series of papers in which we study an efficient approximation scheme for solving the Hamilton-Jacobi-Bellman equation for multi-dimensional problems in stochastic control theory. The method is a combination of a WKB…

Computational Finance · Quantitative Finance 2014-06-26 Sakda Chaiworawitkul , Patrick S. Hagan , Andrew Lesniewski

We consider the problem of computing optimal linear control policies for linear systems in finite-horizon. The states and the inputs are required to remain inside pre-specified safety sets at all times despite unknown disturbances. In this…

Systems and Control · Computer Science 2019-12-17 Luca Furieri , Maryam Kamgarpour

Theoretical analyses of evolution strategies are indispensable for gaining a deep understanding of their inner workings. For constrained problems, rather simple problems are of interest in the current research. This work presents a…

Neural and Evolutionary Computing · Computer Science 2019-08-12 Patrick Spettel , Hans-Georg Beyer

Optimal control of interacting particles governed by stochastic evolution equations in Hilbert spaces is an open area of research. Such systems naturally arise in formulations where each particle is modeled by stochastic partial…

Probability · Mathematics 2025-11-27 Filippo de Feo , Fausto Gozzi , Andrzej Święch , Lukas Wessels

This note proposes a data-driven output-feedback stabilizing policy iteration for unknown linear discrete-time systems with unmeasurable states. Existing policy iteration methods for optimal control must start from a stabilizing control…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Dongdong Li , Jiuxiang Dong