English
Related papers

Related papers: Non-Markovian Impulse Control Under Nonlinear Expe…

200 papers

We study a dynamic stochastic control problem subject to Knightian uncertainty with multi-objective (vector-valued) criteria. Assuming the preferences across expected multi-loss vectors are represented by a given, yet general, preorder, we…

Optimization and Control · Mathematics 2024-07-02 Igor Cialenco , Gabriela Kováčová

Nonzero sum games typically have multiple Nash equilibriums (or no equilibrium), and unlike the zero sum case, they may have different values at different equilibriums. Instead of focusing on the existence of individual equilibriums, we…

Optimization and Control · Mathematics 2020-08-27 Zachary Feinstein , Birgit Rudloff , Jianfeng Zhang

This paper is concerned with the controller-and-stopper stochastic differential game under a regime switching model in an infinite horizon. The state of the system consists of a number of diffusions \emph{coupled} by a continuous-time…

Optimization and Control · Mathematics 2021-11-02 Siyu Lv

We consider a two-player zero-sum deterministic differential game where each player uses both continuous and impulse controls in infinite-time horizon. We assume that the impulses supposed to be of general term and the costs depend on the…

Optimization and Control · Mathematics 2022-09-26 Brahim El Asri , Hafid Lalioui

Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has…

Numerical Analysis · Mathematics 2020-06-29 Diego Zabaljauregui

The purpose of this article is to study a stochastic control problem on a junction, with control at the junction point. The problem of control is formulated in the weak sense, using a relaxed control, namely a control which takes values in…

Optimization and Control · Mathematics 2023-11-28 Isaac Ohavi

This paper deals with N-person nonzero-sum discrete-time Markov games under a probability criterion, in which the transition probabilities and reward functions are allowed to vary with time. Differing from the existing works on the expected…

Probability · Mathematics 2025-05-16 Xin Guo , Xin Wen

In this paper, we propose a novel policy iteration method, called dynamic policy programming (DPP), to estimate the optimal policy in the infinite-horizon Markov decision processes. We prove the finite-iteration and asymptotic l\infty-norm…

Machine Learning · Computer Science 2011-09-09 Mohammad Gheshlaghi Azar , Vicenc Gomez , Hilbert J. Kappen

We analyze a stochastic optimal control problem, where the state process follows a McKean-Vlasov dynamics and the diffusion coefficient can be degenerate. We prove that its value function V admits a nonlinear Feynman-Kac representation in…

Probability · Mathematics 2016-11-15 Erhan Bayraktar , Andrea Cosso , Huyên Pham

We prove the dynamic programming principe for uniformly nondegenerate stochastic differential games in the framework of time-homogeneous diffusion processes considered up to the first exit time from a domain. In contrast with previous…

Optimization and Control · Mathematics 2012-07-17 N. V. Krylov

We prove the dynamic programming principe for uniformly nondegenerate stochastic differential games in the framework of time-homogeneous diffusion processes considered up to the first exit time from a domain. The zeroth-order "coefficient"…

Optimization and Control · Mathematics 2012-07-17 N. V. Krylov

We consider a general class of nonzero-sum $N$-player stochastic games with impulse controls, where players control the underlying dynamics with discrete interventions. We adopt a verification approach and provide sufficient conditions for…

Optimization and Control · Mathematics 2020-10-06 Matteo Basei , Haoyang Cao , Xin Guo

In this paper, we study the relationship between general maximum principle and dynamic programming principle for risk-sensitive stochastic optimal control problems, where the control domain is not necessarily convex. The original problem is…

Optimization and Control · Mathematics 2026-02-06 Huanqing Dong , Jingtao Shi

We consider a finite-horizon, zero-sum game in which both players control a stochastic differential equation by invoking impulses. We derive a control randomization formulation of the game and use the existence of a value for the randomized…

Optimization and Control · Mathematics 2025-05-13 Magnus Perninge

In this paper we investigate possible approaches to study general time-inconsistent optimization problems without assuming the existence of optimal strategy. This leads immediately to the need to refine the concept of time-consistency as…

Optimization and Control · Mathematics 2016-04-14 Chandrasekhar Karnam , Jin Ma , Jianfeng Zhang

This paper considers a new class of deterministic finite-time horizon, two-player, zero-sum differential games (DGs) in which the maximizing player is allowed to take continuous and impulse controls whereas the minimizing player is allowed…

Optimization and Control · Mathematics 2022-12-21 Brahim El Asri , Hafid Lalioui

Dynamic programming principle (DPP) is fundamental for control and optimization, including Markov decision problems (MDPs), reinforcement learning (RL), and more recently mean-field controls (MFCs). However, in the learning framework of…

Optimization and Control · Mathematics 2022-04-18 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

We consider a general nonzero-sum impulse game with two players. The main mathematical contribution of the paper is a verification theorem which provides, under some regularity conditions, a suitable system of quasi-variational inequalities…

Probability · Mathematics 2018-11-09 René Aïd , Matteo Basei , Giorgia Callegaro , Luciano Campi , Tiziano Vargiolu

In this paper, we present an optimal control problem for stochastic differential games under Markov regime-switching forward-backward stochastic differential equations with jumps and partial information. First, we prove a sufficient maximum…

Optimization and Control · Mathematics 2014-10-14 Olivier Menoukeu Pamen , Romual Herve Momeya

This paper addresses a continuous-time risk-minimizing two-player zero-sum stochastic differential game (SDG), in which each player aims to minimize its probability of failure. Failure occurs in the event when the state of the game enters…

Optimization and Control · Mathematics 2023-08-23 Apurva Patil , Yujing Zhou , David Fridovich-Keil , Takashi Tanaka