English
Related papers

Related papers: The shape of the value function under Poisson opti…

200 papers

In this paper, we consider a varying terminal time structure for the stochastic optimal control problem under state constraints, in which the terminal time varies with the mean value of the state. In this new stochastic optimal control…

Optimization and Control · Mathematics 2024-09-05 Jin Shi , Shuzhen Yang

Infinite horizon optimal stopping problems for a L\'evy processes with a two-sided reward function are considered. A two-sided verification theorem is presented in terms of the overall supremum and the overall infimum of the process. A…

Probability · Mathematics 2019-12-18 Ernesto Mordecki , Facundo Oliú Eguren

This paper is concerned with cost optimization of an insurance company. The surplus of the insurance company is modeled by a controlled regime switching diffusion, where the regime switching mechanism provides the fluctuations of the random…

Optimization and Control · Mathematics 2016-08-02 Chao Zhu

Suppose $X_1,X_2,...$ are i.i.d. nonnegative random variables with finite expectation, and for each $k$, $X_k$ is observed at the $k$-th arrival time $S_k$ of a Poisson process with unit rate which is independent of the sequence $\{X_k\}$.…

Probability · Mathematics 2010-09-08 Pieter C. Allaart

We employ the viscosity solution technique to analyze optimal stopping problems with regime switching. Specifically, we obtain the viscosity property of value functions, the uniqueness of viscosity solutions, the regularity of value…

Optimization and Control · Mathematics 2015-12-25 Yong-Chao Zhang , Na Zhang

We study the optimal multiple stopping time problem defined for each stopping time $S$ by $v(S)=\operatorname {ess}\sup_{\tau_1,...,\tau_d\geq S}E[\psi(\tau_1,...,\tau_d)|\mathcal{F}_S]$. The key point is the construction of a new reward…

Probability · Mathematics 2011-08-30 Magdalena Kobylanski , Marie-Claire Quenez , Elisabeth Rouy-Mironescu

This paper is concerned with stochastic impulse control problems in which the running cost changes depending on the impulse control. Because of such a dependence, it brings several difficulties when the usual dynamic programming principle…

Optimization and Control · Mathematics 2025-11-11 Yuchen Cao , Jiongmin Yong

We study the optimal control of a rate-independent system that is driven by a convex, quadratic energy. Since the associated solution mapping is non-smooth, the analysis of such control problems is challenging. In order to derive optimality…

Optimization and Control · Mathematics 2016-11-04 Ulisse Stefanelli , Gerd Wachsmuth , Daniel Wachsmuth

For an arbitrary diffusion process $X$ with time-homogeneous drift and variance parameters $\mu(x)$ and $\sigma^2(x)$, let $V_\varepsilon$ be $1/\varepsilon$ times the total time $X(t)$ spends in the strip…

Probability · Mathematics 2026-03-03 Nils Lid Hjort , Rafail Zalmonovich Khasminskii

This paper investigates continuity properties of value functions and solutions for parametric optimization problems. These problems are important in operations research, control, and economics because optimality equations are their…

Optimization and Control · Mathematics 2021-09-15 Eugene A. Feinberg , Pavlo O. Kasyanov , David N. Kraemer

We consider stochastic impulse control problems where the process is driven by a general one-dimensional diffusion. We shall show a new mathematical characterization of the value function as a linear function in a certain transformed space.…

Optimization and Control · Mathematics 2007-05-23 Masahiko Egami

A random walk (or a Wiener process), possibly with drift, is observed in a noisy or delayed fashion. The problem considered in this paper is to estimate the first time \tau the random walk reaches a given level. Specifically, the p-moment…

Information Theory · Computer Science 2012-03-22 Marat V. Burnashev , Aslan Tchamkerten

In this paper we study the Poisson process over a $\sigma$-finite measure-space equipped with a measure preserving transformation or a group of measure preserving transformations. For a measure-preserving transformation $T$ acting on a…

Dynamical Systems · Mathematics 2013-10-04 Tom Meyerovitch

We prove the central limit theorem for the volume and the $f$-vector of the Poisson random polytope $\Pi_{\eta}$ in a fixed convex polytope $P\subset\mathbb{R}^d$. Here, $\Pi_{\eta}$ is the convex hull of the intersection of a Poisson…

Probability · Mathematics 2010-10-19 Imre Bárány , Matthias Reitzner

Many discrete-time optimal stopping problems are known to have more tractable limit forms based on a planar Poisson process. Using this tool we find a solution to the optimal stopping problem for i.i.d. sequence of $n$ discrete uniform…

Probability · Mathematics 2026-01-09 Alexander Gnedin

In this paper, we consider a general time-inconsistent optimal control problem for a non homogeneous linear system, in which its state evolves according to a stochastic differential equation with deterministic coefficients, when the noise…

Optimization and Control · Mathematics 2015-05-19 Ishak Alia , Farid Chighoub , Ayesha Sohail

We solve two stochastic control problems in which a player tries to minimize or maximize the exit time from an interval of a Brownian particle, by controlling its drift. The player can change from one drift to another but is subject to a…

Probability · Mathematics 2014-08-19 Robert C. Dalang , Laura Vinckenbosch

We consider the free endpoint Mayer problem for a controlled Moreau process, the control acting as a perturbation of the dynamics driven by the normal cone, and derive necessary optimality conditions of Pontryagin's Maximum Principle type.…

Optimization and Control · Mathematics 2016-10-31 Chems Eddine Arroud , Giovanni Colombo

We consider the problem of global optimization of a function over a continuous domain. In our setup, we can evaluate the function sequentially at points of our choice and the evaluations are noisy. We frame it as a continuum-armed bandit…

Machine Learning · Statistics 2020-07-21 Kinjal Basu , Souvik Ghosh

We introduce a nonasymptotic framework for sub-Poisson distributions with moment generating function dominated by that of a Poisson distribution. At its core is a new notion of optimal sub-Poisson variance proxy, analogous to the variance…

Probability · Mathematics 2025-08-19 Lasse Leskelä , Ian Välimaa