English
Related papers

Related papers: New Optional Stopping Theorems and Maximal Inequal…

200 papers

We construct a class of nonnegative martingale processes that oscillate indefinitely with high probability. For these processes, we state a uniform rate of the number of oscillations and show that this rate is asymptotically close to the…

Machine Learning · Computer Science 2014-08-18 Jan Leike , Marcus Hutter

This paper deals with the optimal stopping problem under partial observation for piecewise-deterministic Markov processes. We first obtain a recursive formulation of the optimal filter process and derive the dynamic programming equation of…

Probability · Mathematics 2013-05-28 Adrien Brandejsky , Benoîte de Saporta , François Dufour

In this paper, we derive first-order Pontryagin optimality conditions for risk-averse stochastic optimal control problems subject to final time inequality constraints, and whose costs are general, possibly non-smooth finite coherent risk…

Optimization and Control · Mathematics 2023-05-30 Riccardo Bonalli , Benoît Bonnet

This paper introduces a new class of optimal switching problems, where the player is allowed to switch at a sequence of exogenous Poisson arrival times, and the underlying switching system is governed by an infinite horizon backward…

Probability · Mathematics 2014-03-07 Gechun Liang , Wei Wei

We present a generalization of the maximal inequalities that upper bound the expectation of the maximum of $n$ jointly distributed random variables. We control the expectation of a randomly selected random variable from $n$ jointly…

Probability · Mathematics 2017-08-31 Jiantao Jiao , Yanjun Han , Tsachy Weissman

Many decision problems in economics, information technology, and industry can be transformed to an optimal stopping of adapted random vectors with some utility function over the set of Markov times with respect to filtration build by the…

Optimization and Control · Mathematics 2020-11-04 Krzysztof Szajowski

We consider stochastic dynamical systems defined by differential equations with a uniform random time delay. The latter equations are shown to be equivalent to deterministic higher-order differential equations: for an $n$-th order equation…

Statistical Mechanics · Physics 2011-10-11 P. L. Krapivsky , J. M. Luck , K. Mallick

We prove a general existence result in stochastic optimal control in discrete time where controls take values in conditional metric spaces, and depend on the current state and the information of past decisions through the evolution of a…

Optimization and Control · Mathematics 2018-12-19 Asgar Jamneshan , Michael Kupper , José Miguel Zapata

Our purpose is to study a particular class of optimal stopping problems for Markov processes. We justify the value function convexity and we deduce that there exists a boundary function such that the smallest optimal stopping time is the…

Probability · Mathematics 2013-07-22 Diana Dorobantu

For a discrete time Markov chain and in line with Strotz' consistent planning we develop a framework for problems of optimal stopping that are time-inconsistent due to the consideration of a non-linear function of an expected reward. We…

Optimization and Control · Mathematics 2020-01-23 Sören Christensen , Kristoffer Lindensjö

We establish a new class of functional central limit theorems for partial sum of certain symmetric stationary infinitely divisible processes with regularly varying L\'{e}vy measures. The limit process is a new class of symmetric stable…

Probability · Mathematics 2015-01-16 Takashi Owada , Gennady Samorodnitsky

We study a control problem where the state equation is a nonlinear partial differential equation of the calculus of variation in a bounded domain, perturbed by noise. We allow the control to act on the boundary and set stochastic boundary…

Probability · Mathematics 2025-11-26 Stefano Bonaccorsi , Adrian Zalinescu

We study single-machine scheduling of jobs, each belonging to a job type that determines its duration distribution. We start by analyzing the scenario where the type characteristics are known and then move to two learning scenarios where…

Machine Learning · Computer Science 2023-06-02 Nadav Merlis , Hugo Richard , Flore Sentenac , Corentin Odic , Mathieu Molina , Vianney Perchet

This paper deals with partially-observed optimal control problems for the state governed by stochastic differential equation with delay. We develop a stochastic maximum principle for this kind of optimal control problems using a variational…

Optimization and Control · Mathematics 2020-10-15 Shuaiqi Zhang , Xun Li , Jie Xiong

The topic of this manuscript is the stability analysis of continuous-time switched nonlinear systems with constraints on the admissible switching signals. Our particular focus lies in considering signals characterized by upper and lower…

Optimization and Control · Mathematics 2024-01-17 Matteo Della Rossa

This paper provides necessary conditions of optimality for optimal control problems with time delays in both state and control variables. Different versions of the necessary conditions cover fixed end-time problems and, under additional…

Dynamical Systems · Mathematics 2017-01-09 Andrea Boccia , Richard B. Vinter

Opportunistic detection rules (ODRs) are variants of fixed-sample-size detection rules in which the statistician is allowed to make an early decision on the alternative hypothesis opportunistically based on the sequentially observed…

Information Theory · Computer Science 2016-02-15 Wenyi Zhang , George V. Moustakides , H. Vincent Poor

Assessment of the degree of boundedness/stability of multidimensional nonlinear systems with time-dependent and nonperiodic coefficients is an important problem in various applied areas which has no adequate resolution yet. Most of the…

Dynamical Systems · Mathematics 2022-06-07 Mark A. Pinsky

In this paper, we consider a varying terminal time structure for the stochastic optimal control problem under state constraints, in which the terminal time varies with the mean value of the state. In this new stochastic optimal control…

Optimization and Control · Mathematics 2024-09-05 Jin Shi , Shuzhen Yang

Consider the problem on sequential change-point detection on multiple data streams. We provide the asymptotic lower bounds of the detection delays at all levels of change-point sparsity and we derive a smaller asymptotic lower bound of the…

Statistics Theory · Mathematics 2023-06-02 Jingyan Huang