English
Related papers

Related papers: Optimal Stopping with Rank-Dependent Loss

200 papers

We prove a general existence result in stochastic optimal control in discrete time where controls take values in conditional metric spaces, and depend on the current state and the information of past decisions through the evolution of a…

Optimization and Control · Mathematics 2018-12-19 Asgar Jamneshan , Michael Kupper , José Miguel Zapata

We will investigate the value and inactive region of optimal stopping and one-sided singular control problems by focusing on two fundamental ratios. We shall see that these ratios unambiguously characterize the solution, although usually…

Probability · Mathematics 2015-02-10 Pekka Matomäki

We study the existence of optimal actions in a zero-sum game $\inf_{\tau}\sup_PE^P[X_{\tau}]$ between a stopper and a controller choosing a probability measure. This includes the optimal stopping problem $\inf_{\tau}\mathcal{E}(X_{\tau})$…

Optimization and Control · Mathematics 2015-09-10 Marcel Nutz , Jianfeng Zhang

The problem of ranking/ordering instances, instead of simply classifying them, has recently gained much attention in machine learning. In this paper we formulate the ranking problem in a rigorous statistical framework. The goal is to learn…

Statistics Theory · Mathematics 2016-08-16 Stéphan Clémençon , Gábor Lugosi , Nicolas Vayatis

Markov reward processes (MRPs) are used to model stochastic phenomena arising in operations research, control engineering, robotics, and artificial intelligence, as well as communication and transportation networks. In many of these cases,…

Machine Learning · Statistics 2020-09-17 Ashwin Pananjady , Martin J. Wainwright

We consider a vibrating string that is fixed at one end with Neumann control action at the other end. We investigate the optimal control problem of steering this system from given initial data to rest, in time T , by minimizing an objective…

Optimization and Control · Mathematics 2015-05-20 Martin Gugat , Emmanuel Trélat , Enrique Zuazua

The problem of sequential probability forecasting is considered in the most general setting: a model set C is given, and it is required to predict as well as possible if any of the measures (environments) in C is chosen to generate the…

Machine Learning · Computer Science 2019-10-25 Daniil Ryabko

The problem of optimal stopping with finite horizon in discrete time is considered in view of maximizing the expected gain. The algorithm proposed in this paper is completely nonparametric in the sense that it uses observed data from the…

Statistics Theory · Mathematics 2013-07-24 Michael Kohler , Harro Walk

The standard theory of optimal stopping is based on the idealised assumption that the underlying process is essentially known. In this paper, we drop this restriction and study data-driven optimal stopping for a general diffusion process,…

Statistics Theory · Mathematics 2023-12-12 Sören Christensen , Niklas Dexheimer , Claudia Strauch

The objective in this paper is to obtain fast converging reinforcement learning algorithms to approximate solutions to the problem of discounted cost optimal stopping in an irreducible, uniformly ergodic Markov chain, evolving on a compact…

Systems and Control · Computer Science 2019-10-01 Shuhang Chen , Adithya M. Devraj , Ana Bušić , Sean P. Meyn

We study the optimal investment stopping problem in both continuous and discrete case, where the investor needs to choose the optimal trading strategy and optimal stopping time concurrently to maximize the expected utility of terminal…

Mathematical Finance · Quantitative Finance 2020-05-01 Dingqian Sun

We obtain the first probabilistic proof of continuous differentiability of time-dependent optimal boundaries in optimal stopping problems. The underlying stochastic dynamics is a one-dimensional, time-inhomogeneous diffusion. The gain…

Probability · Mathematics 2024-05-28 Tiziano De Angelis , Damien Lamberton

We consider the $[0,1]$-valued regression problem in the i.i.d. setting. In a related problem called cost-sensitive classification, \citet{foster21efficient} have shown that the log loss minimizer achieves an improved generalization bound…

Machine Learning · Computer Science 2025-07-18 Yinan Li , Kwang-Sung Jun

In this paper we study the problem of stopping a Brownian bridge $X$ in order to maximise the expected value of an exponential gain function. In particular, we solve the stopping problem $$\sup_{0\le \tau\le…

Probability · Mathematics 2020-05-06 Tiziano De Angelis , Alessandro Milazzo

It is known that the decision to purchase an annuity may be associated to an optimal stopping problem. However, little is known about optimal strategies, if the mortality force is a generic function of time and if the `subjective' life…

Mathematical Finance · Quantitative Finance 2018-07-13 Tiziano De Angelis , Gabriele Stabile

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

In multi-armed bandit problems, the typical goal is to identify the arm with the highest reward. This paper explores a threshold-based bandit problem, aiming to select an arm based on its relation to a prescribed threshold \(\tau \). We…

Machine Learning · Computer Science 2025-09-03 Chanakya Varude , Jay Chaudhary , Siddharth Kaushik , Prasanna Chaporkar

Infinite-time nonlinear optimal regulation control is widely utilized in aerospace engineering as a systematic method for synthesizing stable controllers. However, conventional methods often rely on linearization hypothesis, while recent…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Han Wang , Di Wu , Lin Cheng , Shengping Gong , Xu Huang

We study a mathematical model motivated by the support/resistance line method in technical analysis where the underlying stock price transitions between three states of nature in a path-dependent manner. For optimal stopping problems with…

Trading and Market Microstructure · Quantitative Finance 2025-04-15 Vicky Henderson , Saul Jacka , Ruiqi Liu , Jun Maeda

Let $X$ be a one-dimensional diffusion and let $g\colon[0,T]\times\mathbb{R}\to\mathbb{R}$ be a payoff function depending on time and the value of $X$. The paper analyzes the inverse optimal stopping problem of finding a time-dependent…

Optimization and Control · Mathematics 2017-08-08 Thomas Kruse , Philipp Strack