English
Related papers

Related papers: Ordinal Optimisation and the Offline Multiple Nois…

200 papers

We study contextual stochastic optimization problems, where we leverage rich auxiliary observations (e.g., product characteristics) to improve decision making with uncertain variables (e.g., demand). We show how to train forest decision…

Optimization and Control · Mathematics 2022-03-17 Nathan Kallus , Xiaojie Mao

We study Matching and other related problems in a partial information setting where the agents' utilities for being matched to other agents are hidden and the mechanism only has access to ordinal preference information. Our model is…

Computer Science and Game Theory · Computer Science 2016-08-03 Elliot Anshelevich , Shreyas Sekar

We revisit three fundamental problems in algorithms under uncertainty: the Secretary Problem, Prophet Inequality, and Stochastic Probing, each subject to general downward-closed constraints. When elements have binary values, all three…

Data Structures and Algorithms · Computer Science 2026-04-02 Aviad Rubinstein , Sahil Singla

In this work we introduce a novel approach, based on sampling, for finding assignments that are likely to be solutions to stochastic constraint satisfaction problems and constraint optimisation problems. Our approach reduces the size of the…

Optimization and Control · Mathematics 2015-09-22 Roberto Rossi , Brahim Hnich , S. Armagan Tarim , Steven Prestwich

We define and study a new variant of the secretary problem. Whereas in the classic setting multiple secretaries compete for a single position, we study the case where the secretaries arrive one at a time and are assigned, in an on-line…

Computer Science and Game Theory · Computer Science 2017-05-05 Yakov Babichenko , Yuval Emek , Michal Feldman , Boaz Patt-Shamir , Ron Peretz , Rann Smorodinsky

In this paper, we consider convex stochastic optimization problems arising in machine learning applications (e.g., risk minimization) and mathematical statistics (e.g., maximum likelihood estimation). There are two main approaches to solve…

Optimization and Control · Mathematics 2022-03-03 Darina Dvinskikh , Vitali Pirau , Alexander Gasnikov

A fundamental challenge in model-based offline reinforcement learning (RL) lies in the trade-off between generalization and robustness against exploitation errors in out-of-distribution (OOD) regions. While OOD samples may capture valid…

Artificial Intelligence · Computer Science 2026-05-11 Hongqiang Lin , Dongxu Zhang , Yiding Sun , Mingzhe Li , Ning Yang , Haijun Zhang

This work considers the problem of the noisy binary search in a sorted array. The noise is modeled by a parameter $p$ that dictates that a comparison can be incorrect with probability $p$, independently of other queries. We state two types…

Data Structures and Algorithms · Computer Science 2025-02-27 Dariusz Dereniowski , Aleksander Łukasiewicz , Przemysław Uznański

We consider two variants of the secretary problem, the\emph{ Best-or-Worst} and the \emph{Postdoc} problems, which are closely related. First, we prove that both variants, in their standard form with binary payoff 1 or 0, share the same…

Probability · Mathematics 2017-06-23 L. Bayon , P. Fortuny Ayuso , J. M. Grau , A. M. Oller-Marcen , M. M. Ruiz

Model selection is often performed by empirical risk minimization. The quality of selection in a given situation can be assessed by risk bounds, which require assumptions both on the margin and the tails of the losses used. Starting with…

Statistics Theory · Mathematics 2008-12-18 Charles Mitchell , Sara van de Geer

Language Models are extremely susceptible to performance collapse with even small changes to input prompt strings. Libraries such as DSpy (from Stanford NLP) avoid this problem through demonstration-based prompt optimisation. Inspired by…

Computation and Language · Computer Science 2025-11-25 Maanas Taneja

In the "secretary problem", well-known in the theory of optimal stopping, an employer is about to interview a maximum of N secretaries about which she has no prior information. Chow et al. proved that with an optimal strategy the expected…

Combinatorics · Mathematics 2007-05-23 Kimmo Eriksson , Jonas Sjostrand , Pontus Strimling

Offline reinforcement learning seeks to utilize offline (observational) data to guide the learning of (causal) sequential decision making strategies. The hope is that offline reinforcement learning coupled with function approximation…

Machine Learning · Computer Science 2020-10-23 Ruosong Wang , Dean P. Foster , Sham M. Kakade

Many online problems are studied in stochastic settings for which inputs are samples from a known distribution, given in advance, or from an unknown distribution. Such distributions model both beyond-worst-case inputs and, when given,…

Data Structures and Algorithms · Computer Science 2025-11-13 Gregory Kehne , Thomas Kesselheim

There are two major models of value uncertainty in the optimal stopping literature: the secretary model, which assumes no prior knowledge, and the prophet inequality model, which assumes full information about value distributions. In…

Data Structures and Algorithms · Computer Science 2026-03-03 Tian Bai , Zhiyi Huang , Chui Shan Lee , Dongchen Li

We study the secure stochastic convex optimization problem. A learner aims to learn the optimal point of a convex function through sequentially querying a (stochastic) gradient oracle. In the meantime, there exists an adversary who aims to…

Machine Learning · Computer Science 2021-04-06 Wei Tang , Chien-Ju Ho , Yang Liu

Multi-objective optimization is a type of decision making problems where multiple conflicting objectives are optimized. We study offline optimization of multi-objective policies from data collected by an existing policy. We propose a…

Machine Learning · Computer Science 2023-10-31 Shima Alizadeh , Aniruddha Bhargava , Karthick Gopalswamy , Lalit Jain , Branislav Kveton , Ge Liu

Probabilistic conditioning is concerned with the identification of a distribution of a random variable $X$ given a random variable $Y$. It is a cornerstone of scientific and engineering applications where modeling uncertainty is key. This…

Machine Learning · Statistics 2026-05-13 Panos Tsimpos , Edoardo Calvello , Ayoub Belhadji , Nicholas H. Nelsen

The well-known secretary problem in sequential analysis and optimal stopping theory asks one to maximize the probability of finding the optimal candidate in a sequentially examined list under the constraint that accept/reject decisions are…

Combinatorics · Mathematics 2021-07-13 Xujun Liu , Olgica Milenkovic

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev