English
Related papers

Related papers: Optimal Stopping with Multi-Dimensional Comparativ…

200 papers

We show that the mechanism-design problem for a monopolist selling multiple, heterogeneous objects to a buyer with ex ante symmetric and additive values is equivalent to the mechanism-design problem for a monopolist selling identical…

Theoretical Economics · Economics 2024-08-20 Sushil Bikhchandani , Debasis Mishra

We theoretically explore the relationship between sample-efficiency and adaptivity in reinforcement learning. An algorithm is sample-efficient if it uses a number of queries $n$ to the environment that is polynomial in the dimension $d$ of…

Machine Learning · Computer Science 2024-05-29 Emmeran Johnson , Ciara Pike-Burke , Patrick Rebeschini

Measurement incompatibility stipulates the existence of quantum measurements that cannot be carried out simultaneously on single systems. We show that the set of input-output probabilities obtained from d-dimensional classical systems…

Quantum Physics · Physics 2023-06-13 Debashis Saha , Debarshi Das , Arun Kumar Das , Bihalan Bhattacharya , A. S. Majumdar

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-01-03 Piao Hu , Jiashuo Jiang , Guodong Lyu , Hao Su

We consider the non-stochastic Multi-Armed Bandit problem in a setting where there is a fixed and known metric on the action space that determines a cost for switching between any pair of actions. The loss of the online learner has two…

Machine Learning · Computer Science 2017-10-26 Tomer Koren , Roi Livni , Yishay Mansour

In this paper, we analyze deep learning from a mathematical point of view and derive several novel results. The results are based on intriguing mathematical properties of high dimensional spaces. We first look at perturbation based…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Simant Dube

Recently emerging large-scale biomedical data pose exciting opportunities for scientific discoveries. However, the ultrahigh dimensionality and non-negligible measurement errors in the data may create difficulties in estimation. There are…

Methodology · Statistics 2022-10-28 Xin Ma , Suprateek Kundu

The three gap theorem, also known as the Steinhaus conjecture or three distance theorem, states that the gaps in the fractional parts of $\alpha,2\alpha,\ldots, N\alpha$ take at most three distinct values. Motivated by a question of…

Number Theory · Mathematics 2018-07-11 Alan Haynes , Jens Marklof

We study a dynamic market setting where an intermediary interacts with an unknown large sequence of agents that can be either sellers or buyers: their identities, as well as the sequence length $n$, are decided in an adversarial, online…

Computer Science and Game Theory · Computer Science 2017-03-29 Yiannis Giannakopoulos , Elias Koutsoupias , Philip Lazos

We consider a contextual online learning (multi-armed bandit) problem with high-dimensional covariate $\mathbf{x}$ and decision $\mathbf{y}$. The reward function to learn, $f(\mathbf{x},\mathbf{y})$, does not have a particular parametric…

Machine Learning · Computer Science 2022-10-04 Wenhao Li , Ningyuan Chen , L. Jeff Hong

We study the problem of online learning and online regret minimization when samples are drawn from a general unknown non-stationary process. We introduce the concept of a dynamic changing process with cost $K$, where the conditional…

Machine Learning · Computer Science 2023-11-14 Changlong Wu , Ananth Grama , Wojciech Szpankowski

Deep reinforcement learning has achieved impressive successes yet often requires a very large amount of interaction data. This result is perhaps unsurprising, as using complicated function approximation often requires more data to fit, and…

Machine Learning · Computer Science 2020-11-20 Jonathan N. Lee , Aldo Pacchiano , Vidya Muthukumar , Weihao Kong , Emma Brunskill

An open challenge in supervised learning is \emph{conceptual drift}: a data point begins as classified according to one label, but over time the notion of that label changes. Beyond linear autoregressive models, transfer and meta learning…

Optimization and Control · Mathematics 2019-09-13 Amrit Singh Bedi , Alec Koppel , Ketan Rajawat , Brian M. Sadler

We make three contributions to the theory of k-armed adversarial bandits. First, we prove a first-order bound for a modified variant of the INF strategy by Audibert and Bubeck [2009], without sacrificing worst case optimality or modifying…

Machine Learning · Computer Science 2019-07-25 Roman Pogodin , Tor Lattimore

We study the adversarial robustness in offline reinforcement learning. Given a batch dataset consisting of tuples $(s, a, r, s')$, an adversary is allowed to arbitrarily modify $\epsilon$ fraction of the tuples. From the corrupted dataset…

Machine Learning · Computer Science 2021-06-15 Xuezhou Zhang , Yiding Chen , Jerry Zhu , Wen Sun

In the classic prophet inequality, samples from independent random variables arrive online. A gambler that knows the distributions must decide at each point in time whether to stop and pick the current sample or to continue and lose that…

Data Structures and Algorithms · Computer Science 2019-03-13 Jose Correa , Raimundo Saona , Bruno Ziliotto

We study dynamic regret in online convex optimization, where the objective is to achieve low cumulative loss relative to an arbitrary benchmark sequence. By observing that competing with an arbitrary sequence of comparators…

Machine Learning · Computer Science 2025-12-12 Andrew Jacobsen , Alessandro Rudi , Francesco Orabona , Nicolo Cesa-Bianchi

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

Competing risk analysis accounts for multiple mutually exclusive events, improving risk estimation over traditional survival analysis. Despite methodological advancements, a comprehensive comparison of competing risk methods, especially in…

Methodology · Statistics 2025-04-04 Paul M. Djangang , Summer S. Han , Nilotpal Sanyal

We study the role of probe dimension in determining the bounds of precision and the level of incompatibility in multi-parameter quantum estimation problems. In particular, we focus on the paradigmatic case of unitary encoding generated by…

Quantum Physics · Physics 2024-03-13 Alessandro Candeloro , Zahra Pazhotan , Matteo G. A. Paris