English
Related papers

Related papers: On the Minimax Regret of Sequential Probability As…

200 papers

This work addresses the mediator feedback problem, a bandit game where the decision set consists of a number of policies, each associated with a probability distribution over a common space of outcomes. Upon choosing a policy, the learner…

Machine Learning · Computer Science 2024-02-19 Khaled Eldowa , Nicolò Cesa-Bianchi , Alberto Maria Metelli , Marcello Restelli

We consider the setting of online logistic regression and consider the regret with respect to the 2-ball of radius B. It is known (see [Hazan et al., 2014]) that any proper algorithm which has logarithmic regret in the number of samples…

Machine Learning · Computer Science 2020-11-04 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We consider the setting of online linear regression for arbitrary deterministic sequences, with the square loss. We are interested in the aim set by Bartlett et al. (2015): obtain regret bounds that hold uniformly over all competitor…

Machine Learning · Statistics 2019-02-26 Pierre Gaillard , Sébastien Gerchinovitz , Malo Huard , Gilles Stoltz

Multi-criteria decision-making often requires finding a small representative set from the database. A recently proposed method is the regret minimization set (RMS) query. RMS returns a size $r$ subset $S$ of dataset $D$ that minimizes the…

Machine Learning · Computer Science 2022-03-10 Xingxing Xiao , Jianzhong Li

We study the problem of nonstochastic bandits with expert advice, extending the setting from finitely many experts to any countably infinite set: A learner aims to maximize the total reward by taking actions sequentially based on bandit…

Machine Learning · Computer Science 2021-03-29 X. Flora Meng , Tuhin Sarkar , Munther A. Dahleh

The problem of bipartite ranking, where instances are labeled positive or negative and the goal is to learn a scoring function that minimizes the probability of mis-ranking a pair of positive and negative instances (or equivalently, that…

Machine Learning · Computer Science 2014-08-13 Shivani Agarwal

We consider the problem of transfer learning in an online setting. Different tasks are presented sequentially and processed by a within-task algorithm. We propose a lifelong learning strategy which refines the underlying data representation…

Machine Learning · Statistics 2019-10-14 Pierre Alquier , The Tien Mai , Massimiliano Pontil

We study the problem of learning Markov decision processes with finite state and action spaces when the transition probability distributions and loss functions are chosen adversarially and are allowed to change with time. We introduce an…

Machine Learning · Computer Science 2013-03-14 Yasin Abbasi-Yadkori , Peter L. Bartlett , Csaba Szepesvari

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

Machine Learning · Computer Science 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

We revisit the classical problem of multiclass classification with bandit feedback (Kakade, Shalev-Shwartz and Tewari, 2008), where each input classifies to one of $K$ possible labels and feedback is restricted to whether the predicted…

Machine Learning · Computer Science 2024-06-21 Liad Erez , Alon Cohen , Tomer Koren , Yishay Mansour , Shay Moran

In this paper, we study the problem of stochastic linear bandits with finite action sets. Most of existing work assume the payoffs are bounded or sub-Gaussian, which may be violated in some scenarios such as financial markets. To settle…

Machine Learning · Computer Science 2020-04-29 Bo Xue , Guanghui Wang , Yimu Wang , Lijun Zhang

This paper studies the stochastic linear bandit problem, where a decision-maker chooses actions from possibly time-dependent sets of vectors in $\mathbb{R}^d$ and receives noisy rewards. The objective is to minimize regret, the difference…

Machine Learning · Computer Science 2023-04-24 Nima Hamidi , Mohsen Bayati

We investigate an extension of classical empirical risk minimization, where the hypothesis space consists of a random subspace within a given Hilbert space. Specifically, we examine the Nystr\"om method where the subspaces are defined by a…

Machine Learning · Statistics 2025-03-18 Andrea Della Vecchia , Ernesto De Vito , Jaouad Mourtada , Lorenzo Rosasco

The theory of reinforcement learning has focused on two fundamental problems: achieving low regret, and identifying $\epsilon$-optimal policies. While a simple reduction allows one to apply a low-regret algorithm to obtain an…

Machine Learning · Computer Science 2022-06-23 Andrew Wagenmaker , Max Simchowitz , Kevin Jamieson

We study the problem of stochastic contextual bandits in the agnostic setting, where the goal is to compete with the best policy in a given class without assuming realizability or imposing model restrictions on losses or rewards. In this…

Machine Learning · Statistics 2026-04-06 Samuel Girard , Aurelien Bibaut , Arthur Gretton , Nathan Kallus , Houssam Zenati

The parameters for a Markov Decision Process (MDP) often cannot be specified exactly. Uncertain MDPs (UMDPs) capture this model ambiguity by defining sets which the parameters belong to. Minimax regret has been proposed as an objective for…

Artificial Intelligence · Computer Science 2023-02-14 Marc Rigter , Bruno Lacerda , Nick Hawes

Online reinforcement learning in infinite-horizon Markov decision processes (MDPs) remains less theoretically and algorithmically developed than its episodic counterpart, with many algorithms suffering from high ``burn-in'' costs and…

Machine Learning · Computer Science 2026-03-26 Guy Zamir , Matthew Zurek , Yudong Chen

Most results regarding Skorokhod embedding problems (SEP) so far rely on the assumption that the corresponding stopped process is uniformly integrable, which is equivalent to the convex ordering condition…

Probability · Mathematics 2020-01-01 Jiajie Wang

We study the $K$-armed dueling bandit problem, a variation of the standard stochastic bandit problem where the feedback is limited to relative comparisons of a pair of arms. We introduce a tight asymptotic regret lower bound that is based…

Machine Learning · Statistics 2015-06-30 Junpei Komiyama , Junya Honda , Hisashi Kashima , Hiroshi Nakagawa

The problem of regret minimization for online adaptive control of linear-quadratic systems is studied. In this problem, the true system transition parameters (matrices $A$ and $B$) are unknown, and the objective is to design and analyze…

Optimization and Control · Mathematics 2022-10-31 Mohammad Akbari , Bahman Gharesifard , Tamas Linder