English
Related papers

Related papers: Multiclass Online Learnability under Bandit Feedba…

200 papers

Delle Rose et al.~(COLT'23) introduced an effective version of the Vapnik-Chervonenkis dimension, and showed that it characterizes improper PAC learning with total computable learners. In this paper, we introduce and study a similar…

Machine Learning · Computer Science 2024-11-25 Valentino Delle Rose , Alexander Kozachinskiy , Tomasz Steifer

Online learning in large-scale structured bandits is known to be challenging due to the curse of dimensionality. In this paper, we propose a unified meta-learning framework for a general class of structured bandit problems where the…

Machine Learning · Computer Science 2022-03-01 Runzhe Wan , Lin Ge , Rui Song

We consider the problem of online multiclass classification with partial feedback, where an algorithm predicts a class for a new instance in each round and only receives its correctness. Although several methods have been developed for this…

Machine Learning · Computer Science 2019-02-05 Takuo Kaneko , Issei Sato , Masashi Sugiyama

We prove that every concept class with finite Littlestone dimension can be learned by an (approximate) differentially-private algorithm. This answers an open question of Alon et al. (STOC 2019) who proved the converse statement (this…

Machine Learning · Computer Science 2021-06-23 Mark Bun , Roi Livni , Shay Moran

In online binary classification under \emph{apple tasting} feedback, the learner only observes the true label if it predicts ``1". First studied by \cite{helmbold2000apple}, we revisit this classical partial-feedback setting and study…

Machine Learning · Computer Science 2024-06-21 Vinod Raman , Unique Subedi , Ananth Raman , Ambuj Tewari

The standard model and the bandit model are two generalizations of the mistake-bound model to online multiclass classification. In both models the learner guesses a classification in each round, but in the standard model the learner…

Discrete Mathematics · Computer Science 2021-02-02 Jesse Geneson

We study the problem of online multiclass classification in a setting where the learner's feedback is determined by an arbitrary directed graph. While including bandit feedback as a special case, feedback graphs allow a much richer set of…

Machine Learning · Computer Science 2024-02-20 Dirk van der Hoeven , Federico Fusco , Nicolò Cesa-Bianchi

We study the problem of learning robust classifiers where the classifier will receive a perturbed input. Unlike robust PAC learning studied in prior work, here the clean data and its label are also adversarially chosen. We formulate this…

Machine Learning · Computer Science 2026-03-02 Sajad Ashkezari

Most learning to rank research has assumed that the utility of different documents is independent, which results in learned ranking functions that return redundant results. The few approaches that avoid this have rather unsatisfyingly…

Machine Learning · Computer Science 2012-09-04 Aleksandrs Slivkins , Filip Radlinski , Sreenivas Gollapudi

Adaptive and sequential experiment design is a well-studied area in numerous domains. We survey and synthesize the work of the online statistical learning paradigm referred to as multi-armed bandits integrating the existing research as a…

Machine Learning · Statistics 2015-11-04 Giuseppe Burtini , Jason Loeppky , Ramon Lawrence

We study the online learnability of hypothesis classes with respect to arbitrary, but bounded loss functions. No characterization of online learnability is known at this level of generality. We give a new scale-sensitive combinatorial…

Machine Learning · Computer Science 2024-02-12 Vinod Raman , Unique Subedi , Ambuj Tewari

Traditional online learning models are typically initialized from scratch. By contrast, contemporary real-world applications often have access to historical datasets that can potentially enhanced the online learning processes. We study how…

Machine Learning · Computer Science 2025-12-19 Wang Chi Cheung , Lixing Lyu

This paper addresses the problem of multiclass classification with corrupted or noisy bandit feedback. In this setting, the learner may not receive true feedback. Instead, it receives feedback that has been flipped with some non-zero…

Machine Learning · Computer Science 2021-06-08 Mudit Agarwal , Naresh Manwani

We study the task of online learning in the presence of Massart noise. Instead of assuming that the online adversary chooses an arbitrary sequence of labels, we assume that the context $\mathbf{x}$ is selected adversarially but the label…

Machine Learning · Computer Science 2024-05-22 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

Machine Learning · Statistics 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

We study the problem of efficient online multiclass linear classification with bandit feedback, where all examples belong to one of $K$ classes and lie in the $d$-dimensional Euclidean space. Previous works have left open the challenge of…

We study the sample complexity of multiclass prediction in several learning settings. For the PAC setting our analysis reveals a surprising phenomenon: In sharp contrast to binary classification, we show that there exist multiclass…

Machine Learning · Computer Science 2016-04-19 Amit Daniely , Sivan Sabato , Shai Ben-David , Shai Shalev-Shwartz

We investigate the feasibility of learning from a mix of both fully-labeled supervised data and contextual bandit data. We specifically consider settings in which the underlying learning signal may be different between these two data…

Machine Learning · Computer Science 2019-06-25 Chicheng Zhang , Alekh Agarwal , Hal Daumé , John Langford , Sahand N Negahban

We study the attainable regret for online linear optimization problems with bandit feedback, where unlike the full-information setting, the player can only observe its own loss rather than the full loss vector. We show that the price of…

Machine Learning · Computer Science 2014-08-12 Ohad Shamir

We study an online decision making problem where on each round a learner chooses a list of items based on some side information, receives a scalar feedback value for each individual item, and a reward that is linearly related to this…

Machine Learning · Computer Science 2016-11-07 Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudik