English
Related papers

Related papers: Learning with Comparison Feedback: Online Estimati…

200 papers

In the context of large samples, a small number of individuals might spoil basic statistical indicators like the mean. It is difficult to detect automatically these atypical individuals, and an alternative strategy is using robust…

Machine Learning · Statistics 2023-04-04 Antoine Godichon-Baggioni , Wei Lu

Optimizing an interactive system against a predefined online metric is particularly challenging, when the metric is computed from user feedback such as clicks and payments. The key challenge is the counterfactual nature: in the case of Web…

Machine Learning · Computer Science 2014-03-13 Lihong Li , Shunbao Chen , Jim Kleban , Ankur Gupta

We study the task of online learning in the presence of Massart noise. Instead of assuming that the online adversary chooses an arbitrary sequence of labels, we assume that the context $\mathbf{x}$ is selected adversarially but the label…

Machine Learning · Computer Science 2024-05-22 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We extend the standard online worst-case model to accommodate past experience which is available to the online player in many practical scenarios. We do this by revealing a random sample of the adversarial input to the online player ahead…

Data Structures and Algorithms · Computer Science 2019-07-12 Haim Kaplan , David Naori , Danny Raz

Inverse optimization is a powerful paradigm for learning preferences and restrictions that explain the behavior of a decision maker, based on a set of external signal and the corresponding decision pairs. However, most inverse optimization…

Machine Learning · Computer Science 2018-11-05 Chaosheng Dong , Yiran Chen , Bo Zeng

Learning theory has largely focused on two main learning scenarios. The first is the classical statistical setting where instances are drawn i.i.d. from a fixed distribution and the second scenario is the online learning, completely…

Machine Learning · Statistics 2011-04-28 Alexander Rakhlin , Karthik Sridharan , Ambuj Tewari

We study online classification of features into labels with general hypothesis classes. In our setting, true labels are determined by some function within the hypothesis class but are corrupted by unknown stochastic noise, and the features…

Machine Learning · Computer Science 2024-09-27 Changlong Wu , Ananth Grama , Wojciech Szpankowski

Paired comparison data, where users evaluate items in pairs, play a central role in ranking and preference learning tasks. While ordinal comparison data intuitively offer richer information than binary comparisons, this paper challenges…

Machine Learning · Statistics 2026-01-13 Shirong Xu , Jingnan Zhang , Junhui Wang

Contextual dueling bandit is used to model the bandit problems, where a learner's goal is to find the best arm for a given context using observed noisy human preference feedback over the selected arms for the past contexts. However,…

Machine Learning · Computer Science 2025-04-17 Arun Verma , Zhongxiang Dai , Xiaoqiang Lin , Patrick Jaillet , Bryan Kian Hsiang Low

We study the adversarial online learning problem and create a completely online algorithmic framework that has data dependent regret guarantees in both full expert feedback and bandit feedback settings. We study the expected performance of…

Machine Learning · Computer Science 2023-03-14 Kaan Gokcesu , Hakan Gokcesu

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

When the number of subjects, $n$, is large, paired comparisons are often sparse. Here, we study statistical inference in a class of paired comparison models parameterized by a set of merit parameters, under an Erd\"{o}s--R\'{e}nyi…

Statistics Theory · Mathematics 2025-11-17 Qiuping Wang , Lu Pan , Ting Yan

We study the control of a linear dynamical system with adversarial disturbances (as opposed to statistical noise). The objective we consider is one of regret: we desire an online control procedure that can do nearly as well as that of a…

Machine Learning · Computer Science 2019-02-26 Naman Agarwal , Brian Bullins , Elad Hazan , Sham M. Kakade , Karan Singh

Comparing two (large) language models (LMs) side-by-side and pinpointing their prediction similarities and differences on the same set of inputs are crucial in many real-world scenarios, e.g., one can test if a licensed model was…

Computation and Language · Computer Science 2024-12-18 Weitang Liu , Yuelei Li , Ying Wai Li , Zihan Wang , Jingbo Shang

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss using a randomized…

Machine Learning · Statistics 2019-02-26 Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Adversarial examples have recently drawn considerable attention in the field of machine learning due to the fact that small perturbations in the data can result in major performance degradation. This phenomenon is usually modeled by a…

Machine Learning · Computer Science 2022-03-10 Payam Delgosha , Hamed Hassani , Ramtin Pedarsani

Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness,…

Machine Learning · Computer Science 2021-11-02 Maor Ivgi , Jonathan Berant

We study the problem of clustering a set of items from binary user feedback. Such a problem arises in crowdsourcing platforms solving large-scale labeling tasks with minimal effort put on the users. For example, in some of the recent…

Machine Learning · Statistics 2024-12-20 Kaito Ariu , Jungseul Ok , Alexandre Proutiere , Se-Young Yun

We present statistical methods for big data arising from online analytical processing, where large amounts of data arrive in streams and require fast analysis without storage/access to the historical data. In particular, we develop…

Computation · Statistics 2018-06-13 Elizabeth D. Schifano , Jing Wu , Chun Wang , Jun Yan , Ming-Hui Chen

We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the…

Machine Learning · Computer Science 2024-05-28 Yogev Bar-On , Yishay Mansour