English
Related papers

Related papers: Online Learning to Rank with Feedback at the Top

200 papers

Recommender systems, medical diagnosis, network security, etc., require on-going learning and decision-making in real time. These -- and many others -- represent perfect examples of the opportunities and difficulties presented by Big Data:…

Machine Learning · Computer Science 2023-07-19 Cem Tekin , Mihaela van der Schaar

Object ranking is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects, which are typically represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2018-12-07 Karlson Pfannschmidt , Pritha Gupta , Eyke Hüllermeier

Ranking evaluation metrics are a fundamental element of design and improvement efforts in information retrieval. We observe that most popular metrics disregard information portrayed in the scores used to derive rankings, when available.…

Information Retrieval · Computer Science 2016-12-20 Nuno Moniz , Luís Torgo , João Vinagre

Learning to rank is an important task that has been successfully deployed in many real-world information retrieval systems. Most existing methods compute relevance judgments of documents independently, without holistically considering the…

Information Retrieval · Computer Science 2020-05-11 Shuo Sun , Kevin Duh

We provide the first sub-linear space and sub-linear regret algorithm for online learning with expert advice (against an oblivious adversary), addressing an open question raised recently by Srinivas, Woodruff, Xu and Zhou (STOC 2022). We…

Data Structures and Algorithms · Computer Science 2022-11-09 Binghui Peng , Fred Zhang

Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of…

Machine Learning · Computer Science 2020-05-19 Jaspreet Singh , Zhenye Wang , Megha Khosla , Avishek Anand

Ranking is at the core of Information Retrieval. Classic ranking optimization studies often treat ranking as a sorting problem with the assumption that the best performance of ranking would be achieved if we rank items according to their…

Information Retrieval · Computer Science 2023-04-18 Qingyao Ai , Xuanhui Wang , Michael Bendersky

We study an online linear regression setting in which the observed feature vectors are corrupted by noise and the learner can pay to reduce the noise level. In practice, this may happen for several reasons: for example, because features can…

Machine Learning · Computer Science 2025-11-12 Nadav Merlis , Kyoungseok Jang , Nicolò Cesa-Bianchi

We consider the problem of online learning where the sequence of actions played by the learner must adhere to an unknown safety constraint at every round. The goal is to minimize regret with respect to the best safe action in hindsight…

Machine Learning · Computer Science 2024-03-08 Karthik Sridharan , Seung Won Wilson Yoo

Response selection plays a vital role in building retrieval-based conversation systems. Despite that response selection is naturally a learning-to-rank problem, most prior works take a point-wise view and train binary classifiers for this…

Computation and Language · Computer Science 2020-10-14 Zibo Lin , Deng Cai , Yan Wang , Xiaojiang Liu , Hai-Tao Zheng , Shuming Shi

Many web systems rank and present a list of items to users, from recommender systems to search and advertising. An important problem in practice is to evaluate new ranking policies offline and optimize them before they are deployed. We…

Machine Learning · Computer Science 2018-06-15 Shuai Li , Yasin Abbasi-Yadkori , Branislav Kveton , S. Muthukrishnan , Vishwa Vinay , Zheng Wen

The ability of reinforcement learning algorithms to learn effective policies is determined by the rewards available during training. However, for practical problems, obtaining large quantities of reward labels is often infeasible due to…

Machine Learning · Computer Science 2025-10-02 Shreyas Chaudhari , Renhao Zhang , Philip S. Thomas , Bruno Castro da Silva

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

Information Retrieval · Computer Science 2020-08-06 Nisarg Raval , Manisha Verma

Information systems experience an ever-growing volume of unstructured data, particularly in the form of textual materials. This represents a rich source of information from which one can create value for people, organizations and…

Artificial Intelligence · Computer Science 2017-04-19 Nicolas Pröllochs , Stefan Feuerriegel , Dirk Neumann

Ranked search results have become the main mechanism by which we find content, products, places, and people online. Thus their ordering contributes not only to the satisfaction of the searcher, but also to career and business opportunities,…

Information Retrieval · Computer Science 2020-05-28 Meike Zehlike , Carlos Castillo

We describe mechanisms for the allocation of a scarce resource among multiple users in a way that is efficient, fair, and strategy-proof, but when users do not know their resource requirements. The mechanism is repeated for multiple rounds…

Machine Learning · Statistics 2020-12-17 Kirthevasan Kandasamy , Gur-Eyal Sela , Joseph E Gonzalez , Michael I Jordan , Ion Stoica

Consider a collection of m competing machine learning algorithms. Given their performance on a benchmark of datasets, we would like to identify the best performing algorithm. Specifically, which algorithm is most likely to ``win'' (rank…

Machine Learning · Computer Science 2026-01-06 Amichai Painsky

Traditional approaches to ranking in web search follow the paradigm of rank-by-score: a learned function gives each query-URL combination an absolute score and URLs are ranked according to this score. This paradigm ensures that if the score…

Machine Learning · Computer Science 2012-07-03 Or Sheffet , Nina Mishra , Samuel Ieong

We study an online market-making problem in which a learner sequentially posts bid and ask prices for a single asset while interacting with traders holding private valuations. Unlike existing online learning formulations that assume fully…

Machine Learning · Computer Science 2026-05-20 Davide Maran , Marcello Restelli

As recommender systems become increasingly central for sorting and prioritizing the content available online, they have a growing impact on the opportunities or revenue of their items producers. For instance, they influence which recruiter…

Information Retrieval · Computer Science 2022-09-28 Nicolas Usunier , Virginie Do , Elvis Dohmatob