English
Related papers

Related papers: Online Learning to Rank in Stochastic Click Models

200 papers

Online strategic classification studies settings in which agents strategically modify their features to obtain favorable predictions. For example, given a classifier that determines loan approval based on credit scores, applicants may open…

Machine Learning · Computer Science 2026-02-09 Chase Hutton , Adam Melrod , Han Shao

We consider a special case of bandit problems, named batched bandits, in which an agent observes batches of responses over a certain time period. Unlike previous work, we consider a more practically relevant batch-centric scenario of batch…

Machine Learning · Computer Science 2023-04-04 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

This tutorial covers and contrasts the two main methodologies in unbiased Learning to Rank (LTR): Counterfactual LTR and Online LTR. There has long been an interest in LTR from user interactions, however, this form of implicit feedback is…

Information Retrieval · Computer Science 2019-07-18 Harrie Oosterhuis , Rolf Jagerman , Maarten de Rijke

Online learning represents an important family of machine learning algorithms, in which a learner attempts to resolve an online prediction (or any type of decision-making) task by learning a model/hypothesis from a sequence of data…

Machine Learning · Computer Science 2018-10-23 Steven C. H. Hoi , Doyen Sahoo , Jing Lu , Peilin Zhao

Distributed, online data mining systems have emerged as a result of applications requiring analysis of large amounts of correlated and high-dimensional data produced by multiple distributed data sources. We propose a distributed online data…

Machine Learning · Computer Science 2013-07-03 Cem Tekin , Mihaela van der Schaar

This paper considers the problem of document ranking in information retrieval systems by Learning to Rank. We propose ConvRankNet combining a Siamese Convolutional Neural Network encoder and the RankNet ranking model which could be trained…

Information Retrieval · Computer Science 2018-02-27 Baoyang Song

Unbiased learning to rank has been proposed to alleviate the biases in the search ranking, making it possible to train ranking models with user interaction data. In real applications, search engines are designed to display only the most…

Information Retrieval · Computer Science 2024-06-14 Haiyuan Zhao , Jun Xu , Xiao Zhang , Guohao Cai , Zhenhua Dong , Ji-Rong Wen

The online knapsack problem is a classic online resource allocation problem in networking and operations research. Its basic version studies how to pack online arriving items of different sizes and values into a capacity-limited knapsack.…

Data Structures and Algorithms · Computer Science 2023-03-16 Bo Sun , Lin Yang , Mohammad Hajiesmaili , Adam Wierman , John C. S. Lui , Don Towsley , Danny H. K. Tsang

Ranking problems, also known as preference learning problems, define a widely spread class of statistical learning problems with many applications, including fraud detection, document ranking, medicine, credit risk screening, image ranking…

Machine Learning · Computer Science 2020-12-17 Tino Werner

Bandit learning has been an increasingly popular design choice for recommender system. Despite the strong interest in bandit learning from the community, there remains multiple bottlenecks that prevent many bandit learning approaches from…

Information Retrieval · Computer Science 2023-08-01 Hongbo Guo , Ruben Naeff , Alex Nikulkov , Zheqing Zhu

We study the ranking problem in generalized linear bandits. At each time, the learning agent selects an ordered list of items and observes stochastic outcomes. In recommendation systems, displaying an ordered list of the most attractive…

Machine Learning · Statistics 2024-01-03 Amitis Shidani , George Deligiannidis , Arnaud Doucet

Learning to Rank (LTR) from user interactions is challenging as user feedback often contains high levels of bias and noise. At the moment, two methodologies for dealing with bias prevail in the field of LTR: counterfactual methods that…

Information Retrieval · Computer Science 2019-07-16 Rolf Jagerman , Harrie Oosterhuis , Maarten de Rijke

We extend the theory of boosting for regression problems to the online learning setting. Generalizing from the batch setting for boosting, the notion of a weak learning algorithm is modeled as an online learning algorithm with linear loss…

Machine Learning · Computer Science 2015-11-03 Alina Beygelzimer , Elad Hazan , Satyen Kale , Haipeng Luo

The page presentation biases in the information retrieval system, especially on the click behavior, is a well-known challenge that hinders improving ranking models' performance with implicit user feedback. Unbiased Learning to Rank~(ULTR)…

Information Retrieval · Computer Science 2024-06-14 Haitao Mao , Lixin Zou , Yujia Zheng , Jiliang Tang , Xiaokai Chu , Jiashu Zhao , Qian Wang , Dawei Yin

The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual…

Machine Learning · Statistics 2025-04-22 Qiyu Han , Will Wei Sun , Yichen Zhang

ListNet is a well-known listwise learning to rank model and has gained much attention in recent years. A particular problem of ListNet, however, is the high computation complexity in model training, mainly due to the large number of object…

Information Retrieval · Computer Science 2015-11-03 Tianyi Luo , Dong Wang , Rong Liu , Yiqiao Pan

This paper examines whether widely used online learning algorithms in pricing can independently reach competitive outcomes or instead foster tacit collusion. This issue has drawn considerable attention from competition regulators as…

Computer Science and Game Theory · Computer Science 2025-11-25 Martin Bichler , Julius Durmann , Matthias Oberlechner

In digital health and EdTech, recommendation systems face a significant challenge: users often choose impulsively, in ways that conflict with the platform's long-term payoffs. This misalignment makes it difficult to effectively learn to…

Machine Learning · Computer Science 2024-02-22 Arpit Agarwal , Rad Niazadeh , Prathamesh Patil

Many platforms on the web present ranked lists of content to users, typically optimized for engagement-, satisfaction- or retention- driven metrics. Advances in the Learning-to-Rank (LTR) research literature have enabled rapid growth in…

Information Retrieval · Computer Science 2024-01-09 Hitesh Sagtani , Olivier Jeunen , Aleksei Ustimenko

The task of expert finding has been getting increasing attention in information retrieval literature. However, the current state-of-the-art is still lacking in principled approaches for combining different sources of evidence in an optimal…

Information Retrieval · Computer Science 2013-02-05 Catarina Moreira , Pável Calado , Bruno Martins