English
Related papers

Related papers: Online Learning to Rank with Top-k Feedback

200 papers

Counterfactual Learning to Rank (LTR) methods optimize ranking systems using logged user interactions that contain interaction biases. Existing methods are only unbiased if users are presented with all relevant items in every ranking. There…

Information Retrieval · Computer Science 2021-04-12 Harrie Oosterhuis , Maarten de Rijke

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

Machine Learning · Statistics 2024-05-20 Lexing Ying

Given an input query, a recommendation model is trained using user feedback data (e.g., click data) to output a ranked list of items. In real-world systems, besides accuracy, an important consideration for a new model is novelty of its…

Information Retrieval · Computer Science 2024-06-21 Amit Sharma , Hua Li , Xue Li , Jian Jiao

Traditional approaches to ranking in web search follow the paradigm of rank-by-score: a learned function gives each query-URL combination an absolute score and URLs are ranked according to this score. This paradigm ensures that if the score…

Machine Learning · Computer Science 2012-07-03 Or Sheffet , Nina Mishra , Samuel Ieong

Object ranking or "learning to rank" is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2017-12-05 Mohsen Ahmadi Fahandar , Eyke Hüllermeier

Rankings are ubiquitous in the online world today. As we have transitioned from finding books in libraries to ranking products, jobs, job applicants, opinions and potential romantic partners, there is a substantial precedent that ranking…

Information Retrieval · Computer Science 2018-10-18 Ashudeep Singh , Thorsten Joachims

The problem of relevance ranking consists of sorting a set of objects with respect to a given criterion. Since users may prefer different relevance criteria, the ranking algorithms should be adaptable to the user needs. Two main approaches…

Machine Learning · Computer Science 2023-11-06 Leonardo Rigutini , Tiziano Papini , Marco Maggini , Franco Scarselli

This paper considers a variant of the classical online learning problem with expert predictions. Our model's differences and challenges are due to lacking any direct feedback on the loss each expert incurs at each time step $t$. We propose…

Machine Learning · Computer Science 2020-01-07 Yang Liu , David P. Helmbold

For many internet businesses, presenting a given list of items in an order that maximizes a certain metric of interest (e.g., click-through-rate, average engagement time etc.) is crucial. We approach the aforementioned task from a…

Machine Learning · Statistics 2017-02-28 Swayambhoo Jain , Akshay Soni , Nikolay Laptev , Yashar Mehdad

Motivated by applications to resource-limited and safety-critical domains, we study selective classification in the online learning model, wherein a predictor may abstain from classifying an instance. For example, this may model an adaptive…

Machine Learning · Computer Science 2021-10-28 Aditya Gangrade , Anil Kag , Ashok Cutkosky , Venkatesh Saligrama

Business success in e-commerce depends on customer perceived value. A customer with high perceived value buys, returns, and recommends items. The perceived value is at risk whenever the information load harms users' shopping experience. In…

Information Retrieval · Computer Science 2021-06-01 Franziska Scherpinski , Stefan Lessmann

Many latent (factorized) models have been proposed for recommendation tasks like collaborative filtering and for ranking tasks like document or image retrieval and annotation. Common to all those methods is that during inference the items…

Machine Learning · Computer Science 2012-10-19 Jason Weston , John Blitzer

We consider the problem of stochastic $K$-armed dueling bandit in the contextual setting, where at each round the learner is presented with a context set of $K$ items, each represented by a $d$-dimensional feature vector, and the goal of…

Machine Learning · Computer Science 2021-05-11 Aadirupa Saha , Aditya Gopalan

Ranking problems, also known as preference learning problems, define a widely spread class of statistical learning problems with many applications, including fraud detection, document ranking, medicine, credit risk screening, image ranking…

Machine Learning · Computer Science 2020-12-17 Tino Werner

Implicit feedback data, such as user clicks, is commonly used in learning-to-rank (LTR) systems because it is easy to collect and it often reflects user preferences. However, this data is prone to various biases, and training an LTR…

Information Retrieval · Computer Science 2026-01-30 Md Aminul Islam , Kathryn Vasilaky , Elena Zheleva

The task of learning to rank has been widely studied by the machine learning community, mainly due to its use and great importance in information retrieval, data mining, and natural language processing. Therefore, ranking accurately and…

Artificial Intelligence · Computer Science 2021-02-17 Nathalia Q. Ascenção , Luis C. S. Afonso , Danilo Colombo , Luciano Oliveira , João P. Papa

Online Learning to Rank (OL2R) eliminates the need of explicit relevance annotation by directly optimizing the rankers from their interactions with users. However, the required exploration drives it away from successful practices in offline…

Machine Learning · Computer Science 2021-06-03 Yiling Jia , Huazheng Wang , Stephen Guo , Hongning Wang

We study a stochastic budget-allocation problem over $K$ tasks. At each round $t$, the learner chooses an allocation $X_t \in \Delta_K$. Task $k$ succeeds with probability $F_k(X_{t,k})$, where $F_1,\dots,F_K$ are nondecreasing…

Computer Science and Game Theory · Computer Science 2026-02-05 François Bachoc , Nicolò Cesa-Bianchi , Tommaso Cesari , Roberto Colomboni

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou