English
Related papers

Related papers: Ranker-agnostic Contextual Position Bias Estimatio…

200 papers

Learning to rank has been intensively studied and widely applied in information retrieval. Typically, a global ranking function is learned from a set of labeled data, which can achieve good performance on average but may be suboptimal for…

Information Retrieval · Computer Science 2018-04-25 Qingyao Ai , Keping Bi , Jiafeng Guo , W. Bruce Croft

Reinforcement learning from human feedback (RLHF) has become a cornerstone for aligning large language models with human preferences. However, the heterogeneity of human feedback, driven by diverse individual contexts and preferences, poses…

Machine Learning · Statistics 2026-03-05 Seong Jin Lee , Will Wei Sun , Yufeng Liu

We consider an online learning to rank setting in which, at each round, an oblivious adversary generates a list of $m$ documents, pertaining to a query, and the learner produces scores to rank the documents. The adversary then generates a…

Machine Learning · Computer Science 2016-08-24 Sougata Chaudhuri , Ambuj Tewari

Probabilistic learning to rank (LTR) has been the dominating approach for optimizing the ranking metric, but cannot maximize long-term rewards. Reinforcement learning models have been proposed to maximize user long-term rewards by…

Machine Learning · Computer Science 2024-01-18 Teng Xiao , Suhang Wang

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

In today's technology environment, information is abundant, dynamic, and heterogeneous in nature. Automated filtering and prioritization of information is based on the distinction between whether the information adds substantial value…

Machine Learning · Computer Science 2022-02-01 Jade Freeman , Michael Rawson

As Learning-to-Rank (LTR) approaches primarily seek to improve ranking quality, their output scores are not scale-calibrated by design. This fundamentally limits LTR usage in score-sensitive applications. Though a simple multi-objective…

Information Retrieval · Computer Science 2023-08-23 Aijun Bai , Rolf Jagerman , Zhen Qin , Le Yan , Pratyush Kar , Bing-Rong Lin , Xuanhui Wang , Michael Bendersky , Marc Najork

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

We introduce a novel latent vector space model that jointly learns the latent representations of words, e-commerce products and a mapping between the two without the need for explicit annotations. The power of the model lies in its ability…

Information Retrieval · Computer Science 2016-08-26 Christophe Van Gysel , Maarten de Rijke , Evangelos Kanoulas

Position bias, i.e., users' preference of an item is affected by its placing position, is well studied in the recommender system literature. However, most existing methods ignore the widely coupled ranking bias, which is also related to the…

Information Retrieval · Computer Science 2024-05-30 Yao Zhao , Zhining Liu , Tianchi Cai , Haipeng Zhang , Chenyi Zhuang , Jinjie Gu

Context, as referred to situational factors related to the object of interest, can help infer the object's states or properties in visual recognition. As such contextual features are too diverse (across instances) to be annotated, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Mingzhou Liu , Xinwei Sun , Fandong Zhang , Yizhou Yu , Yizhou Wang

Implicit sentiment analysis is challenging because sentiment toward an aspect is often inferred from events rather than expressed through explicit opinion words. Existing models typically learn from the final polarity label, which provides…

Computation and Language · Computer Science 2026-05-21 Yaping Chai , Haoran Xie , Joe S. Qin

Ranking is at the core of many artificial intelligence (AI) applications, including search engines, recommender systems, etc. Modern ranking systems are often constructed with learning-to-rank (LTR) models built from user behavior signals.…

Information Retrieval · Computer Science 2023-05-29 Tao Yang , Cuize Han , Chen Luo , Parth Gupta , Jeff M. Phillips , Qingyao Ai

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal

Recommendation is the task of improving customer experience through personalized recommendation based on users' past feedback. In this paper, we investigate the most common scenario: the user-item (U-I) matrix of implicit feedback. Even…

Machine Learning · Computer Science 2017-07-21 Peng Yang , Peilin Zhao , Xin Gao , Yong Liu

According to the Probability Ranking Principle (PRP), ranking documents in decreasing order of their probability of relevance leads to an optimal document ranking for ad-hoc retrieval. The PRP holds when two conditions are met: [C1] the…

Information Retrieval · Computer Science 2021-01-13 Gustavo Penha , Claudia Hauff

Understanding user preference is essential to the optimization of recommender systems. As a feedback of user's taste, rating scores can directly reflect the preference of a given user to a given product. Uncovering the latent components of…

Information Retrieval · Computer Science 2017-10-20 Junhua Chen , Wei Zeng , Junming Shao , Ge Fan

Good quality explanations strengthen the understanding of language models and data. Feature attribution methods, such as Integrated Gradient, are a type of post-hoc explainer that can provide token-level insights. However, explanations on…

Computation and Language · Computer Science 2026-04-21 Jonathan Kamp , Roos Bakker , Dominique Blok

Personalizing the outputs of large language models (LLMs) to align with individual user preferences is an active research area. However, previous studies have mainly focused on classification or ranking tasks and have not considered…

Computation and Language · Computer Science 2025-10-02 Koki Ryu , Hitomi Yanaka

Societal biases that are contained in retrieved documents have received increased interest. Such biases, which are often prevalent in the training data and learned by the model, can cause societal harms, by misrepresenting certain groups,…

Information Retrieval · Computer Science 2023-09-19 Maria Heuss , Daniel Cohen , Masoud Mansoury , Maarten de Rijke , Carsten Eickhoff