English
Related papers

Related papers: Correcting for Selection Bias in Learning-to-rank …

200 papers

For industrial learning-to-rank (LTR) systems, it is common that the output of a ranking model is modified, either as a results of post-processing logic that enforces business requirements, or as a result of unforeseen design flaws or bugs…

Information Retrieval · Computer Science 2023-11-06 Matej Jakimov , Alexander Buchholz , Yannik Stein , Thorsten Joachims

Recent studies have demonstrated that large language models (LLMs) exhibit significant biases in evaluation tasks, particularly in preferentially rating and favoring self-generated content. However, the extent to which this bias manifests…

Computation and Language · Computer Science 2025-12-09 Yen-Shan Chen , Jing Jin , Peng-Ting Kuo , Chao-Wei Huang , Yun-Nung Chen

As conventional answer selection (AS) methods generally match the question with each candidate answer independently, they suffer from the lack of matching information between the question and the candidate. To address this problem, we…

Computation and Language · Computer Science 2020-10-13 Yingxue Zhang , Fandong Meng , Peng Li , Ping Jian , Jie Zhou

While recent years have witnessed a rapid growth of research papers on recommender system (RS), most of the papers focus on inventing machine learning models to better fit user behavior data. However, user behavior data is observational…

Information Retrieval · Computer Science 2021-12-30 Jiawei Chen , Hande Dong , Xiang Wang , Fuli Feng , Meng Wang , Xiangnan He

Recommender systems (RSs) are software tools and algorithms developed to alleviate the problem of information overload, which makes it difficult for a user to make right decisions. Two main paradigms toward the recommendation problem are…

Information Retrieval · Computer Science 2021-05-24 Mehdi Afsar , Trafford Crump , Behrouz Far

Recommendation systems often suffer from data sparsity caused by limited user-item interactions, which degrade their performance and amplify popularity bias in real-world scenarios. This paper proposes a novel data augmentation framework…

Information Retrieval · Computer Science 2026-04-22 Minh-Anh Nguyen , Bao Nguyen , Ha Lan N. T. , Tuan Anh Hoang , Duc-Trong Le , Dung D. Le

Recommender systems for software engineering (RSSE) play a crucial role in automating development tasks by providing relevant suggestions according to the developer's context. However, they suffer from the so-called popularity bias, i.e.,…

Software Engineering · Computer Science 2025-01-20 Claudio Di Sipio , Juri Di Rocco , Davide Di Ruscio , Vladyslav Bulhakov

Talent search is a cornerstone of modern recruitment systems, yet existing approaches often struggle to capture nuanced job-specific preferences, model recruiter behavior at a fine-grained level, and mitigate noise from subjective human…

Information Retrieval · Computer Science 2025-12-02 Jihang Li , Bing Xu , Zulong Chen , Chuanfei Xu , Minping Chen , Suyu Liu , Ying Zhou , Zeyi Wen

Listwise learning-to-rank methods form a powerful class of ranking algorithms that are widely adopted in applications such as information retrieval. These algorithms learn to rank a set of items by optimizing a loss that is a function of…

Machine Learning · Computer Science 2021-02-08 Sebastian Bruch

Conventional methods for query autocompletion aim to predict which completed query a user will select from a list. A shortcoming of this approach is that users often do not know which query will provide the best retrieval performance on the…

Information Retrieval · Computer Science 2022-04-26 Adam Block , Rahul Kidambi , Daniel N. Hill , Thorsten Joachims , Inderjit S. Dhillon

Click-through rate (CTR) prediction becomes indispensable in ubiquitous web recommendation applications. Nevertheless, the current methods are struggling under the cold-start scenarios where the user interactions are extremely sparse. We…

Information Retrieval · Computer Science 2021-09-30 Yujie Pan , Jiangchao Yao , Bo Han , Kunyang Jia , Ya Zhang , Hongxia Yang

This paper addresses the critical issue of sample selection bias in cross-country comparisons based on international assessments such as the Programme for International Student Assessment (PISA). Although PISA is widely used to benchmark…

Econometrics · Economics 2025-10-08 Onil Boussim

This paper proposes a new approach to training recommender systems called deviation-based learning. The recommender and rational users have different knowledge. The recommender learns user knowledge by observing what action users take upon…

Theoretical Economics · Economics 2022-08-22 Junpei Komiyama , Shunya Noda

Learning to Rank (LTR) methods generally assume that each document in a top-K ranking is presented in an equal format. However, previous work has shown that users' perceptions of relevance can be changed by varying presentations, i.e.,…

Information Retrieval · Computer Science 2025-07-01 Norman Knyazev , Harrie Oosterhuis

Neural ranking models have become increasingly popular for real-world search and recommendation systems in recent years. Unlike their tree-based counterparts, neural models are much less interpretable. That is, it is very difficult to…

Information Retrieval · Computer Science 2024-05-14 Lijun Lyu , Nirmal Roy , Harrie Oosterhuis , Avishek Anand

Recommender systems operate in closed feedback loops, where user interactions reinforce popularity bias, leading to over-recommendation of already popular items while under-exposing niche or novel content. Existing bias mitigation methods,…

Information Retrieval · Computer Science 2025-06-10 Rahul Agarwal , Amit Jaspal , Saurabh Gupta , Omkar Vichare

Across a variety of ranking tasks, researchers use reciprocal rank to measure the effectiveness for users interested in exactly one relevant item. Despite its widespread use, evidence suggests that reciprocal rank is brittle when…

Information Retrieval · Computer Science 2023-06-14 Fernando Diaz

Text-guided image retrieval is to incorporate conditional text to better capture users' intent. Traditionally, the existing methods focus on minimizing the embedding distances between the source inputs and the targeted image, using the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Junyang Chen , Hanjiang Lai

Learning-to-rank techniques have proven to be extremely useful for prioritization problems, where we rank items in order of their estimated probabilities, and dedicate our limited resources to the top-ranked items. This work exposes a…

Machine Learning · Statistics 2018-02-22 Cynthia Rudin , Yining Wang

What we discover and see online, and consequently our opinions and decisions, are becoming increasingly affected by automated machine learned predictions. Similarly, the predictive accuracy of learning machines heavily depends on the…

Information Retrieval · Computer Science 2020-01-15 Sami Khenissi , Olfa Nasraoui