English
Related papers

Related papers: Data-Driven Relevance Judgments for Ranking Evalua…

200 papers

Human relevance assessment is time-consuming and cognitively intensive, limiting the scalability of Information Retrieval evaluation. This has led to growing interest in using large language models (LLMs) as proxies for human judges.…

Information Retrieval · Computer Science 2026-04-28 Chuting Yu , Hang Li , Guido Zuccon , Joel Mackenzie , Teerapong Leelanupab

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding generation in external knowledge, yielding relevance responses that are aligned with factual evidence and evolving corpora. Standard RAG pipelines…

Machine Learning · Computer Science 2026-04-07 Xun Sun , Baiheng Xie , Li Huang , Qiang Gao

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal

Cone distribution functions from statistics are turned into Multi-Criteria Decision Making tools. It is demonstrated that this procedure can be considered as an upgrade of the weighted sum scalarization insofar as it absorbs a whole…

Artificial Intelligence · Computer Science 2024-01-17 Andreas H Hamel , Daniel Kostner

Rank aggregation systems collect ordinal preferences from individuals to produce a global ranking that represents the social preference. Rank-breaking is a common practice to reduce the computational complexity of learning the global…

Machine Learning · Computer Science 2016-10-10 Ashish Khetan , Sewoong Oh

Collaborative Filtering (CF) is a core component of popular web-based services such as Amazon, YouTube, Netflix, and Twitter. Most applications use CF to recommend a small set of items to the user. For instance, YouTube presents to a user a…

Ranking relevance is a fundamental task in search engines, aiming to identify the items most relevant to a given user query. Traditional relevance models typically produce scalar scores or directly predict relevance labels, limiting both…

Information Retrieval · Computer Science 2025-12-30 Ziyang Zeng , Heming Jing , Jindong Chen , Xiangli Li , Hongyu Liu , Yixuan He , Zhengyu Li , Yige Sun , Zheyong Xie , Yuqing Yang , Shaosheng Cao , Jun Fan , Yi Wu , Yao Hu

Learning to rank is a key component of many e-commerce search engines. In learning to rank, one is interested in optimising the global ordering of a list of items according to their utility for users.Popular approaches learn a scoring…

Information Retrieval · Computer Science 2021-05-25 Przemysław Pobrotyn , Tomasz Bartczak , Mikołaj Synowiec , Radosław Białobrzeski , Jarosław Bojar

Efficient search is a critical component for an e-commerce platform with an innumerable number of products. Every day millions of users search for products pertaining to their needs. Thus, showing the relevant products on the top will…

Information Retrieval · Computer Science 2022-07-01 Lakshya Kumar , Sagnik Sarkar

Ranking, recommendation, and retrieval systems are widely used in online platforms and other societal systems, including e-commerce, media-streaming, admissions, gig platforms, and hiring. In the recent past, a large "fair ranking" research…

Information Retrieval · Computer Science 2022-02-01 Gourab K Patro , Lorenzo Porcaro , Laura Mitchell , Qiuyue Zhang , Meike Zehlike , Nikhil Garg

The harmful impacts of algorithmic decision systems have recently come into focus, with many examples of systems such as machine learning (ML) models amplifying existing societal biases. Most metrics attempting to quantify disparities…

Computers and Society · Computer Science 2022-08-15 Tomo Lazovich , Luca Belli , Aaron Gonzales , Amanda Bower , Uthaipon Tantipongpipat , Kristian Lum , Ferenc Huszar , Rumman Chowdhury

The application of large language models (LLMs) in recommendation systems has recently gained traction. Traditional recommendation systems often lack explainability and suffer from issues such as popularity bias. Previous research has also…

Information Retrieval · Computer Science 2025-12-04 Yaqi Wang , Haojia Sun , Shuting Zhang

Traditional machine-learned ranking systems for web search are often trained to capture stationary relevance of documents to queries, which has limited ability to track non-stationary user intention in a timely manner. In recency search,…

Information Retrieval · Computer Science 2011-03-22 Taesup Moon , Wei Chu , Lihong Li , Zhaohui Zheng , Yi Chang

Recent advances in large language models have enabled the development of viable generative retrieval systems. Instead of a traditional document ranking, generative retrieval systems often directly return a grounded generated text as a…

The search engine plays a fundamental role in online e-commerce systems, to help users find the products they want from the massive product collections. Relevance is an essential requirement for e-commerce search, since showing products…

Information Retrieval · Computer Science 2021-02-16 Shaowei Yao , Jiwei Tan , Xi Chen , Keping Yang , Rong Xiao , Hongbo Deng , Xiaojun Wan

Retrieval models are often evaluated on partially-annotated datasets. Each query is mapped to a few relevant texts and the remaining corpus is assumed to be irrelevant. As a result, models that successfully retrieve false negatives are…

Information Retrieval · Computer Science 2024-10-15 Royi Rassin , Yaron Fairstein , Oren Kalinsky , Guy Kushilevitz , Nachshon Cohen , Alexander Libov , Yoav Goldberg

Product search is one of the most popular methods for customers to discover products online. Most existing studies on product search focus on developing effective retrieval models that rank items by their likelihood to be purchased. They,…

Information Retrieval · Computer Science 2019-09-17 Qingyao Ai , Yongfeng Zhang , Keping Bi , W. Bruce Croft

In an online social network, link recommendations are a way for users to discover relevant links to people they may know, thereby potentially increasing their engagement on the platform. However, the addition of links to a social network…

Social and Information Networks · Computer Science 2024-01-18 Yanbang Wang , Jon Kleinberg

The trade-off between relevance and fairness in personalized recommendations has been explored in recent works, with the goal of minimizing learned discrimination towards certain demographics while still producing relevant results. We…

Information Retrieval · Computer Science 2018-09-12 Chen Karako , Putra Manggala

The problem of relevance ranking consists of sorting a set of objects with respect to a given criterion. Since users may prefer different relevance criteria, the ranking algorithms should be adaptable to the user needs. Two main approaches…

Machine Learning · Computer Science 2023-11-06 Leonardo Rigutini , Tiziano Papini , Marco Maggini , Franco Scarselli