English
Related papers

Related papers: LLM-based Relevance Assessment for Web-Scale Searc…

200 papers

Evaluating the output of generative large language models (LLMs) is challenging and difficult to scale. Many evaluations of LLMs focus on tasks such as single-choice question-answering or text classification. These tasks are not suitable…

Information Retrieval · Computer Science 2025-01-20 Sebastian Heineking , Jonas Probst , Daniel Steinbach , Martin Potthast , Harrisen Scells

LLMs are increasingly being used to assess the relevance of information objects. This work reports on experiments to study the labelling of short texts (i.e., passages) for relevance, using multiple open-source and proprietary LLMs. While…

Information Retrieval · Computer Science 2025-01-31 Marwah Alaofi , Paul Thomas , Falk Scholer , Mark Sanderson

Query understanding is essential in modern relevance systems, where user queries are often short, ambiguous, and highly context-dependent. Traditional approaches often rely on multiple task-specific Named Entity Recognition models to…

Information Retrieval · Computer Science 2025-09-15 Ping Liu , Jianqiang Shen , Qianqi Shen , Chunnan Yao , Kevin Kao , Dan Xu , Rajat Arora , Baofen Zheng , Caleb Johnson , Liangjie Hong , Jingwei Wu , Wenjing Zhang

Advanced relevance models, such as those that use large language models (LLMs), provide highly accurate relevance estimations. However, their computational costs make them infeasible for processing large document corpora. To address this,…

Information Retrieval · Computer Science 2025-05-08 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

The Cranfield paradigm has served as a foundational approach for developing test collections, with relevance judgments typically conducted by human assessors. However, the emergence of large language models (LLMs) has introduced new…

Information Retrieval · Computer Science 2024-06-12 Gabriel de Jesus , Sérgio Nunes

Existing large language models (LLMs) evaluation methods typically focus on testing the performance on some closed-environment and domain-specific benchmarks with human annotations. In this paper, we explore a novel unsupervised evaluation…

Computation and Language · Computer Science 2025-02-24 Kun-Peng Ning , Shuo Yang , Yu-Yang Liu , Jia-Yu Yao , Zhen-Hui Liu , Yong-Hong Tian , Yibing Song , Li Yuan

The article presents an online relevancy tuning method using explicit user feedback. The author developed and tested a method of words' weights modification based on search result evaluation by user. User decides whether the result is…

Information Retrieval · Computer Science 2007-05-23 Boris Mark Tylevich

The effectiveness of search systems is evaluated using relevance labels that indicate the usefulness of documents for specific queries and users. While obtaining these relevance labels from real users is ideal, scaling such data collection…

Information Retrieval · Computer Science 2025-01-27 Julian A. Schnabel , Johanne R. Trippas , Falk Scholer , Danula Hettiachchi

Large language models (LLMs) obtain state of the art zero shot relevance ranking performance on a variety of information retrieval tasks. The two most common prompts to elicit LLM relevance judgments are pointwise scoring (a.k.a. relevance…

Machine Learning · Computer Science 2025-05-27 Charles Godfrey , Ping Nie , Natalia Ostapuk , David Ken , Shang Gao , Souheil Inati

As Large Language Model (LLM) capabilities advance, the demand for high-quality annotation of exponentially increasing text corpora has outpaced human capacity, leading to the widespread adoption of LLMs in automatic evaluation and…

Computation and Language · Computer Science 2026-04-02 Jiayu Wang , Junyoung Lee

[Context and Motivation] Online user feedback provides valuable information to support requirements engineering (RE). However, analyzing online user feedback is challenging due to its large volume and noise. Large language models (LLMs)…

Software Engineering · Computer Science 2025-10-28 Manjeshwar Aniruddh Mallya , Alessio Ferrari , Mohammad Amin Zadenoori , Jacek Dąbrowski

Large Language Models (LLMs) have been used as relevance assessors for Information Retrieval (IR) evaluation collection creation due to reduced cost and increased scalability as compared to human assessors. While previous research has…

Information Retrieval · Computer Science 2026-01-06 Samaneh Mohtadi , Gianluca Demartini

In NLP, fine-tuning LLMs is effective for various applications but requires high-quality annotated data. However, manual annotation of data is labor-intensive, time-consuming, and costly. Therefore, LLMs are increasingly used to automate…

Computation and Language · Computer Science 2025-04-22 Muhammad Uzair Ul Haq , Davide Rigoni , Alessandro Sperduti

Current IR evaluation is based on relevance judgments, created either manually or automatically, with decisions outsourced to Large Language Models (LLMs). We offer an alternative paradigm, that never relies on relevance judgments in any…

Information Retrieval · Computer Science 2024-02-02 Naghmeh Farzi , Laura Dietz

Annotating large datasets can be challenging. However, crowd-sourcing is often expensive and can lack quality, especially for non-trivial tasks. We propose a method of using LLMs as few-shot learners for annotating data in a complex natural…

Personalizing the outputs of large language models (LLMs) to align with individual user preferences is an active research area. However, previous studies have mainly focused on classification or ranking tasks and have not considered…

Computation and Language · Computer Science 2025-10-02 Koki Ryu , Hitomi Yanaka

The effective training and evaluation of retrieval systems require a substantial amount of relevance judgments, which are traditionally collected from human assessors -- a process that is both costly and time-consuming. Large Language…

Information Retrieval · Computer Science 2024-12-19 Hossein A. Rahmani , Emine Yilmaz , Nick Craswell , Bhaskar Mitra

NLP benchmarks rely on standardized datasets for training and evaluating models and are crucial for advancing the field. Traditionally, expert annotations ensure high-quality labels; however, the cost of expert annotation does not scale…

Computation and Language · Computer Science 2025-09-15 Omer Nahum , Nitay Calderon , Orgad Keller , Idan Szpektor , Roi Reichart

Unjudged documents or holes in information retrieval benchmarks are considered non-relevant in evaluation, yielding no gains in measuring effectiveness. However, these missing judgments may inadvertently introduce biases into the evaluation…

Information Retrieval · Computer Science 2024-05-09 Shivani Upadhyay , Ehsan Kamalloo , Jimmy Lin

Relevance modeling between queries and items stands as a pivotal component in commercial search engines, directly affecting the user experience. Given the remarkable achievements of large language models (LLMs) in various natural language…

Artificial Intelligence · Computer Science 2025-02-19 Kaixin Wu , Yixin Ji , Zeyuan Chen , Qiang Wang , Cunxiang Wang , Hong Liu , Baijun Ji , Jia Xu , Zhongyi Liu , Jinjie Gu , Yuan Zhou , Linjian Mo