English
Related papers

Related papers: PyTerrier-GenRank: The PyTerrier Plugin for Rerank…

200 papers

Large Language Models (LLMs) have significantly enhanced Information Retrieval (IR) across various modules, such as reranking. Despite impressive performance, current zero-shot relevance ranking with LLMs heavily relies on human prompt…

Artificial Intelligence · Computer Science 2025-05-21 Can Jin , Hongwu Peng , Shiyu Zhao , Zhenting Wang , Wujiang Xu , Ligong Han , Jiahui Zhao , Kai Zhong , Sanguthevar Rajasekaran , Dimitris N. Metaxas

Alongside the rapid development of Large Language Models (LLMs), there has been a notable increase in efforts to integrate LLM techniques in information retrieval (IR) and search engines (SE). Recently, an additional post-ranking stage is…

Information Retrieval · Computer Science 2024-11-05 Yang Yan , Yihao Wang , Chi Zhang , Wenyuan Hou , Kang Pan , Xingkai Ren , Zelun Wu , Zhixin Zhai , Enyun Yu , Wenwu Ou , Yang Song

Training Large Language Models (LLMs) with Reinforcement Learning from AI Feedback (RLAIF) aligns model outputs more closely with human preferences. This involves an evaluator model ranking multiple candidate responses to user prompts.…

Computation and Language · Computer Science 2024-06-04 Peter Devine

Many information retrieval tasks require large labeled datasets for fine-tuning. However, such datasets are often unavailable, and their utility for real-world applications can diminish quickly due to domain shifts. To address this…

Multi-stage information retrieval (IR) has become a widely-adopted paradigm in search. While Large Language Models (LLMs) have been extensively evaluated as second-stage reranking models for monolingual IR, a systematic large-scale…

Computation and Language · Computer Science 2025-09-19 Longfei Zuo , Pingjun Hong , Oliver Kraus , Barbara Plank , Robert Litschko

Pre-trained deep language models~(LM) have advanced the state-of-the-art of text retrieval. Rerankers fine-tuned from deep LM estimates candidate relevance based on rich contextualized matching signals. Meanwhile, deep LMs can also be…

Information Retrieval · Computer Science 2021-01-22 Luyu Gao , Zhuyun Dai , Jamie Callan

Large language models (LLMs), with advanced linguistic capabilities, have been employed in reranking tasks through a sequence-to-sequence approach. In this paradigm, multiple passages are reranked in a listwise manner and a textual reranked…

Information Retrieval · Computer Science 2024-11-08 Ruiyang Ren , Yuhao Wang , Kun Zhou , Wayne Xin Zhao , Wenjie Wang , Jing Liu , Ji-Rong Wen , Tat-Seng Chua

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Recent advancements in Large Language Models (LLMs) have shown significant potential in enhancing recommender systems. However, addressing the cold-start recommendation problem, where users lack historical data, remains a considerable…

Information Retrieval · Computer Science 2025-04-29 Hai-Dang Kieu , Minh Duc Nguyen , Thanh-Son Nguyen , Dung D. Le

In this paper, we introduce Rank-R1, a novel LLM-based reranker that performs reasoning over both the user query and candidate documents before performing the ranking task. Existing document reranking methods based on large language models…

Information Retrieval · Computer Science 2025-03-11 Shengyao Zhuang , Xueguang Ma , Bevan Koopman , Jimmy Lin , Guido Zuccon

Effective document reranking is essential for improving search relevance across diverse applications. While Large Language Models (LLMs) excel at reranking due to their deep semantic understanding and reasoning, their high computational…

Computation and Language · Computer Science 2025-10-03 Dimitar Peshevski , Kiril Blazhevski , Martin Popovski , Gjorgji Madjarov

Classification tasks in NLP are typically addressed by selecting a pre-trained language model (PLM) from a model hub, and fine-tuning it for the task at hand. However, given the very large number of PLMs that are currently available, a…

Computation and Language · Computer Science 2024-09-11 Lukas Garbas , Max Ploner , Alan Akbik

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

Information Retrieval · Computer Science 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song

Large Language Model (LLM) based listwise ranking has shown superior performance in many passage ranking tasks. With the development of Large Reasoning Models (LRMs), many studies have demonstrated that step-by-step reasoning during…

Information Retrieval · Computer Science 2026-04-23 Wenhan Liu , Xinyu Ma , Weiwei Sun , Yutao Zhu , Yuchen Li , Dawei Yin , Zhicheng Dou

Large Language Models (LLMs) often struggle with hallucinations and outdated information. To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge. However, existing IR techniques contain…

Computation and Language · Computer Science 2024-11-26 Danupat Khamnuansin , Tawunrat Chalothorn , Ekapol Chuangsuwanich

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

Listwise rerankers based on large language models (LLM) are the zero-shot state-of-the-art. However, current works in this direction all depend on the GPT models, making it a single point of failure in scientific reproducibility. Moreover,…

Computation and Language · Computer Science 2023-12-06 Xinyu Zhang , Sebastian Hofstätter , Patrick Lewis , Raphael Tang , Jimmy Lin

Social media platforms utilize Machine Learning (ML) and Artificial Intelligence (AI) powered recommendation algorithms to maximize user engagement, which can result in inadvertent exposure to harmful content. Current moderation efforts,…

Computation and Language · Computer Science 2025-05-30 Rajvardhan Oak , Muhammad Haroon , Claire Jo , Magdalena Wojcieszak , Anshuman Chhabra

Large language models (LLMs) typically utilize the top-k contexts from a retriever in retrieval-augmented generation (RAG). In this work, we propose a novel instruction fine-tuning framework RankRAG, which instruction-tunes a single LLM for…

Computation and Language · Computer Science 2024-07-03 Yue Yu , Wei Ping , Zihan Liu , Boxin Wang , Jiaxuan You , Chao Zhang , Mohammad Shoeybi , Bryan Catanzaro