中文
相关论文

相关论文: Scaling Down, LiTting Up: Efficient Zero-Shot List…

200 篇论文

Listwise reranking utilizing Large Language Models (LLMs) has achieved state-of-the-art retrieval effectiveness. Recently, reasoning-enhanced models have further pushed these boundaries by employing Chain-of-Thought (CoT) to perform deep…

信息检索 · 计算机科学 2026-05-15 Danyang Liu , Kan Li

We present a comparative study between cross-encoder and LLMs rerankers in the context of re-ranking effective SPLADE retrievers. We conduct a large evaluation on TREC Deep Learning datasets and out-of-domain datasets such as BEIR and…

信息检索 · 计算机科学 2024-03-18 Hervé Déjean , Stéphane Clinchant , Thibault Formal

Large Language Models (LLMs) have demonstrated exceptional performance in the task of text ranking for information retrieval. While Pointwise ranking approaches offer computational efficiency by scoring documents independently, they often…

信息检索 · 计算机科学 2025-12-03 Jieran Li , Xiuyuan Hu , Yang Zhao , Shengyao Zhuang , Hao Zhang

Large language models (LLMs) and high-capacity encoders have advanced zero and few-shot classification, but their inference cost and latency limit practical deployment. We propose training lightweight text classifiers using dynamically…

计算与语言 · 计算机科学 2026-01-26 Gaurav Maheshwari , Kevin El Haddad

Zero-shot text classification (ZSC) offers the promise of eliminating costly task-specific annotation by matching texts directly to human-readable label descriptions. While early approaches have predominantly relied on cross-encoder models…

计算与语言 · 计算机科学 2026-03-13 Ilias Aarab

Listwise reranking is a key yet computationally expensive component in vision-centric retrieval and multimodal retrieval-augmented generation (M-RAG) over long documents. While recent VLM-based rerankers achieve strong accuracy, their…

信息检索 · 计算机科学 2026-05-13 Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh

Recent studies have highlighted the significant potential of Large Language Models (LLMs) as zero-shot relevance rankers. These methods predominantly utilize prompt learning to assess the relevance between queries and documents by…

信息检索 · 计算机科学 2024-11-08 Dezhi Ye , Junwei Hu , Jiabin Fan , Bowen Tian , Jie Liu , Haijin Liang , Jin Ma

Zero-shot document re-ranking with Large Language Models (LLMs) has evolved from Pointwise methods to Listwise and Setwise approaches that optimize computational efficiency. Despite their success, these methods predominantly rely on…

信息检索 · 计算机科学 2026-04-28 Haodong Chen , Shengyao Zhuang , Zheng Yao , Guido Zuccon , Teerapong Leelanupab

Large Language Models (LLMs) have significantly impacted many facets of natural language processing and information retrieval. Unlike previous encoder-based approaches, the enlarged context window of these generative models allows for…

信息检索 · 计算机科学 2024-05-24 Andrew Parry , Sean MacAvaney , Debasis Ganguly

In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs)…

Despite multi-billion parameter neural rankers being common components of state-of-the-art information retrieval pipelines, they are rarely used in production due to the enormous amount of compute required for inference. In this work, we…

信息检索 · 计算机科学 2024-01-17 Thiago Laitz , Konstantinos Papakostas , Roberto Lotufo , Rodrigo Nogueira

Conversational NLU providers often need to scale to thousands of intent-classification models where new customers often face the cold-start problem. Scaling to so many customers puts a constraint on storage space as well. In this paper, we…

计算与语言 · 计算机科学 2023-05-15 Soham Parikh , Quaizar Vohra , Prashil Tumbade , Mitul Tiwari

Re-rankers, which order retrieved documents with respect to the relevance score on the given query, have gained attention for the information retrieval (IR) task. Rather than fine-tuning the pre-trained language model (PLM), the large-scale…

信息检索 · 计算机科学 2023-05-24 Sukmin Cho , Soyeong Jeong , Jeongyeon Seo , Jong C. Park

Transformer-based models like BERT excel at short text classification but struggle with long document classification (LDC) due to input length limitations and computational inefficiencies. In this work, we propose an efficient, zero-shot…

计算与语言 · 计算机科学 2025-08-26 Prathamesh Kokate , Mitali Sarnaik , Manavi Khopade , Mukta Takalikar , Raviraj Joshi

Large Language Models (LLMs) excel at understanding the semantic relationships between queries and documents, even with lengthy and complex long-tail queries. These queries are challenging for feedback-based rankings due to sparse user…

Cross-encoders distilled from large language models (LLMs) are often more effective re-rankers than cross-encoders fine-tuned on manually labeled data. However, distilled models do not match the effectiveness of their teacher LLMs. We…

Recent advancements have successfully harnessed the power of Large Language Models (LLMs) for zero-shot document ranking, exploring a variety of prompting strategies. Comparative approaches like pairwise and listwise achieve high…

信息检索 · 计算机科学 2025-06-13 Kehan Long , Shasha Li , Chen Xu , Jintao Tang , Ting Wang

Listwise rerankers based on large language models (LLM) are the zero-shot state-of-the-art. However, current works in this direction all depend on the GPT models, making it a single point of failure in scientific reproducibility. Moreover,…

计算与语言 · 计算机科学 2023-12-06 Xinyu Zhang , Sebastian Hofstätter , Patrick Lewis , Raphael Tang , Jimmy Lin

Multimodal Video Search by Examples (MVSE) investigates using video clips as the query term for information retrieval, rather than the more traditional text query. This enables far richer search modalities such as images, speaker, content,…

计算与语言 · 计算机科学 2024-09-11 Mengjie Qian , Rao Ma , Adian Liusie , Erfan Loweimi , Kate M. Knill , Mark J. F. Gales

Large Language Models (LLMs) have significantly advanced the field of information retrieval, particularly for reranking. Listwise LLM rerankers have showcased superior performance and generalizability compared to existing supervised…

信息检索 · 计算机科学 2024-06-25 Revanth Gangi Reddy , JaeHyeok Doo , Yifei Xu , Md Arafat Sultan , Deevya Swain , Avirup Sil , Heng Ji