English
Related papers

Related papers: Zero-Shot Dense Retrieval with Embeddings from Rel…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, their ability to generate human-like text has raised concerns about potential misuse. This underscores the need for reliable and effective…

Computation and Language · Computer Science 2026-04-24 Runheng Liu , Heyan Huang , Xingchen Xiao , Zhijing Wu

Recent advancements in Large Language Models (LLMs) have significantly improved their performance across various Natural Language Processing (NLP) tasks. However, LLMs still struggle with generating non-factual responses due to limitations…

Computation and Language · Computer Science 2024-09-10 Taeho Hwang , Soyeong Jeong , Sukmin Cho , SeungYoon Han , Jong C. Park

The application of large language models to provide relevance assessments presents exciting opportunities to advance information retrieval, natural language processing, and beyond, but to date many unknowns remain. This paper reports on the…

Information Retrieval · Computer Science 2024-11-14 Shivani Upadhyay , Ronak Pradeep , Nandan Thakur , Daniel Campos , Nick Craswell , Ian Soboroff , Hoa Trang Dang , Jimmy Lin

A fundamental goal of search engines is to identify, given a query, documents that have relevant text. This is intrinsically difficult because the query and the document may use different vocabulary, or the document may contain query words…

Information Retrieval · Computer Science 2016-02-04 Bhaskar Mitra , Eric Nalisnick , Nick Craswell , Rich Caruana

This paper introduces a simple yet effective query expansion approach, denoted as query2doc, to improve both sparse and dense retrieval systems. The proposed method first generates pseudo-documents by few-shot prompting large language…

Information Retrieval · Computer Science 2023-10-12 Liang Wang , Nan Yang , Furu Wei

Aligning large language models (LLMs) to human preferences is a crucial step in building helpful and safe AI tools, which usually involve training on supervised datasets. Popular algorithms such as Direct Preference Optimization (DPO) rely…

Computation and Language · Computer Science 2025-06-05 Honggen Zhang , Xufeng Zhao , Igor Molybog , June Zhang

Document-Level Zero-Shot Relation Extraction (DocZSRE) aims to predict unseen relation labels in text documents without prior training on specific relations. Existing approaches rely on Large Language Models (LLMs) to generate synthetic…

Computation and Language · Computer Science 2026-01-13 Mohan Raj Chanthran , Soon Lay Ki , Ong Huey Fang , Bhawani Selvaretnam

Retrieval-augmented language models (RALMs) hold promise to produce language understanding systems that are are factual, efficient, and up-to-date. An important desideratum of RALMs, is that retrieved information helps model performance…

Computation and Language · Computer Science 2024-05-07 Ori Yoran , Tomer Wolfson , Ori Ram , Jonathan Berant

Reverse Dictionary (RD) is the task of obtaining the most relevant word or set of words given a textual description or dictionary definition. Effective RD methods have applications in accessibility, translation or writing support systems.…

Computation and Language · Computer Science 2024-12-10 Fatemah Almeman , Luis Espinosa-Anke

Large Language Models (LLMs)-based text retrieval retrieves documents relevant to search queries based on vector similarities. Documents are pre-encoded offline, while queries arrive in real-time, necessitating an efficient online query…

Information Retrieval · Computer Science 2026-02-02 Guangyuan Ma , Yongliang Ma , Xuanrui Gou , Zhenpeng Su , Ming Zhou , Songlin Hu

When asked, large language models (LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in evaluations of retrieval systems. In this perspectives paper,…

Augmenting Large Language Models (LLMs) with retrieved external knowledge has proven effective for improving the factual accuracy of generated responses. Despite their success, retrieval-augmented LLMs still face the distractibility issue,…

Computation and Language · Computer Science 2025-02-18 Zexuan Qiu , Zijing Ou , Bin Wu , Jingjing Li , Aiwei Liu , Irwin King

Latent semantic representations of words or paragraphs, namely the embeddings, have been widely applied to information retrieval (IR). One of the common approaches of utilizing embeddings for IR is to estimate the document-to-query (D2Q)…

Information Retrieval · Computer Science 2017-08-11 Chenhao Yang , Ben He , Yanhua Ran

Large language models (LLMs) have demonstrated impressive performance on several tasks and are increasingly deployed in real-world applications. However, especially in high-stakes settings, it becomes vital to know when the output of an LLM…

Computation and Language · Computer Science 2025-06-23 Yu-Neng Chuang , Prathusha Kameswara Sarma , Parikshit Gopalan , John Boccio , Sara Bolouki , Xia Hu , Helen Zhou

Recommender systems utilizing explicit feedback have witnessed significant advancements and widespread applications over the past years. However, generating recommendations in few-shot scenarios remains a persistent challenge. Recently,…

Information Retrieval · Computer Science 2023-12-22 Zhoumeng Wang

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

This paper considers Pseudo-Relevance Feedback (PRF) methods for dense retrievers in a resource constrained environment such as that of cheap cloud instances or embedded systems (e.g., smartphones and smartwatches), where memory and CPU are…

Information Retrieval · Computer Science 2024-12-09 Hang Li , Chuting Yu , Ahmed Mourad , Bevan Koopman , Guido Zuccon

Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de facto method. In this work, we show that retrieval can be…

Computation and Language · Computer Science 2020-10-02 Vladimir Karpukhin , Barlas Oğuz , Sewon Min , Patrick Lewis , Ledell Wu , Sergey Edunov , Danqi Chen , Wen-tau Yih

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

Information Retrieval · Computer Science 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin