English
Related papers

Related papers: GLEN: Generative Retrieval via Lexical Index Learn…

200 papers

Generative Information Retrieval (GenIR) is a novel paradigm in which a transformer encoder-decoder model predicts document rankings based on a query in an end-to-end fashion. These GenIR models have received significant attention due to…

Information Retrieval · Computer Science 2025-04-09 Anja Reusch , Yonatan Belinkov

Embedding models can generate high-dimensional vectors whose similarity reflects semantic affinities. Thus, accurately and timely retrieving those vectors in a large collection that are similar to a given query has become a critical…

Information Retrieval · Computer Science 2024-10-31 Mariano Tepper , Ishwar Singh Bhati , Cecilia Aguerrebere , Ted Willke

Generative retrieval reformulates retrieval as an autoregressive generation task, where large language models (LLMs) generate target documents directly from a query. As a novel paradigm, the mechanisms that underpin its performance and…

Information Retrieval · Computer Science 2025-06-10 Hongru Cai , Yongqi Li , Ruifeng Yuan , Wenjie Wang , Zhen Zhang , Wenjie Li , Tat-Seng Chua

Generative approaches powered by large language models (LLMs) have demonstrated emergent abilities in tasks that require complex reasoning abilities. Yet the generative nature still makes the generated content suffer from hallucinations,…

Computation and Language · Computer Science 2023-11-07 Zilin Xiao , Ming Gong , Jie Wu , Xingyao Zhang , Linjun Shou , Jian Pei , Daxin Jiang

Generative information retrieval (GenIR) is a promising neural retrieval paradigm that formulates document retrieval as a document identifier (docid) generation task, allowing for end-to-end optimization toward a unified global retrieval…

Information Retrieval · Computer Science 2026-05-26 Kidist Amde Mekonnen , Yubao Tang , Maarten de Rijke

Document retrieval techniques are essential for developing large-scale information systems. The common approach involves using a bi-encoder to compute the semantic similarity between a query and documents. However, the scalar similarity…

Information Retrieval · Computer Science 2025-06-02 Haoyu Liu , Shaohan Huang , Jianfeng Liu , Yuefeng Zhan , Hao Sun , Weiwei Deng , Feng Sun , Furu Wei , Qi Zhang

Recent advances in Generative Adversarial Networks (GANs) have resulted in its widespread applications to multiple domains. A recent model, IRGAN, applies this framework to Information Retrieval (IR) and has gained significant attention…

Machine Learning · Computer Science 2020-10-05 Ameet Deshpande , Mitesh M. Khapra

Retrieval approaches that score documents based on learned dense vectors (i.e., dense retrieval) rather than lexical signals (i.e., conventional retrieval) are increasingly popular. Their ability to identify related documents that do not…

Information Retrieval · Computer Science 2023-08-01 Hrishikesh Kulkarni , Sean MacAvaney , Nazli Goharian , Ophir Frieder

Index structures are a building block of query processing and computer science in general. Since the dawn of computer technology there have been index structures. And since then, a myriad of index structures are being invented and published…

Databases · Computer Science 2021-09-17 Jens Dittrich , Joris Nix , Christian Schön

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Algorithmic Recourse provides recommendations to individuals who are adversely impacted by automated model decisions, on how to alter their profiles to achieve a favorable outcome. Effective recourse methods must balance three conflicting…

Machine Learning · Computer Science 2025-05-13 Prateek Garg , Lokesh Nagalapatti , Sunita Sarawagi

Generative document retrieval, an emerging paradigm in information retrieval, learns to build connections between documents and identifiers within a single model, garnering significant attention. However, there are still two challenges: (1)…

Information Retrieval · Computer Science 2024-05-14 Yong Guan , Dingxiao Liu , Jinchen Ma , Hao Peng , Xiaozhi Wang , Lei Hou , Ru Li

Recently, a novel generative retrieval (GR) paradigm has been proposed, where a single sequence-to-sequence model is learned to directly generate a list of relevant document identifiers (docids) given a query. Existing GR models commonly…

Information Retrieval · Computer Science 2024-03-20 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Xueqi Cheng

Search engines often follow a two-phase paradigm where in the first stage (the retrieval stage) an initial set of documents is retrieved and in the second stage (the re-ranking stage) the documents are re-ranked to obtain the final result…

Information Retrieval · Computer Science 2020-10-06 Saar Kuzi , Mingyang Zhang , Cheng Li , Michael Bendersky , Marc Najork

This paper introduces PAG-a novel optimization and decoding approach that guides autoregressive generation of document identifiers in generative retrieval models through simultaneous decoding. To this aim, PAG constructs a set-based and…

Information Retrieval · Computer Science 2024-04-24 Hansi Zeng , Chen Luo , Hamed Zamani

Query reformulation is a well-known problem in Information Retrieval (IR) aimed at enhancing single search successful completion rate by automatically modifying user's input query. Recent methods leverage Large Language Models (LLMs) to…

Information Retrieval · Computer Science 2024-09-18 Wonduk Seo , Haojie Zhang , Yueyang Zhang , Changhao Zhang , Songyao Duan , Lixin Su , Daiting Shi , Jiashu Zhao , Dawei Yin

Retrieving molecular structures from tandem mass spectra is a crucial step in rapid compound identification. Existing retrieval methods, such as traditional mass spectral library matching, suffer from limited spectral library coverage,…

Machine Learning · Computer Science 2025-11-11 Yiwen Zhang , Keyan Ding , Yihang Wu , Xiang Zhuang , Yi Yang , Qiang Zhang , Huajun Chen

Building test collections for Information Retrieval evaluation has traditionally been a resource-intensive and time-consuming task, primarily due to the dependence on manual relevance judgments. While various cost-effective strategies have…

Information Retrieval · Computer Science 2025-01-07 Mehmet Deniz Türkmen , Mucahid Kutlu , Bahadir Altun , Gokalp Cosgun

Knowledge-intensive language tasks require NLP systems to both provide the correct answer and retrieve supporting evidence for it in a given corpus. Autoregressive language models are emerging as the de-facto standard for generating…

Computation and Language · Computer Science 2022-04-25 Michele Bevilacqua , Giuseppe Ottaviano , Patrick Lewis , Wen-tau Yih , Sebastian Riedel , Fabio Petroni

Retrieval-Augmented Generation allows to enhance Large Language Models with external knowledge. In response to the recent popularity of generative LLMs, many RAG approaches have been proposed, which involve an intricate number of different…

Computation and Language · Computer Science 2024-07-02 David Rau , Hervé Déjean , Nadezhda Chirkova , Thibault Formal , Shuai Wang , Vassilina Nikoulina , Stéphane Clinchant