English
Related papers

Related papers: Typo-Robust Representation Learning for Dense Retr…

200 papers

Question answering is one of the most important and difficult applications at the border of information retrieval and natural language processing, especially when we talk about complex science questions which require some form of inference…

Computation and Language · Computer Science 2019-05-08 George-Sebastian Pirtoaca , Traian Rebedea , Stefan Ruseti

Dialogue systems can benefit from being able to search through a corpus of text to find information relevant to user requests, especially when encountering a request for which no manually curated response is available. The state-of-the-art…

Information Retrieval · Computer Science 2022-06-02 Hui Wan , Siva Sankalp Patel , J. William Murdock , Saloni Potdar , Sachindra Joshi

Retrieval models based on dense representations in semantic space have become an indispensable branch for first-stage retrieval. These retrievers benefit from surging advances in representation learning towards compressive global…

Computation and Language · Computer Science 2023-03-06 Kai Zhang , Chongyang Tao , Tao Shen , Can Xu , Xiubo Geng , Binxing Jiao , Daxin Jiang

Deep language models learning a hierarchical representation proved to be a powerful tool for natural language processing, text mining and information retrieval. However, representations that perform well for retrieval must capture semantic…

Information Retrieval · Computer Science 2019-05-24 Tolgahan Cakaloglu , Xiaowei Xu

In open-domain question answering, a model receives a text question as input and searches for the correct answer using a large evidence corpus. The retrieval step is especially difficult as typical evidence corpora have \textit{millions} of…

Computation and Language · Computer Science 2021-09-24 Christopher Sciavolino

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

Dense retrieval, which aims to encode the semantic information of arbitrary text into dense vector representations or embeddings, has emerged as an effective and efficient paradigm for text retrieval, consequently becoming an essential…

Information Retrieval · Computer Science 2024-11-20 Zongmeng Zhang , Jinhua Zhu , Wengang Zhou , Xiang Qi , Peng Zhang , Houqiang Li

Recent advances in dense retrieval techniques have offered the promise of being able not just to re-rank documents using contextualised language models such as BERT, but also to use such models to identify documents from the collection in…

Information Retrieval · Computer Science 2021-08-25 Nicola Tonellotto , Craig Macdonald

Conversational dense retrieval has shown to be effective in conversational search. However, a major limitation of conversational dense retrieval is their lack of interpretability, hindering intuitive understanding of model behaviors for…

Information Retrieval · Computer Science 2024-06-04 Yiruo Cheng , Kelong Mao , Zhicheng Dou

Many discriminative natural language understanding (NLU) tasks have large label spaces. Learning such a process of large-space decision making is particularly challenging due to the lack of training instances per label and the difficulty of…

Computation and Language · Computer Science 2023-10-31 Nan Xu , Fei Wang , Mingtao Dong , Muhao Chen

Dense retrieval models using a transformer-based bi-encoder design have emerged as an active area of research. In this work, we focus on the task of monolingual retrieval in a variety of typologically diverse languages using one such…

Information Retrieval · Computer Science 2022-04-06 Xinyu Zhang , Kelechi Ogueji , Xueguang Ma , Jimmy Lin

Dense retrieval (DR) has shown promising results in information retrieval. In essence, DR requires high-quality text representations to support effective search in the representation space. Recent studies have shown that pre-trained…

Information Retrieval · Computer Science 2022-08-23 Xinyu Ma , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

In this demo we present a web-based application for selecting an effective pre-trained dense retriever to use on a private collection. Our system, DenseQuest, provides unsupervised selection and ranking capabilities to predict the best…

Information Retrieval · Computer Science 2024-07-10 Ekaterina Khramtsova , Teerapong Leelanupab , Shengyao Zhuang , Mahsa Baktashmotlagh , Guido Zuccon

Dense retrieval models, which aim at retrieving the most relevant document for an input query on a dense representation space, have gained considerable attention for their remarkable success. Yet, dense models require a vast amount of…

Information Retrieval · Computer Science 2022-03-17 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Efficiently retrieving a concise set of candidates from a large document corpus remains a pivotal challenge in Information Retrieval (IR). Neural retrieval models, particularly dense retrieval models built with transformers and pretrained…

Information Retrieval · Computer Science 2025-01-01 Haitian Chen , Qingyao Ai , Xiao Wang , Yiqun Liu , Fen Lin , Qin Liu

While dense retrieval models, which embed queries and documents into a shared low-dimensional space, have gained widespread popularity, they were shown to exhibit important theoretical limitations and considerably lag behind traditional…

Information Retrieval · Computer Science 2026-04-09 Adrian Bracher , Svitlana Vakulenko

When provided with sufficient explanatory context, smaller Language Models have been shown to exhibit strong reasoning ability on challenging short-answer question-answering tasks where the questions are unseen in training. We evaluate two…

Computation and Language · Computer Science 2023-10-16 Tim Hartill , Diana Benavides-Prado , Michael Witbrock , Patricia J. Riddle

One major deficiency of most semantic representation techniques is that they usually model a word type as a single point in the semantic space, hence conflating all the meanings that the word can have. Addressing this issue by learning…

Computation and Language · Computer Science 2016-08-08 Mohammad Taher Pilehvar , Nigel Collier

Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to robustly represent…

Information Retrieval · Computer Science 2024-04-23 Kelong Mao , Chenlong Deng , Haonan Chen , Fengran Mo , Zheng Liu , Tetsuya Sakai , Zhicheng Dou

Information retrieval involves selecting artifacts from a corpus that are most relevant to a given search query. The flavor of retrieval typically used in classical applications can be termed as homogeneous and relaxed, where queries and…

Information Retrieval · Computer Science 2023-10-10 Anirudh Khatry , Yasharth Bajpai , Priyanshu Gupta , Sumit Gulwani , Ashish Tiwari