English
Related papers

Related papers: Towards Universal Dense Retrieval for Open-domain …

200 papers

Answering complex questions is a time-consuming activity for humans that requires reasoning and integration of information. Recent work on reading comprehension made headway in answering simple questions, but tackling complex questions is…

Computation and Language · Computer Science 2018-03-20 Alon Talmor , Jonathan Berant

While dense retrieval models, which embed queries and documents into a shared low-dimensional space, have gained widespread popularity, they were shown to exhibit important theoretical limitations and considerably lag behind traditional…

Information Retrieval · Computer Science 2026-04-09 Adrian Bracher , Svitlana Vakulenko

Open-domain Question Answering (OpenQA) is an important task in Natural Language Processing (NLP), which aims to answer a question in the form of natural language based on large-scale unstructured documents. Recently, there has been a surge…

Artificial Intelligence · Computer Science 2021-05-11 Fengbin Zhu , Wenqiang Lei , Chao Wang , Jianming Zheng , Soujanya Poria , Tat-Seng Chua

Deep language models learning a hierarchical representation proved to be a powerful tool for natural language processing, text mining and information retrieval. However, representations that perform well for retrieval must capture semantic…

Information Retrieval · Computer Science 2019-05-24 Tolgahan Cakaloglu , Xiaowei Xu

Vector representations and vector space modeling (VSM) play a central role in modern machine learning. We propose a novel approach to `vector similarity searching' over dense semantic representations of words and documents that can be…

Information Retrieval · Computer Science 2017-06-06 Jan Rygl , Jan Pomikálek , Radim Řehůřek , Michal Růžička , Vít Novotný , Petr Sojka

Recent research demonstrates the effectiveness of using fine-tuned language models~(LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine-tuning pipelines to realize their full…

Information Retrieval · Computer Science 2021-08-13 Luyu Gao , Jamie Callan

Answer sentence selection is the task of identifying sentences that contain the answer to a given question. This is an important problem in its own right as well as in the larger context of open domain question answering. We propose a novel…

Computation and Language · Computer Science 2014-12-05 Lei Yu , Karl Moritz Hermann , Phil Blunsom , Stephen Pulman

We address the task of sentence retrieval for open-ended dialogues. The goal is to retrieve sentences from a document corpus that contain information useful for generating the next turn in a given dialogue. Prior work on dialogue-based…

Information Retrieval · Computer Science 2022-05-25 Itay Harel , Hagai Taitelbaum , Idan Szpektor , Oren Kurland

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

Computation and Language · Computer Science 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

This paper presents Universal Vision-Language Dense Retrieval (UniVL-DR), which builds a unified model for multi-modal retrieval. UniVL-DR encodes queries and multi-modality resources in an embedding space for searching candidates from…

Information Retrieval · Computer Science 2023-02-07 Zhenghao Liu , Chenyan Xiong , Yuanhuiyi Lv , Zhiyuan Liu , Ge Yu

Vector-based retrieval systems have become a common staple for academic and industrial search applications because they provide a simple and scalable way of extending the search to leverage contextual representations for documents and…

Information Retrieval · Computer Science 2023-04-04 Daniel Campos , ChengXiang Zhai

Open Domain Question Answering requires systems to retrieve external knowledge and perform multi-hop reasoning by composing knowledge spread over multiple sentences. In the recently introduced open domain question answering challenge…

Computation and Language · Computer Science 2020-04-20 Pratyay Banerjee , Chitta Baral

Large language models (LLMs) have made notable progress in logical reasoning, yet still fall short of human-level performance. Current boosting strategies rely on expert-crafted in-domain demonstrations, limiting their applicability in…

Artificial Intelligence · Computer Science 2026-04-08 Jianzhi Yan , Zhiming Li , Le Liu , Zike Yuan , Shiwei Chen , Youcheng Pan , Buzhou Tang , Yang Xiang , Danny Dongning Sun

Comparative text mining extends from genre analysis and political bias detection to the revelation of cultural and geographic differences, through to the search for prior art across patents and scientific papers. These applications use…

Information Retrieval · Computer Science 2019-11-27 Julian Risch , Ralf Krestel

Open-domain generative systems have gained significant attention in the field of conversational AI (e.g., generative search engines). This paper presents a comprehensive review of the attribution mechanisms employed by these systems,…

Computation and Language · Computer Science 2023-12-15 Dongfang Li , Zetian Sun , Xinshuo Hu , Zhenyu Liu , Ziyang Chen , Baotian Hu , Aiguo Wu , Min Zhang

Searching for new information requires talking to the system. In this research, an Open-domain Conversational information search system has been developed. This system has been implemented using the TREC CAsT 2019 track, which is one of the…

Information Retrieval · Computer Science 2021-03-01 Omid Mohammadi Kia , Mahmood Neshati , Mahsa Soudi Alamdari

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the…

Computation and Language · Computer Science 2022-10-25 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Dense retrieval models, which aim at retrieving the most relevant document for an input query on a dense representation space, have gained considerable attention for their remarkable success. Yet, dense models require a vast amount of…

Information Retrieval · Computer Science 2022-03-17 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Open Domain Question Answering (ODQA) within natural language processing involves building systems that answer factual questions using large-scale knowledge corpora. Recent advances stem from the confluence of several factors, such as…

Computation and Language · Computer Science 2024-06-21 Akchay Srivastava , Atif Memon

Most Outside-Knowledge Visual Question Answering (OK-VQA) systems employ a two-stage framework that first retrieves external knowledge given the visual question and then predicts the answer based on the retrieved content. However, the…

Computation and Language · Computer Science 2022-10-24 Jialin Wu , Raymond J. Mooney