English
Related papers

Related papers: MultiReQA: A Cross-Domain Evaluation for Retrieval…

200 papers

Multi-hop question answering (QA) involves finding multiple relevant passages and step-by-step reasoning to answer complex questions, indicating a retrieve-and-read paradigm. However, previous retrievers were customized for two-hop…

Computation and Language · Computer Science 2024-04-02 Jiahao Zhang , Haiyang Zhang , Dongmei Zhang , Yong Liu , Shen Huang

We introduce DeepSearchQA, a 900-prompt benchmark for evaluating agents on difficult multi-step information-seeking tasks across 17 different fields. Unlike traditional benchmarks that target single answer retrieval or broad-spectrum…

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous…

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

Recent studies on Question Answering (QA) and Conversational QA (ConvQA) emphasize the role of retrieval: a system first retrieves evidence from a large collection and then extracts answers. This open-retrieval ConvQA setting typically…

Information Retrieval · Computer Science 2021-03-04 Chen Qu , Liu Yang , Cen Chen , W. Bruce Croft , Kalpesh Krishna , Mohit Iyyer

We introduce ART, a new corpus-level autoencoding approach for training dense retrieval models that does not require any labeled training data. Dense retrieval is a central challenge for open-domain tasks, such as Open QA, where…

Computation and Language · Computer Science 2023-04-04 Devendra Singh Sachan , Mike Lewis , Dani Yogatama , Luke Zettlemoyer , Joelle Pineau , Manzil Zaheer

In this paper, we propose a new paradigm for the task of entity-relation extraction. We cast the task as a multi-turn question answering problem, i.e., the extraction of entities and relations is transformed to the task of identifying…

Computation and Language · Computer Science 2019-09-05 Xiaoya Li , Fan Yin , Zijun Sun , Xiayu Li , Arianna Yuan , Duo Chai , Mingxin Zhou , Jiwei Li

Retrieval-Augmented Generation (RAG) is a cornerstone of modern question answering (QA) systems, enabling grounded answers based on external knowledge. Although recent progress has been driven by open-domain datasets, enterprise QA systems…

Artificial Intelligence · Computer Science 2025-05-14 Dvir Cohen , Lin Burg , Sviatoslav Pykhnivskyi , Hagit Gur , Stanislav Kovynov , Olga Atzmon , Gilad Barkan

Retrieval-based code question answering seeks to match user queries in natural language to relevant code snippets. Previous approaches typically rely on pretraining models using crafted bi-modal and uni-modal datasets to align text and code…

Computation and Language · Computer Science 2024-03-26 Zehan Li , Jianfei Zhang , Chuantao Yin , Yuanxin Ouyang , Wenge Rong

Retrieval-augmented question-answering systems combine retrieval techniques with large language models to provide answers that are more accurate and informative. Many existing toolkits allow users to quickly build such systems using…

Computation and Language · Computer Science 2024-03-05 Xiao Yu , Yunan Lu , Zhou Yu

Open Domain Question Answering requires systems to retrieve external knowledge and perform multi-hop reasoning by composing knowledge spread over multiple sentences. In the recently introduced open domain question answering challenge…

Computation and Language · Computer Science 2020-04-20 Pratyay Banerjee , Chitta Baral

We implement a method for re-ranking top-10 results of a state-of-the-art question answering (QA) system. The goal of our re-ranking approach is to improve the answer selection given the user question and the top-10 candidates. We focus on…

Machine Learning · Computer Science 2021-06-17 Michael Barz , Daniel Sonntag

Question answering based on retrieval augmented generation (RAG-QA) is an important research topic in NLP and has a wide range of real-world applications. However, most existing datasets for this task are either constructed using a single…

Computation and Language · Computer Science 2024-10-04 Rujun Han , Yuhao Zhang , Peng Qi , Yumo Xu , Jenyuan Wang , Lan Liu , William Yang Wang , Bonan Min , Vittorio Castelli

Parallel deep learning architectures like fine-tuned BERT and MT-DNN, have quickly become the state of the art, bypassing previous deep and shallow learning methods by a large margin. More recently, pre-trained models from large related…

Information Retrieval · Computer Science 2019-07-04 Hemant Pugaliya , Karan Saxena , Shefali Garg , Sheetal Shalini , Prashant Gupta , Eric Nyberg , Teruko Mitamura

The question answering system can answer questions from various fields and forms with deep neural networks, but it still lacks effective ways when facing multiple evidences. We introduce a new model called SRQA, which means Synthetic Reader…

Computation and Language · Computer Science 2020-09-04 Jiuniu Wang , Wenjia Xu , Xingyu Fu , Yang Wei , Li Jin , Ziyan Chen , Guangluan Xu , Yirong Wu

Generalization and robustness to input variation are core desiderata of machine learning research. Language varies along several axes, most importantly, language instance (e.g. French) and domain (e.g. news). While adapting NLP models to…

Computation and Language · Computer Science 2024-07-02 Leon Engländer , Hannah Sterz , Clifton Poth , Jonas Pfeiffer , Ilia Kuznetsov , Iryna Gurevych

Multimodal information extraction (MIE) aims to extract structured information from unstructured multimedia content. Due to the diversity of tasks and settings, most current MIE models are task-specific and data-intensive, which limits…

Computation and Language · Computer Science 2023-10-05 Yuxuan Sun , Kai Zhang , Yu Su

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG…

Computation and Language · Computer Science 2026-05-28 Yikai Zhu , Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du

How retrieved documents are used in language models (LMs) for long-form generation task is understudied. We present two controlled studies on retrieval-augmented LM for long-form question answering (LFQA): one fixing the LM and varying…

Computation and Language · Computer Science 2025-10-07 Hung-Ting Chen , Fangyuan Xu , Shane Arora , Eunsol Choi

Question Answering (QA) systems provide easy access to the vast amount of knowledge without having to know the underlying complex structure of the knowledge. The research community has provided ad hoc solutions to the key QA tasks,…

Computation and Language · Computer Science 2019-06-11 Somayeh Asadifar , Mohsen Kahani , Saeedeh Shekarpour