English
Related papers

Related papers: MultiReQA: A Cross-Domain Evaluation for Retrieval…

200 papers

A key challenge of multi-hop question answering (QA) in the open-domain setting is to accurately retrieve the supporting passages from a large corpus. Existing work on open-domain QA typically relies on off-the-shelf information retrieval…

Computation and Language · Computer Science 2019-11-05 Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Hong Wang , Shiyu Chang , Murray Campbell , William Yang Wang

Considerable progress has been made recently in open-domain question answering (QA) problems, which require Information Retrieval (IR) and Reading Comprehension (RC). A popular approach to improve the system's performance is to improve the…

Computation and Language · Computer Science 2022-05-10 Zhengzhong Liang , Tushar Khot , Steven Bethard , Mihai Surdeanu , Ashish Sabharwal

Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and…

Computation and Language · Computer Science 2024-07-02 Tal Schuster , Adam D. Lelkes , Haitian Sun , Jai Gupta , Jonathan Berant , William W. Cohen , Donald Metzler

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular…

Computation and Language · Computer Science 2023-04-07 Zhichao Duan , Xiuxing Li , Zhengyan Zhang , Zhenyu Li , Ning Liu , Jianyong Wang

Video Question Answering (VideoQA) has been significantly advanced from the scaling of recent Large Language Models (LLMs). The key idea is to convert the visual information into the language feature space so that the capacity of LLMs can…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Junting Pan , Ziyi Lin , Yuying Ge , Xiatian Zhu , Renrui Zhang , Yi Wang , Yu Qiao , Hongsheng Li

To date, most of recent work under the retrieval-reader framework for open-domain QA focuses on either extractive or generative reader exclusively. In this paper, we study a hybrid approach for leveraging the strengths of both models. We…

Computation and Language · Computer Science 2021-06-04 Hao Cheng , Yelong Shen , Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

Over the last twenty years, significant progress has been made in designing and implementing Question Answering (QA) systems. However, addressing complex questions, the answers to which are spread across multiple documents, remains a…

Computation and Language · Computer Science 2026-02-26 Sourav Saha , Dwaipayan Roy , Mandar Mitra

We study visual question answering in a setting where the answer has to be mined from a pool of relevant and irrelevant images given as a context. For such a setting, a model must first retrieve relevant images from the pool and answer the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Abhirama Subramanyam Penamakuri , Manish Gupta , Mithun Das Gupta , Anand Mishra

Answering questions that require multi-hop reasoning at web-scale necessitates retrieving multiple evidence documents, one of which often has little lexical or semantic relationship to the question. This paper introduces a new graph-based…

Computation and Language · Computer Science 2020-02-17 Akari Asai , Kazuma Hashimoto , Hannaneh Hajishirzi , Richard Socher , Caiming Xiong

A common thread of retrieval-augmented methods in the existing literature focuses on retrieving encyclopedic knowledge, such as Wikipedia, which facilitates well-defined entity and relation spaces that can be modeled. However, applying such…

Computation and Language · Computer Science 2022-10-25 Wenhao Yu , Chenguang Zhu , Zhihan Zhang , Shuohang Wang , Zhuosheng Zhang , Yuwei Fang , Meng Jiang

Adaptive retrieval-augmented generation (ARAG) aims to dynamically determine the necessity of retrieval for queries instead of retrieving indiscriminately to enhance the efficiency and relevance of the sourced information. However, previous…

Computation and Language · Computer Science 2024-06-06 Zihan Zhang , Meng Fang , Ling Chen

Recent work on open domain question answering (QA) assumes strong supervision of the supporting evidence and/or assumes a blackbox information retrieval (IR) system to retrieve evidence candidates. We argue that both are suboptimal, since…

Computation and Language · Computer Science 2019-07-01 Kenton Lee , Ming-Wei Chang , Kristina Toutanova

Multiple-choice question answering (MCQA) has been a popular format for evaluating and reinforcement fine-tuning (RFT) of modern multimodal language models. Its constrained output format allows for simplified, deterministic automatic…

Computation and Language · Computer Science 2025-11-25 Yesheng Liu , Hao Li , Haiyu Xu , Baoqi Pei , Jiahao Wang , Mingxuan Zhao , Jingshu Zheng , Zheqi He , JG Yao , Bowen Qin , Xi Yang , Jiajun Zhang

The retriever-reader pipeline has shown promising performance in open-domain QA but suffers from a very slow inference speed. Recently proposed question retrieval models tackle this problem by indexing question-answer pairs and searching…

Computation and Language · Computer Science 2022-05-20 Yeon Seonwoo , Juhee Son , Jiho Jin , Sang-Woo Lee , Ji-Hoon Kim , Jung-Woo Ha , Alice Oh

To produce a domain-agnostic question answering model for the Machine Reading Question Answering (MRQA) 2019 Shared Task, we investigate the relative benefits of large pre-trained language models, various data sampling strategies, as well…

Computation and Language · Computer Science 2019-12-05 Shayne Longpre , Yi Lu , Zhucheng Tu , Chris DuBois

Retrieving information from correlative paragraphs or documents to answer open-domain multi-hop questions is very challenging. To deal with this challenge, most of the existing works consider paragraphs as nodes in a graph and propose…

Computation and Language · Computer Science 2021-02-09 Nan Shao , Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

The task of long-form question answering (LFQA) involves retrieving documents relevant to a given question and using them to generate a paragraph-length answer. While many models have recently been proposed for LFQA, we show in this paper…

Computation and Language · Computer Science 2021-05-20 Kalpesh Krishna , Aurko Roy , Mohit Iyyer

Retrieval augmented Question Answering (QA) helps QA models overcome knowledge gaps by incorporating retrieved evidence, typically a set of passages, alongside the question at test time. Previous studies show that this approach improves QA…

Computation and Language · Computer Science 2025-09-12 Laura Perez-Beltrachini , Mirella Lapata

Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we…

Computation and Language · Computer Science 2025-07-01 Yaxuan Kong , Yiyuan Yang , Yoontae Hwang , Wenjie Du , Stefan Zohren , Zhangyang Wang , Ming Jin , Qingsong Wen