English
Related papers

Related papers: Evidence Aggregation for Answer Re-Ranking in Open…

200 papers

Open-domain question answering (Open-QA) is a common task for evaluating large language models (LLMs). However, current Open-QA evaluations are criticized for the ambiguity in questions and the lack of semantic understanding in evaluators.…

Computation and Language · Computer Science 2024-05-28 Peiran Yao , Denilson Barbosa

We present assertion based question answering (ABQA), an open domain question answering task that takes a question and a passage as inputs, and outputs a semi-structured assertion consisting of a subject, a predicate and a list of…

Computation and Language · Computer Science 2018-01-24 Zhao Yan , Duyu Tang , Nan Duan , Shujie Liu , Wendi Wang , Daxin Jiang , Ming Zhou , Zhoujun Li

While numerous methods have been proposed as defenses against adversarial examples in question answering (QA), these techniques are often model specific, require retraining of the model, and give only marginal improvements in performance…

Computation and Language · Computer Science 2021-02-08 Sagnik Majumder , Chinmoy Samant , Greg Durrett

This paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA). In this challenging scenario, given an input question the system has to gather evidence documents from a…

Answering questions that require multi-hop reasoning at web-scale necessitates retrieving multiple evidence documents, one of which often has little lexical or semantic relationship to the question. This paper introduces a new graph-based…

Computation and Language · Computer Science 2020-02-17 Akari Asai , Kazuma Hashimoto , Hannaneh Hajishirzi , Richard Socher , Caiming Xiong

Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on…

Computation and Language · Computer Science 2024-09-30 Minsang Kim , Cheoneum Park , Seungjun Baek

Recent state-of-the-art open-domain QA models are typically based on a two stage retriever-reader approach in which the retriever first finds the relevant knowledge/passages and the reader then leverages that to predict the answer. Prior…

Computation and Language · Computer Science 2022-11-24 Neeraj Varshney , Man Luo , Chitta Baral

Knowledge-intensive tasks, such as open-domain question answering (QA), require access to a large amount of world or domain knowledge. A common approach for knowledge-intensive tasks is to employ a retrieve-then-read pipeline that first…

Computation and Language · Computer Science 2023-01-26 Wenhao Yu , Dan Iter , Shuohang Wang , Yichong Xu , Mingxuan Ju , Soumya Sanyal , Chenguang Zhu , Michael Zeng , Meng Jiang

We consider the problem of adapting neural paragraph-level question answering models to the case where entire documents are given as input. Our proposed solution trains models to produce well calibrated confidence scores for their results…

Computation and Language · Computer Science 2017-11-08 Christopher Clark , Matt Gardner

Often questions provided to open-domain question answering systems are ambiguous. Traditional QA systems that provide a single answer are incapable of answering ambiguous questions since the question may be interpreted in several ways and…

Computation and Language · Computer Science 2022-11-30 Poojitha Nandigam , Nikhil Rayaprolu , Manish Shrivastava

Legal question answering (QA) has attracted increasing attention from people seeking legal advice, which aims to retrieve the most applicable answers from a large-scale database of question-answer pairs. Previous methods mainly use a…

Computation and Language · Computer Science 2024-12-30 Shiwen Ni , Hao Cheng , Min Yang

This paper introduces a new framework for open-domain question answering in which the retriever and the reader iteratively interact with each other. The framework is agnostic to the architecture of the machine reading model, only requiring…

Computation and Language · Computer Science 2019-05-15 Rajarshi Das , Shehzaad Dhuliawala , Manzil Zaheer , Andrew McCallum

A common thread of open-domain question answering (QA) models employs a retriever-reader pipeline that first retrieves a handful of relevant passages from Wikipedia and then peruses the passages to produce an answer. However, even…

Computation and Language · Computer Science 2022-10-11 Mingxuan Ju , Wenhao Yu , Tong Zhao , Chuxu Zhang , Yanfang Ye

Recent studies on Question Answering (QA) and Conversational QA (ConvQA) emphasize the role of retrieval: a system first retrieves evidence from a large collection and then extracts answers. This open-retrieval ConvQA setting typically…

Information Retrieval · Computer Science 2021-03-04 Chen Qu , Liu Yang , Cen Chen , W. Bruce Croft , Kalpesh Krishna , Mohit Iyyer

Open Domain Question Answering (QA) is evolving from complex pipelined systems to end-to-end deep neural networks. Specialized neural models have been developed for extracting answers from either text alone or Knowledge Bases (KBs) alone.…

Computation and Language · Computer Science 2018-09-05 Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , William W. Cohen

In open-domain question answering, questions are highly likely to be ambiguous because users may not know the scope of relevant topics when formulating them. Therefore, a system needs to find possible interpretations of the question, and…

Recent advances in open-domain QA have led to strong models based on dense retrieval, but only focused on retrieving textual passages. In this work, we tackle open-domain QA over tables for the first time, and show that retrieval can be…

Computation and Language · Computer Science 2021-06-10 Jonathan Herzig , Thomas Müller , Syrine Krichene , Julian Martin Eisenschlos

BERT model has been successfully applied to open-domain QA tasks. However, previous work trains BERT by viewing passages corresponding to the same question as independent training instances, which may cause incomparable scores for answers…

Computation and Language · Computer Science 2019-10-03 Zhiguo Wang , Patrick Ng , Xiaofei Ma , Ramesh Nallapati , Bing Xiang

Knowledge-intensive visual question answering requires models to effectively use external knowledge to help answer visual questions. A typical pipeline includes a knowledge retriever and an answer generator. However, a retriever that…

Computation and Language · Computer Science 2024-07-18 Haoyang Wen , Honglei Zhuang , Hamed Zamani , Alexander Hauptmann , Michael Bendersky

How retrieved documents are used in language models (LMs) for long-form generation task is understudied. We present two controlled studies on retrieval-augmented LM for long-form question answering (LFQA): one fixing the LM and varying…

Computation and Language · Computer Science 2025-10-07 Hung-Ting Chen , Fangyuan Xu , Shane Arora , Eunsol Choi