English
Related papers

Related papers: CS563-QA: A Collection for Evaluating Question Ans…

200 papers

Question answering (QA) is a high-level ability of natural language processing. Most extractive ma-chine reading comprehension models focus on factoid questions (e.g., who, when, where) and restrict the output answer as a short and…

Computation and Language · Computer Science 2021-10-25 Peng Cui , Dongyao Hu , Le Hu

Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Early studies mainly focused on answering simple questions over KBs and achieved great success. However, their performance on complex questions…

Computation and Language · Computer Science 2022-11-09 Yunshi Lan , Gaole He , Jinhao Jiang , Jing Jiang , Wayne Xin Zhao , Ji-Rong Wen

Visual Question Answering (VQA) is a novel problem domain where multi-modal inputs must be processed in order to solve the task given in the form of a natural language. As the solutions inherently require to combine visual and natural…

Computer Vision and Pattern Recognition · Computer Science 2018-01-31 Mikyas T. Desta , Larry Chen , Tomasz Kornuta

The last few years have seen an explosion of research on the topic of automated question answering (QA), spanning the communities of information retrieval, natural language processing, and artificial intelligence. This tutorial would cover…

Information Retrieval · Computer Science 2020-08-10 Rishiraj Saha Roy , Avishek Anand

One strategy for facilitating reading comprehension is to present information in a question-and-answer format. We demo a system that integrates the tasks of question answering (QA) and question generation (QG) in order to produce Q&A items…

Computation and Language · Computer Science 2021-03-08 Melissa Roemmele , Deep Sidhpura , Steve DeNeefe , Ling Tsou

Conditional question answering (CQA) is an important task that aims to find probable answers and identify missing conditions. Existing approaches struggle with CQA due to two challenges: (1) precisely identifying necessary conditions and…

Computation and Language · Computer Science 2024-10-07 Jiuheng Lin , Yuxuan Lai , Yansong Feng

Thousands of complex natural language questions are submitted to community question answering websites on a daily basis, rendering them as one of the most important information sources these days. However, oftentimes submitted questions are…

Information Retrieval · Computer Science 2019-05-21 Jan Trienes , Krisztian Balog

The evaluation of explanation methods is a research topic that has not yet been explored deeply, however, since explainability is supposed to strengthen trust in artificial intelligence, it is necessary to systematically review and compare…

We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic error categories and we gather for each of them a set of…

Computation and Language · Computer Science 2019-10-17 Avramidis Eleftherios , Vivien Macketanz , Arle Lommel , Hans Uszkoreit

The use of question-based activities (QBAs) is wide-spread in education, traditionally forming an integral part of the learning and assessment process. In this paper, we design and evaluate an automated question generation tool for…

Computation and Language · Computer Science 2023-09-27 Ayan Kumar Bhowmick , Ashish Jagmohan , Aditya Vempaty , Prasenjit Dey , Leigh Hall , Jeremy Hartman , Ravi Kokku , Hema Maheshwari

Ambiguous questions are a challenge for Question Answering models, as they require answers that cover multiple interpretations of the original query. To this end, these models are required to generate long-form answers that often combine…

Computation and Language · Computer Science 2023-05-23 Konstantinos Papakostas , Irene Papadopoulou

The objective of automated Question Answering (QA) systems is to provide answers to user queries in a time efficient manner. The answers are usually found in either databases (or knowledge bases) or a collection of documents commonly…

Artificial Intelligence · Computer Science 2021-11-12 Krishanu Das Baksi

In this paper, we report on Qaviar, an experimental automated evaluation system for question answering applications. The goal of our research was to find an automatically calculated measure that correlates well with human judges' assessment…

Computation and Language · Computer Science 2007-05-23 Eric Breck , John D. Burger , Lisa Ferro , Lynette Hirschman , David House , Marc Light , Inderjeet Mani

Semantic Question Answering (SQA) systems automatically interpret user questions expressed in a natural language in terms of semantic queries. This process involves uncertainty, such that the resulting queries do not always accurately match…

Information Retrieval · Computer Science 2020-06-26 Hamid Zafar , Mohnish Dubey , Jens Lehmann , Elena Demidova

In this thesis, we investigated the relevance, faithfulness, and succinctness aspects of Long Form Question Answering (LFQA). LFQA aims to generate an in-depth, paragraph-length answer for a given question, to help bridge the gap between…

Computation and Language · Computer Science 2022-11-16 Dan Su

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros

Question-answering (QA) is certainly the best known and probably also one of the most complex problem within Natural Language Processing (NLP) and artificial intelligence (AI). Since the complete solution to the problem of finding a generic…

Computation and Language · Computer Science 2020-08-11 Giovanni Di Gennaro , Amedeo Buonanno , Antonio Di Girolamo , Armando Ospedale , Francesco A. N. Palmieri

A fundamental ability of humans is to utilize commonsense knowledge in language understanding and question answering. In recent years, many knowledge-enhanced Commonsense Question Answering (CQA) approaches have been proposed. However, it…

Computation and Language · Computer Science 2021-01-06 Ning Bian , Xianpei Han , Bo Chen , Le Sun

One of the challenges in large-scale information retrieval (IR) is to develop fine-grained and domain-specific methods to answer natural language questions. Despite the availability of numerous sources and datasets for answer retrieval,…

Computation and Language · Computer Science 2019-11-28 Asma Ben Abacha , Dina Demner-Fushman

Attributed Question Answering (AQA) has attracted wide attention, but there are still several limitations in evaluating the attributions, including lacking fine-grained attribution categories, relying on manual annotations, and failing to…

Computation and Language · Computer Science 2025-07-02 Nan Hu , Jiaoyan Chen , Yike Wu , Guilin Qi , Hongru Wang , Sheng Bi , Yongrui Chen , Tongtong Wu , Jeff Z. Pan