English
Related papers

Related papers: When to Fold'em: How to answer Unanswerable questi…

200 papers

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

We present an automatic large language model (LLM) conversion approach that produces uncertainty-aware LLMs capable of estimating uncertainty with every prediction. Our approach is model- and data-agnostic, is computationally-efficient, and…

State-of-the-art extractive question-answering models achieve superhuman performances on the SQuAD benchmark. Yet, they are unreasonably heavy and need expensive GPU computing to answer questions in a reasonable time. Thus, they cannot be…

Computation and Language · Computer Science 2025-03-11 Sofian Chaybouti , Achraf Saghe , Aymen Shabou

Question answering(QA) is one of the most challenging yet widely investigated problems in Natural Language Processing (NLP). Question-answering (QA) systems try to produce answers for given questions. These answers can be generated from…

Computation and Language · Computer Science 2025-08-06 Kholoud Alsubhi , Amani Jamal , Areej Alhothali

While models have reached superhuman performance on popular question answering (QA) datasets such as SQuAD, they have yet to outperform humans on the task of question answering itself. In this paper, we investigate if models are learning…

Computation and Language · Computer Science 2021-09-14 Priyanka Sen , Amir Saffari

Contemporary question answering (QA) systems, including transformer-based architectures, suffer from increasing computational and model complexity which render them inefficient for real-world applications with limited resources. Further,…

We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text…

Computation and Language · Computer Science 2016-10-12 Pranav Rajpurkar , Jian Zhang , Konstantin Lopyrev , Percy Liang

The last several years have seen intensive interest in exploring neural-network-based models for machine comprehension (MC) and question answering (QA). In this paper, we approach the problems by closely modelling questions in a neural…

Computation and Language · Computer Science 2017-03-28 Junbei Zhang , Xiaodan Zhu , Qian Chen , Lirong Dai , Si Wei , Hui Jiang

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

Computation and Language · Computer Science 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti

This paper studies joint models for selecting correct answer sentences among the top $k$ provided by answer sentence selection (AS2) modules, which are core components of retrieval-based Question Answering (QA) systems. Our work shows that…

Computation and Language · Computer Science 2021-08-17 Zeyu Zhang , Thuy Vu , Alessandro Moschitti

We show that the task of question answering (QA) can significantly benefit from the transfer learning of models trained on a different large, fine-grained QA dataset. We achieve the state of the art in two well-studied QA datasets, WikiQA…

Computation and Language · Computer Science 2018-06-22 Sewon Min , Minjoon Seo , Hannaneh Hajishirzi

Current state-of-the-art reading comprehension models rely heavily on recurrent neural networks. We explored an entirely different approach to question answering: a convolutional model. By their nature, these convolutional models are fast…

Computation and Language · Computer Science 2018-10-23 Tobin Bell , Benjamin Penchas

Self-Rewarding Language Models propose an architecture in which the Large Language Models(LLMs) both generates responses and evaluates its own outputs via LLM-as-a-Judge prompting, dynamically improving its generative capabilities through…

Computation and Language · Computer Science 2025-08-11 Yidong Wang , Xin Wang , Cunxiang Wang , Junfeng Fang , Qiufeng Wang , Jianing Chu , Xuran Meng , Shuxun Yang , Libo Qin , Yue Zhang , Wei Ye , Shikun Zhang

Question answering (QA) is an important aspect of open-domain conversational agents, garnering specific research focus in the conversational QA (ConvQA) subtask. One notable limitation of recent ConvQA efforts is the response being answer…

Computation and Language · Computer Science 2020-12-18 Ashutosh Baheti , Alan Ritter , Kevin Small

A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question/answer pairs. To improve the…

Computation and Language · Computer Science 2021-04-27 Timo Möller , Julian Risch , Malte Pietsch

An effective paradigm for building Automated Question Answering systems is the re-use of previously answered questions, e.g., for FAQs or forum applications. Given a database (DB) of question/answer (q/a) pairs, it is possible to answer a…

Computation and Language · Computer Science 2023-04-04 Stefano Campese , Ivano Lauriola , Alessandro Moschitti

To produce a domain-agnostic question answering model for the Machine Reading Question Answering (MRQA) 2019 Shared Task, we investigate the relative benefits of large pre-trained language models, various data sampling strategies, as well…

Computation and Language · Computer Science 2019-12-05 Shayne Longpre , Yi Lu , Zhucheng Tu , Chris DuBois

Lifelong language learning aims to stream learning NLP tasks while retaining knowledge of previous tasks. Previous works based on the language model and following data-free constraint approaches have explored formatting all data as "begin…

Computation and Language · Computer Science 2022-12-27 Han Wang , Ruiliu Fu , Xuejun Zhang , Jun Zhou , Qingwei Zhao

Objectives: To adapt and evaluate a deep learning language model for answering why-questions based on patient-specific clinical text. Materials and Methods: Bidirectional encoder representations from transformers (BERT) models were trained…

Computation and Language · Computer Science 2020-03-09 Andrew Wen , Mohamed Y. Elwazir , Sungrim Moon , Jungwei Fan

A popular recent approach to answering open-domain questions is to first search for question-related passages and then apply reading comprehension models to extract answers. Existing methods usually extract answers from single passages…

Computation and Language · Computer Science 2018-04-27 Shuohang Wang , Mo Yu , Jing Jiang , Wei Zhang , Xiaoxiao Guo , Shiyu Chang , Zhiguo Wang , Tim Klinger , Gerald Tesauro , Murray Campbell