English
Related papers

Related papers: Ellipsis Resolution as Question Answering: An Eval…

200 papers

While the body of research directed towards constructing and generating clarifying questions in mixed-initiative conversational search systems is vast, research aimed at processing and comprehending users' answers to such questions is…

Information Retrieval · Computer Science 2024-01-23 Ivan Sekulić , Weronika Łajewska , Krisztian Balog , Fabio Crestani

Existing methods for open-retrieval question answering in lower resource languages (LRLs) lag significantly behind English. They not only suffer from the shortcomings of non-English document retrieval, but are reliant on language-specific…

Computation and Language · Computer Science 2021-07-19 Ivan Montero , Shayne Longpre , Ni Lao , Andrew J. Frank , Christopher DuBois

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

Ambiguous questions are a challenge for Question Answering models, as they require answers that cover multiple interpretations of the original query. To this end, these models are required to generate long-form answers that often combine…

Computation and Language · Computer Science 2023-05-23 Konstantinos Papakostas , Irene Papadopoulou

One of the most widely used tasks for evaluating Large Language Models (LLMs) is Multiple-Choice Question Answering (MCQA). While open-ended question answering tasks are more challenging to evaluate, MCQA tasks are, in principle, easier to…

Computation and Language · Computer Science 2025-06-10 Francesco Maria Molfese , Luca Moroni , Luca Gioffré , Alessandro Scirè , Simone Conia , Roberto Navigli

Popular QA benchmarks like SQuAD have driven progress on the task of identifying answer spans within a specific passage, with models now surpassing human performance. However, retrieving relevant answers from a huge corpus of documents is…

Computation and Language · Computer Science 2020-02-13 Amin Ahmad , Noah Constant , Yinfei Yang , Daniel Cer

Interpretability in Table Question Answering (Table QA) is critical, especially in high-stakes domains like finance and healthcare. While recent Table QA approaches based on Large Language Models (LLMs) achieve high accuracy, they often…

Computation and Language · Computer Science 2025-07-01 Giang Nguyen , Ivan Brugere , Shubham Sharma , Sanjay Kariyappa , Anh Totti Nguyen , Freddy Lecue

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the emergence of…

Reading comprehension is a key for individual success, yet the assessment of question difficulty remains challenging due to the extensive human annotation and large-scale testing required by traditional methods such as linguistic analysis…

Computation and Language · Computer Science 2025-02-26 Yoshee Jain , John Hollander , Amber He , Sunny Tang , Liang Zhang , John Sabatini

\Ac{LFQA} aims to generate lengthy answers to complex questions. This scenario presents great flexibility as well as significant challenges for evaluation. Most evaluations rely on deterministic metrics that depend on string or n-gram…

Information Retrieval · Computer Science 2025-04-28 Ning Xian , Yixing Fan , Ruqing Zhang , Maarten de Rijke , Jiafeng Guo

Standard accuracy metrics indicate that modern reading comprehension systems have achieved strong performance in many question answering datasets. However, the extent these systems truly understand language remains unknown, and existing…

Computation and Language · Computer Science 2019-09-04 Yi-Ting Yeh , Yun-Nung Chen

Any system which performs goal-directed continual learning must not only learn incrementally but process and absorb information incrementally. Such a system also has to understand when its goals have been achieved. In this paper, we…

Computation and Language · Computer Science 2019-01-16 Samira Abnar , Tania Bedrax-weiss , Tom Kwiatkowski , William W. Cohen

User queries are often underspecified and may admit multiple valid interpretations. Rather than silently making assumptions about the user's intent, a helpful assistant should surface such ambiguity by asking a clarifying question. Doing so…

Computation and Language · Computer Science 2026-05-26 Jinyan Su , Claire Cardie

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

Reading comprehension is a challenging task, especially when executed across longer or across multiple evidence documents, where the answer is likely to reoccur. Existing neural architectures typically do not scale to the entire evidence,…

Computation and Language · Computer Science 2018-06-01 Swabha Swayamdipta , Ankur P. Parikh , Tom Kwiatkowski

While there has been substantial progress in text comprehension through simple factoid question answering, more holistic comprehension of a discourse still presents a major challenge (Dunietz et al., 2020). Someone critically reflecting on…

Computation and Language · Computer Science 2022-10-18 Wei-Jen Ko , Cutter Dalton , Mark Simmons , Eliza Fisher , Greg Durrett , Junyi Jessy Li

Relation extraction is an important task in knowledge acquisition and text understanding. Existing works mainly focus on improving relation extraction by extracting effective features or designing reasonable model structures. However, few…

Computation and Language · Computer Science 2021-04-08 Jiayang Cheng , Haiyun Jiang , Deqing Yang , Yanghua Xiao

In human conversations, ellipsis and coreference are commonly occurring linguistic phenomena. Although these phenomena are a mean of making human-machine conversations more fluent and natural, only few dialogue corpora contain explicit…

Computation and Language · Computer Science 2022-07-08 Quentin Brabant , Lina Maria Rojas-Barahona , Claire Gardent

We present ELQA, a corpus of questions and answers in and about the English language. Collected from two online forums, the >70k questions (from English learners and others) cover wide-ranging topics including grammar, meaning, fluency, and…

Computation and Language · Computer Science 2023-07-04 Shabnam Behzad , Keisuke Sakaguchi , Nathan Schneider , Amir Zeldes

Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are…

Computation and Language · Computer Science 2021-06-08 Akari Asai , Eunsol Choi