English
Related papers

Related papers: Looking Under the Hood : Tools for Diagnosing your…

200 papers

In this paper, we propose a novel word-alignment-based method to solve the FAQ-based question answering task. First, we employ a neural network model to calculate question similarity, where the word alignment between two questions is used…

Computation and Language · Computer Science 2015-07-10 Zhiguo Wang , Abraham Ittycheriah

Despite the steady progress in machine translation evaluation, existing automatic metrics struggle to capture how well meaning is preserved beyond sentence boundaries. We posit that reliance on a single intrinsic quality score, trained to…

Computation and Language · Computer Science 2025-08-12 Patrick Fernandes , Sweta Agrawal , Emmanouil Zaranis , André F. T. Martins , Graham Neubig

Neural network-based methods represent the state-of-the-art in question generation from text. Existing work focuses on generating only questions from text without concerning itself with answer generation. Moreover, our analysis shows that…

Computation and Language · Computer Science 2018-03-13 Vishwajeet Kumar , Kireeti Boorla , Yogesh Meena , Ganesh Ramakrishnan , Yuan-Fang Li

Retrieval-augmented language models have demonstrated performance comparable to much larger models while requiring fewer computational resources. The effectiveness of these models crucially depends on the overlap between query and retrieved…

Computation and Language · Computer Science 2025-05-21 Ehsan Doostmohammadi , Marco Kuhlmann

In multi-turn dialog, utterances do not always take the full form of sentences \cite{Carbonell1983DiscoursePA}, which naturally makes understanding the dialog context more difficult. However, it is essential to fully grasp the dialog…

Computation and Language · Computer Science 2020-12-15 Xiuying Chen , Zhi Cui , Jiayi Zhang , Chen Wei , Jianwei Cui , Bin Wang , Dongyan Zhao , Rui Yan

Accurately understanding temporal relations between events is a critical building block of diverse tasks, such as temporal reading comprehension (TRC) and relation extraction (TRE). For example in TRC, we need to understand the temporal…

Computation and Language · Computer Science 2025-06-18 Jongho Kim , Dohyeon Lee , Minsoo Kim , Seung-won Hwang

One long-term goal of machine learning research is to produce methods that are applicable to reasoning and natural language, in particular building an intelligent dialogue agent. To measure progress towards that goal, we argue for the…

Artificial Intelligence · Computer Science 2016-01-01 Jason Weston , Antoine Bordes , Sumit Chopra , Alexander M. Rush , Bart van Merriënboer , Armand Joulin , Tomas Mikolov

General Question Answering (QA) systems over texts require the multi-hop reasoning capability, i.e. the ability to reason with information collected from multiple passages to derive the answer. In this paper we conduct a systematic analysis…

Computation and Language · Computer Science 2019-11-01 Haoyu Wang , Mo Yu , Xiaoxiao Guo , Rajarshi Das , Wenhan Xiong , Tian Gao

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

Computation and Language · Computer Science 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

We address the problem of generating query suggestions to support users in completing their underlying tasks (which motivated them to search in the first place). Given an initial query, these query suggestions should provide a coverage of…

Information Retrieval · Computer Science 2017-08-29 Darío Garigliotti , Krisztian Balog

We consider the problem of conversational question answering over a large-scale knowledge base. To handle huge entity vocabulary of a large-scale knowledge base, recent neural semantic parsing based approaches usually decompose the task…

Computation and Language · Computer Science 2019-10-14 Tao Shen , Xiubo Geng , Tao Qin , Daya Guo , Duyu Tang , Nan Duan , Guodong Long , Daxin Jiang

Multi-choice reading comprehension is a challenging task, which involves the matching between a passage and a question-answer pair. This paper proposes a new co-matching approach to this problem, which jointly models whether a passage can…

Computation and Language · Computer Science 2018-06-12 Shuohang Wang , Mo Yu , Shiyu Chang , Jing Jiang

Reading comprehension is a challenging task, especially when executed across longer or across multiple evidence documents, where the answer is likely to reoccur. Existing neural architectures typically do not scale to the entire evidence,…

Computation and Language · Computer Science 2018-06-01 Swabha Swayamdipta , Ankur P. Parikh , Tom Kwiatkowski

Many natural language processing (NLP) tasks involve reasoning with textual spans, including question answering, entity recognition, and coreference resolution. While extensive research has focused on functional architectures for…

Computation and Language · Computer Science 2020-06-09 Shubham Toshniwal , Haoyue Shi , Bowen Shi , Lingyu Gao , Karen Livescu , Kevin Gimpel

Multiple-choice reading and listening comprehension tests are an important part of language assessment. Content creators for standard educational tests need to carefully curate questions that assess the comprehension abilities of candidates…

Computation and Language · Computer Science 2023-07-04 Vatsal Raina , Adian Liusie , Mark Gales

When evaluating an answer choice for Reading Comprehension task, other answer choices available for the question and the answers of related questions about the same paragraph often provide valuable information. In this paper, we propose a…

Computation and Language · Computer Science 2021-01-01 Rajkumar Pujari , Dan Goldwasser

The Natural Questions (NQ) benchmark set brings new challenges to Machine Reading Comprehension: the answers are not only at different levels of granularity (long and short), but also of richer types (including no-answer, yes/no,…

Computation and Language · Computer Science 2020-09-30 Xuguang Wang , Linjun Shou , Ming Gong , Nan Duan , Daxin Jiang

Multi-hop reading comprehension requires not only the ability to reason over raw text but also the ability to combine multiple evidence. We propose a novel learning approach that helps language models better understand difficult multi-hop…

Computation and Language · Computer Science 2022-11-08 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Natural Questions is a new challenging machine reading comprehension benchmark with two-grained answers, which are a long answer (typically a paragraph) and a short answer (one or more entities inside the long answer). Despite the…

Computation and Language · Computer Science 2020-05-14 Bo Zheng , Haoyang Wen , Yaobo Liang , Nan Duan , Wanxiang Che , Daxin Jiang , Ming Zhou , Ting Liu