English
Related papers

Related papers: MCScript: A Novel Dataset for Assessing Machine Co…

200 papers

Story generation, namely generating a reasonable story from a leading context, is an important but challenging task. In spite of the success in modeling fluency and local coherence, existing neural language generation models (e.g., GPT-2)…

Computation and Language · Computer Science 2020-01-16 Jian Guan , Fei Huang , Zhihao Zhao , Xiaoyan Zhu , Minlie Huang

Machine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explainability beyond the model interpretation, i.e., reading…

Computation and Language · Computer Science 2021-01-27 Saku Sugawara , Pontus Stenetorp , Akiko Aizawa

Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this…

Computation and Language · Computer Science 2019-10-16 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou , Zhiyuan Liu

It is very challenging to curate a dataset for language-specific knowledge and common sense in order to evaluate natural language understanding capabilities of language models. Due to the limitation in the availability of annotators, most…

Computation and Language · Computer Science 2024-06-07 Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

Human tackle reading comprehension not only based on the given context itself but often rely on the commonsense beyond. To empower the machine with commonsense reasoning, in this paper, we propose a Commonsense Evidence Generation and…

Artificial Intelligence · Computer Science 2020-05-12 Ye Liu , Tao Yang , Zeyu You , Wei Fan , Philip S. Yu

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

Computation and Language · Computer Science 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

Script knowledge is critical for humans to understand the broad daily tasks and routine activities in the world. Recently researchers have explored the large-scale pre-trained language models (PLMs) to perform various script related tasks,…

Computation and Language · Computer Science 2022-04-22 Zijian Jin , Xingyu Zhang , Mo Yu , Lifu Huang

We describe a detailed analysis of a sample of large benchmark of commonsense reasoning problems that has been automatically obtained from WordNet, SUMO and their mapping. The objective is to provide a better assessment of the quality of…

Artificial Intelligence · Computer Science 2019-09-09 Javier Álvez , Itziar Gonzalez-Dios , German Rigau

Commonsense reasoning is a critical AI capability, but it is difficult to construct challenging datasets that test common sense. Recent neural question answering systems, based on large pre-trained models of language, have already achieved…

Computation and Language · Computer Science 2019-07-29 Michael Chen , Mike D'Arcy , Alisa Liu , Jared Fernandez , Doug Downey

Humans have the capacity to draw common-sense inferences from natural language: various things that are likely but not certain to hold based on established discourse, and are rarely stated explicitly. We propose an evaluation of automated…

Computation and Language · Computer Science 2017-06-05 Sheng Zhang , Rachel Rudinger , Kevin Duh , Benjamin Van Durme

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading comprehension datasets, in…

Computation and Language · Computer Science 2018-03-16 Yiming Cui , Ting Liu , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu

Sources of commonsense knowledge support applications in natural language understanding, computer vision, and knowledge graphs. Given their complementarity, their integration is desired. Yet, their different foci, modeling approaches, and…

Artificial Intelligence · Computer Science 2021-03-24 Filip Ilievski , Pedro Szekely , Bin Zhang

Various applications in computational linguistics and artificial intelligence rely on high-performing word sense disambiguation techniques to solve challenging tasks such as information retrieval, machine translation, question answering,…

Computation and Language · Computer Science 2021-01-11 Mohannad AlMousa , Rachid Benlamri , Richard Khoury

Commonsense knowledge is essential for many AI applications, including those in natural language processing, visual processing, and planning. Consequently, many sources that include commonsense knowledge have been designed and constructed…

Artificial Intelligence · Computer Science 2021-07-30 Filip Ilievski , Alessandro Oltramari , Kaixin Ma , Bin Zhang , Deborah L. McGuinness , Pedro Szekely

Data Scientists leverage common sense reasoning and domain knowledge to understand and enrich data for building predictive models. In recent years, we have witnessed a surge in tools and techniques for {\em automated machine learning}.…

Artificial Intelligence · Computer Science 2022-05-18 Udayan Khurana , Kavitha Srinivas , Horst Samulowitz

Script learning studies how stereotypical events unfold, enabling machines to reason about narratives with implicit information. Previous works mostly consider a script as a linear sequence of events while ignoring the potential branches…

Artificial Intelligence · Computer Science 2024-03-19 Zhaoyi Joey Hou , Li Zhang , Chris Callison-Burch

Understanding users' intentions in e-commerce platforms requires commonsense knowledge. In this paper, we present FolkScope, an intention knowledge graph construction framework to reveal the structure of humans' minds about purchasing…

Computation and Language · Computer Science 2023-05-12 Changlong Yu , Weiqi Wang , Xin Liu , Jiaxin Bai , Yangqiu Song , Zheng Li , Yifan Gao , Tianyu Cao , Bing Yin

Commonsense reasoning (CSR) requires the model to be equipped with general world knowledge. While CSR is a language-agnostic process, most comprehensive knowledge sources are in few popular languages, especially English. Thus, it remains…

Computation and Language · Computer Science 2021-10-19 Yuwei Fang , Shuohang Wang , Yichong Xu , Ruochen Xu , Siqi Sun , Chenguang Zhu , Michael Zeng

When building artificial intelligence systems that can reason and answer questions about visual data, we need diagnostic tests to analyze our progress and discover shortcomings. Existing benchmarks for visual question answering can help,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-22 Justin Johnson , Bharath Hariharan , Laurens van der Maaten , Li Fei-Fei , C. Lawrence Zitnick , Ross Girshick

Exploiting relationships among objects has achieved remarkable progress in interpreting images or videos by natural language. Most existing methods resort to first detecting objects and their relationships, and then generating textual…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Jingyi Hou , Xinxiao Wu , Yayun Qi , Wentian Zhao , Jiebo Luo , Yunde Jia