English
Related papers

Related papers: Commonsense Knowledge + BERT for Level 2 Reading C…

200 papers

Recent work has shown that neural feature- and representation-learning, e.g. BERT, achieves superior performance over traditional manual feature engineering based approaches, with e.g. SVMs, in translationese classification tasks. Previous…

Computation and Language · Computer Science 2022-10-25 Kwabena Amponsah-Kaakyire , Daria Pylypenko , Josef van Genabith , Cristina España-Bonet

Most existing multi-document machine reading comprehension models mainly focus on understanding the interactions between the input question and documents, but ignore following two kinds of understandings. First, to understand the semantic…

Computation and Language · Computer Science 2022-04-08 Feiliang Ren , Yongkang Liu , Bochao Li , Zhibo Wang , Yu Guo , Shilei Liu , Huimin Wu , Jiaqi Wang , Chunchao Liu , Bingchao Wang

Commonsense reasoning is omnipresent in human communications and thus is an important feature for open-domain dialogue systems. However, evaluating commonsense in dialogue systems is still an open challenge. We take the first step by…

Computation and Language · Computer Science 2023-11-06 Sarik Ghazarian , Yijia Shao , Rujun Han , Aram Galstyan , Nanyun Peng

Several studies have been carried out on revealing linguistic features captured by BERT. This is usually achieved by training a diagnostic classifier on the representations obtained from different layers of BERT. The subsequent…

Computation and Language · Computer Science 2021-09-14 Hosein Mohebbi , Ali Modarressi , Mohammad Taher Pilehvar

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to…

Computation and Language · Computer Science 2019-11-01 Matthew E. Peters , Mark Neumann , Robert L. Logan , Roy Schwartz , Vidur Joshi , Sameer Singh , Noah A. Smith

Humans use countless basic, shared facts about the world to efficiently navigate in their environment. This commonsense knowledge is rarely communicated explicitly, however, understanding how commonsense knowledge is represented in…

Computation and Language · Computer Science 2021-09-21 Chunhua Liu , Trevor Cohn , Lea Frermann

Messages in human conversations inherently convey emotions. The task of detecting emotions in textual conversations leads to a wide range of applications such as opinion mining in social networks. However, enabling machines to analyze…

Computation and Language · Computer Science 2019-10-02 Peixiang Zhong , Di Wang , Chunyan Miao

It is very challenging to curate a dataset for language-specific knowledge and common sense in order to evaluate natural language understanding capabilities of language models. Due to the limitation in the availability of annotators, most…

Computation and Language · Computer Science 2024-06-07 Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

General Question Answering (QA) systems over texts require the multi-hop reasoning capability, i.e. the ability to reason with information collected from multiple passages to derive the answer. In this paper we conduct a systematic analysis…

Computation and Language · Computer Science 2019-11-01 Haoyu Wang , Mo Yu , Xiaoxiao Guo , Rajarshi Das , Wenhan Xiong , Tian Gao

Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension (RC) tasks only focus on questions for which the contexts provide all the information required to answer them,…

Computation and Language · Computer Science 2020-11-17 James Ferguson , Matt Gardner , Hannaneh Hajishirzi , Tushar Khot , Pradeep Dasigi

We present a system for answering questions based on the full text of books (BookQA), which first selects book passages given a question at hand, and then uses a memory network to reason and predict an answer. To improve generalization, we…

Computation and Language · Computer Science 2019-10-03 Stefanos Angelidis , Lea Frermann , Diego Marcheggiani , Roi Blanco , Lluís Màrquez

Commonsense reasoning is an important aspect of building robust AI systems and is receiving significant attention in the natural language understanding, computer vision, and knowledge graphs communities. At present, a number of valuable…

Artificial Intelligence · Computer Science 2020-06-24 Filip Ilievski , Pedro Szekely , Jingwei Cheng , Fu Zhang , Ehsan Qasemi

This paper describes our system for SemEval-2020 Task 4: Commonsense Validation and Explanation (Wang et al., 2020). We propose a novel Knowledge-enhanced Graph Attention Network (KEGAT) architecture for this task, leveraging heterogeneous…

Computation and Language · Computer Science 2020-07-29 Qian Zhao , Siyu Tao , Jie Zhou , Linlin Wang , Xin Lin , Liang He

Textual Question Answering (QA) aims to provide precise answers to user's questions in natural language using unstructured data. One of the most popular approaches to this goal is machine reading comprehension(MRC). In recent years, many…

Computation and Language · Computer Science 2022-02-07 Yang Bai , Daisy Zhe Wang

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

Human-Computer Interaction · Computer Science 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

Recently, transformer-based language models such as BERT have shown tremendous performance improvement for a range of natural language processing tasks. However, these language models usually are computation expensive and memory intensive…

Computation and Language · Computer Science 2021-01-18 Jing Jin , Cai Liang , Tiancheng Wu , Liqin Zou , Zhiliang Gan

Online medical forums have become a predominant platform for answering health-related information needs of consumers. However, with a significant rise in the number of queries and the limited availability of experts, it is necessary to…

Community Question Answering (CQA) becomes increasingly prevalent in recent years. However, there are a large number of answers, which is difficult for users to select the relevant answers. Therefore, answer selection is a very significant…

Computation and Language · Computer Science 2023-11-30 Xinghang Hu

We introduce a large dataset of narrative texts and questions about these texts, intended to be used in a machine comprehension task that requires reasoning using commonsense knowledge. Our dataset complements similar datasets in that we…

Computation and Language · Computer Science 2018-03-15 Simon Ostermann , Ashutosh Modi , Michael Roth , Stefan Thater , Manfred Pinkal

Finding relevant products given a user query is pivotal to an e-commerce platform, as it can drive shopping behavior and generate revenue. The challenge lies in accurately predicting the correlation between queries and products. Recently,…

Information Retrieval · Computer Science 2026-03-25 Ge Zhang , Rohan Deepak Ajwani , Yaochen Hu , Tony Zheng , Hongjian Gu , Wei Guo , Mark Coates , Yingxue Zhang