English
Related papers

Related papers: Explain Yourself! Leveraging Language Models for C…

200 papers

Commonsense knowledge has proven to be beneficial to a variety of application areas, including question answering and natural language understanding. Previous work explored collecting commonsense knowledge triples automatically from text to…

Computation and Language · Computer Science 2021-02-02 Zhicheng Liang , Deborah L. McGuinness

Currently, contextualized word representations are learned by intricate neural network models, such as masked neural language models (MNLMs). The new representations significantly enhanced the performance in automated question answering by…

Computation and Language · Computer Science 2019-11-11 Sunjae Kwon , Cheongwoong Kang , Jiyeon Han , Jaesik Choi

Commonsense reasoning, the ability to make logical assumptions about daily scenes, is one core intelligence of human beings. In this work, we present a novel task and dataset for evaluating the ability of text-to-image generative models to…

Multimedia · Computer Science 2024-01-24 Mianzhi Pan , Jianfei Li , Mingyue Yu , Zheng Ma , Kanzhi Cheng , Jianbing Zhang , Jiajun Chen

Neural network models can now recognise images, understand text, translate languages, and play many human games at human or superhuman levels. These systems are highly abstracted, but are inspired by biological brains and use only…

Neurons and Cognition · Quantitative Biology 2019-03-06 Katherine R. Storrs , Nikolaus Kriegeskorte

To better support information retrieval tasks such as web search and open-domain question answering, growing effort is made to develop retrieval-oriented language models, e.g., RetroMAE and many others. Most of the existing works focus on…

Computation and Language · Computer Science 2023-05-05 Shitao Xiao , Zheng Liu , Yingxia Shao , Zhao Cao

Deep learning models in computer vision have made remarkable progress, but their lack of transparency and interpretability remains a challenge. The development of explainable AI can enhance the understanding and performance of these models.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Bismillah Khan , Syed Ali Tariq , Tehseen Zia , Muhammad Ahsan , David Windridge

In this paper, we aim to extract commonsense knowledge to improve machine reading comprehension. We propose to represent relations implicitly by situating structured knowledge in a context instead of relying on a pre-defined set of…

Computation and Language · Computer Science 2020-10-20 Kai Sun , Dian Yu , Jianshu Chen , Dong Yu , Claire Cardie

Commonsense reasoning research has so far been limited to English. We aim to evaluate and improve popular multilingual language models (ML-LMs) to help advance commonsense reasoning (CSR) beyond English. We collect the Mickey Corpus,…

Computation and Language · Computer Science 2021-06-15 Bill Yuchen Lin , Seyeon Lee , Xiaoyang Qiao , Xiang Ren

Recent powerful pre-trained language models have achieved remarkable performance on most of the popular datasets for reading comprehension. It is time to introduce more challenging datasets to push the development of this field towards more…

Computation and Language · Computer Science 2020-08-25 Weihao Yu , Zihang Jiang , Yanfei Dong , Jiashi Feng

This review explores recent advances in commonsense reasoning and intent detection, two key challenges in natural language understanding. We analyze 28 papers from ACL, EMNLP, and CHI (2020-2025), organizing them by methodology and…

Computation and Language · Computer Science 2025-06-18 Md Nazmus Sakib

Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations. While there have been several attempts to create datasets that facilitate commonsense inferences in dialogue contexts,…

Computation and Language · Computer Science 2024-01-30 Sarah E. Finch , Jinho D. Choi

Recent efforts in natural language processing (NLP) commonsense reasoning research have yielded a considerable number of new datasets and benchmarks. However, most of these datasets formulate commonsense reasoning challenges in artificial…

Computation and Language · Computer Science 2023-10-25 Mete Ismayilzada , Debjit Paul , Syrielle Montariol , Mor Geva , Antoine Bosselut

Commonsense reasoning is one of the key problems in natural language processing, but the relative scarcity of labeled data holds back the progress for languages other than English. Pretrained cross-lingual models are a source of powerful…

Computation and Language · Computer Science 2021-12-02 Alexey Tikhonov , Max Ryabinin

In empathetic conversations, individuals express their empathy towards others. Previous work has mainly focused on generating empathetic responses by utilizing the speaker's emotion. Besides, external commonsense knowledge has been applied…

Computation and Language · Computer Science 2023-06-09 Hua Cai , Xuli Shen , Qing Xu , Weilin Shen , Xiaomei Wang , Weifeng Ge , Xiaoqing Zheng , Xiangyang Xue

Commonsense knowledge, a major constituent of artificial intelligence (AI), is primarily evaluated in practice by human-prescribed ground-truth labels. An important, albeit implicit, assumption of these labels is that they accurately…

Artificial Intelligence · Computer Science 2026-01-23 Tuan Dung Nguyen , Duncan J. Watts , Mark E. Whiting

We describe a detailed analysis of a sample of large benchmark of commonsense reasoning problems that has been automatically obtained from WordNet, SUMO and their mapping. The objective is to provide a better assessment of the quality of…

Artificial Intelligence · Computer Science 2019-09-09 Javier Álvez , Itziar Gonzalez-Dios , German Rigau

This paper proposes a hybrid neural network (HNN) model for commonsense reasoning. An HNN consists of two component models, a masked language model and a semantic similarity model, which share a BERT-based contextual encoder but use…

Computation and Language · Computer Science 2019-07-30 Pengcheng He , Xiaodong Liu , Weizhu Chen , Jianfeng Gao

The large and still increasing popularity of deep learning clashes with a major limit of neural network architectures, that consists in their lack of capability in providing human-understandable motivations of their decisions. In situations…

Machine Learning · Computer Science 2023-05-22 Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Marco Gori , Pietro Lió , Marco Maggini , Stefano Melacci

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on…

Computation and Language · Computer Science 2020-09-22 Peifeng Wang , Nanyun Peng , Filip Ilievski , Pedro Szekely , Xiang Ren

The pre-trained conversational models still fail to capture the implicit commonsense (CS) knowledge hidden in the dialogue interaction, even though they were pre-trained with an enormous dataset. In order to build a dialogue agent with CS…

Computation and Language · Computer Science 2022-10-03 Ye Liu , Wolfgang Maier , Wolfgang Minker , Stefan Ultes