English
Related papers

Related papers: Social Commonsense Reasoning with Multi-Head Knowl…

200 papers

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

This paper describes our submission to subtask a and b of SemEval-2020 Task 4. For subtask a, we use a ALBERT based model with improved input form to pick out the common sense statement from two statement candidates. For subtask b, we use a…

Computation and Language · Computer Science 2020-07-07 Shilei Liu , Yu Guo , Bochao Li , Feiliang Ren

Machine Reading Comprehension (MRC) with multiple-choice questions requires the machine to read given passage and select the correct answer among several candidates. In this paper, we propose a novel approach called Convolutional Spatial…

Computation and Language · Computer Science 2019-11-05 Zhipeng Chen , Yiming Cui , Wentao Ma , Shijin Wang , Guoping Hu

Concept Bottleneck Models (CBMs) tackle the opacity of neural architectures by constructing and explaining their predictions using a set of high-level concepts. A special property of these models is that they permit concept interventions,…

Understanding event and event-centered commonsense reasoning are crucial for natural language processing (NLP). Given an observed event, it is trivial for human to infer its intents and effects, while this type of If-Then reasoning still…

Computation and Language · Computer Science 2019-12-03 Li Du , Xiao Ding , Ting Liu , Zhongyang Li

Shared intentionality is a critical component in developing conscious AI agents capable of collaboration, self-reflection, deliberation, and reasoning. We formulate inference of shared intentionality as an inverse reinforcement learning…

Artificial Intelligence · Computer Science 2022-07-14 Susmit Jha , John Rushby

Although neural network approaches achieve remarkable success on a variety of NLP tasks, many of them struggle to answer questions that require commonsense knowledge. We believe the main reason is the lack of commonsense \mbox{connections}…

Computation and Language · Computer Science 2019-03-04 Wanjun Zhong , Duyu Tang , Nan Duan , Ming Zhou , Jiahai Wang , Jian Yin

Attention is a cornerstone of human cognition that facilitates the efficient extraction of information in everyday life. Recent developments in artificial intelligence like the Transformer architecture also incorporate the idea of attention…

Other Quantitative Biology · Quantitative Biology 2024-07-03 Minglu Zhao , Dehong Xu , Tao Gao

Generating commonsense assertions within a given story context remains a difficult task for modern language models. Previous research has addressed this problem by aligning commonsense inferences with stories and training language…

Computation and Language · Computer Science 2024-10-04 Pedro Colon-Hernandez , Nanxi Liu , Chelsea Joe , Peter Chin , Claire Yin , Henry Lieberman , Yida Xin , Cynthia Breazeal

Large pre-trained language models (PLMs) have led to great success on various commonsense question answering (QA) tasks in an end-to-end fashion. However, little attention has been paid to what commonsense knowledge is needed to deeply…

Computation and Language · Computer Science 2021-09-14 Gengyu Wang , Xiaochen Hou , Diyi Yang , Kathleen McKeown , Jing Huang

The extraction and use of diverse knowledge from numerous documents is a pressing challenge in intelligent information retrieval. Documents contain elements that require different recognition methods. Table recognition typically consists of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Takaya Kawakatsu

Multimodal Stance Detection (MSD) is a crucial task for understanding public opinion on social media. Existing methods predominantly operate by learning to fuse modalities. They lack an explicit reasoning process to discern how inter-modal…

Computation and Language · Computer Science 2026-01-06 Bingbing Wang , Zhengda Jin , Bin Liang , Wenjie Li , Jing Li , Ruifeng Xu , Min Zhang

Despite their strong performance on reasoning benchmarks, large language models (LLMs) have proven brittle when presented with counterfactual questions, suggesting weaknesses in their causal reasoning ability. While recent work has…

Machine Learning · Computer Science 2026-02-20 Victoria Lin , Xinnuo Xu , Rachel Lawrence , Risa Ueno , Amit Sharma , Javier Gonzalez , Niranjani Prasad

Although large language models (LLMs) have demonstrated remarkable performance, the lack of transparency in their inference logic raises concerns about their trustworthiness. To gain a better understanding of LLMs, we conduct a detailed…

Computation and Language · Computer Science 2024-07-26 Jie Ren , Qipeng Guo , Hang Yan , Dongrui Liu , Quanshi Zhang , Xipeng Qiu , Dahua Lin

Open-domain dialogue systems need to grasp social commonsense to understand and respond effectively to human users. Commonsense-augmented dialogue models have been proposed that aim to infer commonsense knowledge from dialogue contexts in…

Computation and Language · Computer Science 2025-01-22 Sarah E. Finch , Jinho D. Choi

Recognizing sarcasm often requires a deep understanding of multiple sources of information, including the utterance, the conversational context, and real world facts. Most of the current sarcasm detection systems consider only the utterance…

Computation and Language · Computer Science 2018-09-11 Reza Ghaeini , Xiaoli Z. Fern , Prasad Tadepalli

Attention is a powerful and ubiquitous mechanism for allowing neural models to focus on particular salient pieces of information by taking their weighted average when making predictions. In particular, multi-headed attention is a driving…

Computation and Language · Computer Science 2019-11-05 Paul Michel , Omer Levy , Graham Neubig

There are various models proposed on how knowledge is generated in the human brain including the semantic networks model. Although this model has been widely studied and even computational models are presented, but, due to various limits…

Artificial Intelligence · Computer Science 2025-01-28 Jamshid Ghasimi , Nazanin Movarraei

Concept embeddings offer a practical and efficient mechanism for injecting commonsense knowledge into downstream tasks. Their core purpose is often not to predict the commonsense properties of concepts themselves, but rather to identify…

Artificial Intelligence · Computer Science 2024-06-06 Hanane Kteich , Na Li , Usashi Chatterjee , Zied Bouraoui , Steven Schockaert

Most of the existing work that focus on the identification of implicit knowledge in arguments generally represent implicit knowledge in the form of commonsense or factual knowledge. However, such knowledge is not sufficient to understand…

Computation and Language · Computer Science 2021-10-27 Keshav Singh , Naoya Inoue , Farjana Sultana Mim , Shoichi Naitoh , Kentaro Inui