English
Related papers

Related papers: Adversarial Transformer Language Models for Contex…

200 papers

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an essential cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's Interactive…

Computation and Language · Computer Science 2023-05-29 Mo Yu , Yi Gu , Xiaoxiao Guo , Yufei Feng , Xiaodan Zhu , Michael Greenspan , Murray Campbell , Chuang Gan

This review explores recent advances in commonsense reasoning and intent detection, two key challenges in natural language understanding. We analyze 28 papers from ACL, EMNLP, and CHI (2020-2025), organizing them by methodology and…

Computation and Language · Computer Science 2025-06-18 Md Nazmus Sakib

Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI). There is a wide range of strategies that can be employed to make progress on this challenge. This article deals with the aspects of…

Artificial Intelligence · Computer Science 2020-06-16 Alexander Gavrilenko , Katerina Morozova

Understanding rich narratives, such as dialogues and stories, often requires natural language processing systems to access relevant knowledge from commonsense knowledge graphs. However, these systems typically retrieve facts from KGs using…

Computation and Language · Computer Science 2022-10-25 Silin Gao , Jena D. Hwang , Saya Kanno , Hiromi Wakaki , Yuki Mitsufuji , Antoine Bosselut

Commonsense generation aims at generating plausible everyday scenario description based on a set of provided concepts. Digging the relationship of concepts from scratch is non-trivial, therefore, we retrieve prototypes from external…

Computation and Language · Computer Science 2020-12-02 Zhihao Fan , Yeyun Gong , Zhongyu Wei , Siyuan Wang , Yameng Huang , Jian Jiao , Xuanjing Huang , Nan Duan , Ruofei Zhang

Pre-trained language models have shown excellent results in few-shot learning scenarios using in-context learning. Although it is impressive, the size of language models can be prohibitive to make them usable in on-device applications, such…

Computation and Language · Computer Science 2022-04-27 Navid Rezaei , Marek Z. Reformat

Conversational modeling is an important task in natural language understanding and machine intelligence. Although previous approaches exist, they are often restricted to specific domains (e.g., booking an airline ticket) and require…

Computation and Language · Computer Science 2015-07-23 Oriol Vinyals , Quoc Le

The state-of-the-art pre-trained language representation models, such as Bidirectional Encoder Representations from Transformers (BERT), rarely incorporate commonsense knowledge or other knowledge explicitly. We propose a pre-training…

Computation and Language · Computer Science 2020-05-07 Zhi-Xiu Ye , Qian Chen , Wen Wang , Zhen-Hua Ling

In empathetic conversations, individuals express their empathy towards others. Previous work has mainly focused on generating empathetic responses by utilizing the speaker's emotion. Besides, external commonsense knowledge has been applied…

Computation and Language · Computer Science 2023-06-09 Hua Cai , Xuli Shen , Qing Xu , Weilin Shen , Xiaomei Wang , Weifeng Ge , Xiaoqing Zheng , Xiangyang Xue

Humans have the capacity to draw common-sense inferences from natural language: various things that are likely but not certain to hold based on established discourse, and are rarely stated explicitly. We propose an evaluation of automated…

Computation and Language · Computer Science 2017-06-05 Sheng Zhang , Rachel Rudinger , Kevin Duh , Benjamin Van Durme

Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and CommonsenseQA) mainly focus on the discriminative task of choosing…

Computation and Language · Computer Science 2021-09-23 Pei Zhou , Karthik Gopalakrishnan , Behnam Hedayatnia , Seokhwan Kim , Jay Pujara , Xiang Ren , Yang Liu , Dilek Hakkani-Tur

Enthymemes are defined as arguments where a premise or conclusion is left implicit. We tackle the task of generating the implicit premise in an enthymeme, which requires not only an understanding of the stated conclusion and premise but…

Computation and Language · Computer Science 2021-09-14 Tuhin Chakrabarty , Aadit Trivedi , Smaranda Muresan

Recently, commonsense reasoning in text generation has attracted much attention. Generative commonsense reasoning is the task that requires machines, given a group of keywords, to compose a single coherent sentence with commonsense…

Computation and Language · Computer Science 2023-10-31 Yunxiang Zhang , Xiaojun Wan

The effectiveness of a language model is influenced by its token representations, which must encode contextual information and handle the same word form having a plurality of meanings (polysemy). Currently, none of the common language…

Computation and Language · Computer Science 2022-06-02 Andrea Lekkas , Peter Schneider-Kamp , Isabelle Augenstein

Commonsense knowledge is crucial for artificial intelligence systems to understand natural language. Previous commonsense knowledge acquisition approaches typically rely on human annotations (for example, ATOMIC) or text generation models…

Computation and Language · Computer Science 2021-02-19 Tianqing Fang , Hongming Zhang , Weiqi Wang , Yangqiu Song , Bin He

Commonsense explanation generation aims to empower the machine's sense-making capability by generating plausible explanations to statements against commonsense. While this task is easy to human, the machine still struggles to generate…

Computation and Language · Computer Science 2020-09-25 Haozhe Ji , Pei Ke , Shaohan Huang , Furu Wei , Minlie Huang

Human tackle reading comprehension not only based on the given context itself but often rely on the commonsense beyond. To empower the machine with commonsense reasoning, in this paper, we propose a Commonsense Evidence Generation and…

Artificial Intelligence · Computer Science 2020-05-12 Ye Liu , Tao Yang , Zeyu You , Wei Fan , Philip S. Yu

Conceptualization, or viewing entities and situations as instances of abstract concepts in mind and making inferences based on that, is a vital component in human intelligence for commonsense reasoning. Despite recent progress in artificial…

Computation and Language · Computer Science 2024-05-21 Mutian He , Tianqing Fang , Weiqi Wang , Yangqiu Song

While commonsense knowledge acquisition and reasoning has traditionally been a core research topic in the knowledge representation and reasoning community, recent years have seen a surge of interest in the natural language processing…

Computation and Language · Computer Science 2022-02-01 Prajjwal Bhargava , Vincent Ng

Recently, large-scale pre-trained language models have demonstrated impressive performance on several commonsense-reasoning benchmark datasets. However, building machines with commonsense to compose realistically plausible sentences remains…

Computation and Language · Computer Science 2020-12-01 Bill Yuchen Lin , Wangchunshu Zhou , Ming Shen , Pei Zhou , Chandra Bhagavatula , Yejin Choi , Xiang Ren