English
Related papers

Related papers: Explain Yourself! Leveraging Language Models for C…

200 papers

Language models (LMs) show state of the art performance for common sense (CS) question answering, but whether this ability implies a human-level mastery of CS remains an open question. Understanding the limitations and strengths of LMs can…

Computation and Language · Computer Science 2022-01-21 Ehsan Qasemi , Lee Kezar , Jay Pujara , Pedro Szekely

Commonsense question answering (QA) requires a model to grasp commonsense and factual knowledge to answer questions about world events. Many prior methods couple language modeling with knowledge graphs (KG). However, although a KG contains…

Computation and Language · Computer Science 2021-08-04 Yichong Xu , Chenguang Zhu , Ruochen Xu , Yang Liu , Michael Zeng , Xuedong Huang

Plausibility Estimation (PE) plays a crucial role for enabling language models to objectively comprehend the real world. While large language models (LLMs) demonstrate remarkable capabilities in PE tasks but sometimes produce trivial…

Computation and Language · Computer Science 2024-12-31 Chong Liu , Zaiwen Feng , Lin Liu , Zhenyun Deng , Jiuyong Li , Ruifang Zhai , Debo Cheng , Li Qin

Commonsense reasoning refers to the ability of evaluating a social situation and acting accordingly. Identification of the implicit causes and effects of a social context is the driving capability which can enable machines to perform…

Computation and Language · Computer Science 2020-11-03 Farhad Moghimifar , Lizhen Qu , Yue Zhuo , Mahsa Baktashmotlagh , Gholamreza Haffari

Inspired by evidence that pretrained language models (LMs) encode commonsense knowledge, recent work has applied LMs to automatically populate commonsense knowledge graphs (CKGs). However, there is a lack of understanding on their…

Computation and Language · Computer Science 2021-06-23 Peifeng Wang , Filip Ilievski , Muhao Chen , Xiang Ren

High-level reasoning can be defined as the capability to generalize over knowledge acquired via experience, and to exhibit robust behavior in novel situations. Such form of reasoning is a basic skill in humans, who seamlessly use it in a…

Artificial Intelligence · Computer Science 2023-11-15 Alessandro Oltramari

Recently, pretrained language models (e.g., BERT) have achieved great success on many downstream natural language understanding tasks and exhibit a certain level of commonsense reasoning ability. However, their performance on commonsense…

Artificial Intelligence · Computer Science 2023-02-17 Shiyang Li , Jianshu Chen , Dian Yu

We address the general task of structured commonsense reasoning: given a natural language input, the goal is to generate a graph such as an event -- or a reasoning-graph. To employ large language models (LMs) for this task, existing…

Computation and Language · Computer Science 2022-12-07 Aman Madaan , Shuyan Zhou , Uri Alon , Yiming Yang , Graham Neubig

It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting,…

Computation and Language · Computer Science 2022-09-30 Jiacheng Liu , Alisa Liu , Ximing Lu , Sean Welleck , Peter West , Ronan Le Bras , Yejin Choi , Hannaneh Hajishirzi

Generative commonsense reasoning refers to the task of generating acceptable and logical assumptions about everyday situations based on commonsense understanding. By utilizing an existing dataset such as Korean CommonGen, language…

Computation and Language · Computer Science 2023-06-27 Dahyun Jung , Jaehyung Seo , Jaewook Lee , Chanjun Park , Heuiseok Lim

Commonsense reasoning is an important aspect of building robust AI systems and is receiving significant attention in the natural language understanding, computer vision, and knowledge graphs communities. At present, a number of valuable…

Artificial Intelligence · Computer Science 2020-06-24 Filip Ilievski , Pedro Szekely , Jingwei Cheng , Fu Zhang , Ehsan Qasemi

Stories generated with neural language models have shown promise in grammatical and stylistic consistency. However, the generated stories are still lacking in common sense reasoning, e.g., they often contain sentences deprived of world…

Machine Learning · Computer Science 2020-03-02 Huanru Henry Mao , Bodhisattwa Prasad Majumder , Julian McAuley , Garrison W. Cottrell

Language technologies that accurately model the dynamics of events must perform commonsense reasoning. Existing work evaluating commonsense reasoning focuses on making inferences about common, everyday situations. To instead investigate the…

Computation and Language · Computer Science 2024-05-02 Wenting Zhao , Justin T Chiu , Jena D. Hwang , Faeze Brahman , Jack Hessel , Sanjiban Choudhury , Yejin Choi , Xiang Lorraine Li , Alane Suhr

Commonsense knowledge-graphs (CKGs) are important resources towards building machines that can 'reason' on text or environmental inputs and make inferences beyond perception. While current CKGs encode world knowledge for a large number of…

Computation and Language · Computer Science 2022-12-19 Shantanu Jaiswal , Liu Yan , Dongkyu Choi , Kenneth Kwok

Enabling robots to understand instructions provided via spoken natural language would facilitate interaction between robots and people in a variety of settings in homes and workplaces. However, natural language instructions are often…

Robotics · Computer Science 2020-07-22 Haonan Chen , Hao Tan , Alan Kuntz , Mohit Bansal , Ron Alterovitz

Large-scale commonsense knowledge bases empower a broad range of AI applications, where the automatic extraction of commonsense knowledge (CKE) is a fundamental and challenging problem. CKE from text is known for suffering from the inherent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuan Yao , Tianyu Yu , Ao Zhang , Mengdi Li , Ruobing Xie , Cornelius Weber , Zhiyuan Liu , Hai-Tao Zheng , Stefan Wermter , Tat-Seng Chua , Maosong Sun

Commonsense reasoning is intuitive for humans but has been a long-term challenge for artificial intelligence (AI). Recent advancements in pretrained language models have shown promising results on several commonsense benchmark datasets.…

Computation and Language · Computer Science 2021-06-03 Shikhar Singh , Nuan Wen , Yu Hou , Pegah Alipoormolabashi , Te-Lin Wu , Xuezhe Ma , Nanyun Peng

Contextualized representations trained over large raw text data have given remarkable improvements for NLP tasks including question answering and reading comprehension. There have been works showing that syntactic, semantic and word sense…

Computation and Language · Computer Science 2021-02-12 Xuhui Zhou , Yue Zhang , Leyang Cui , Dandan Huang

Commonsense question answering (CQA) aims to test if models can answer questions regarding commonsense knowledge that everyone knows. Prior works that incorporate external knowledge bases have shown promising results, but knowledge bases…

Computation and Language · Computer Science 2022-01-04 Zi-Yi Dou , Nanyun Peng

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's…

Artificial Intelligence · Computer Science 2020-10-21 Mo Yu , Xiaoxiao Guo , Yufei Feng , Xiaodan Zhu , Michael Greenspan , Murray Campbell