English
Related papers

Related papers: Towards Quantifying Commonsense Reasoning with Mec…

200 papers

Reasoning, the ability to logically draw conclusions from existing knowledge, is a hallmark of human. Together with perception, they constitute the two major themes of artificial intelligence. While deep learning has pushed the limit of…

Artificial Intelligence · Computer Science 2024-10-18 Zhaocheng Zhu

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Pretrained language models have excelled at many NLP tasks recently; however, their social intelligence is still unsatisfactory. To enable this, machines need to have a more general understanding of our complicated world and develop the…

Computation and Language · Computer Science 2021-05-13 Ting-Yun Chang , Yang Liu , Karthik Gopalakrishnan , Behnam Hedayatnia , Pei Zhou , Dilek Hakkani-Tur

Large Language Models (LLMs) are known for their remarkable ability to generate synthesized 'knowledge', such as text documents, music, images, etc. However, there is a huge gap between LLM's and human capabilities for understanding…

Computation and Language · Computer Science 2024-08-14 Vladimir Cherkassky , Eng Hock Lee

Large language models (LLMs) have developed impressive performance and strong explainability across various reasoning scenarios, marking a significant stride towards mimicking human-like intelligence. Despite this, when tasked with several…

Computation and Language · Computer Science 2024-11-12 Kai Xiong , Xiao Ding , Ting Liu , Bing Qin , Dongliang Xu , Qing Yang , Hongtao Liu , Yixin Cao

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

While LLMs have emerged as performant architectures for reasoning tasks, their compositional generalization capabilities have been questioned. In this work, we introduce a Compositional Generalization Challenge for Graph-based Commonsense…

Computation and Language · Computer Science 2024-10-10 Xiyan Fu , Anette Frank

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

Human reasoning relies on constructing and manipulating mental models -- simplified internal representations of situations used to understand and solve problems. Conceptual diagrams (e.g., a sketch drawn to aid reasoning) externalize these…

Artificial Intelligence · Computer Science 2025-09-30 Nasim Borazjanizadeh , Roei Herzig , Eduard Oks , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

An interesting class of commonsense reasoning problems arises when people are faced with natural disasters. To investigate this topic, we present \textsf{RESPONSE}, a human-curated dataset containing 1789 annotated instances featuring 6037…

Computation and Language · Computer Science 2025-03-17 Aissatou Diallo , Antonis Bikakis , Luke Dickens , Anthony Hunter , Rob Miller

The interpretation of implicit meanings is an integral aspect of human communication. However, this framework may not transfer to interactions with Large Language Models (LLMs). To investigate this, we introduce the task of Implicit…

Computation and Language · Computer Science 2026-04-21 Antonio De Santis , Tommaso Bonetti , Andrea Tocchetti , Marco Brambilla

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang

Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI). There is a wide range of strategies that can be employed to make progress on this challenge. This article deals with the aspects of…

Artificial Intelligence · Computer Science 2020-06-16 Alexander Gavrilenko , Katerina Morozova

Language models (LMs) trained on large amounts of data have shown impressive performance on many NLP tasks under the zero-shot and few-shot setup. Here we aim to better understand the extent to which such models learn commonsense knowledge…

Computation and Language · Computer Science 2022-11-02 Xiang Lorraine Li , Adhiguna Kuncoro , Jordan Hoffmann , Cyprien de Masson d'Autume , Phil Blunsom , Aida Nematzadeh

Large language models (LLMs) have led to breakthroughs in language tasks, yet the internal mechanisms that enable their remarkable generalization and reasoning abilities remain opaque. This lack of transparency presents challenges such as…

Computation and Language · Computer Science 2024-04-17 Haiyan Zhao , Fan Yang , Bo Shen , Himabindu Lakkaraju , Mengnan Du

This review explores recent advances in commonsense reasoning and intent detection, two key challenges in natural language understanding. We analyze 28 papers from ACL, EMNLP, and CHI (2020-2025), organizing them by methodology and…

Computation and Language · Computer Science 2025-06-18 Md Nazmus Sakib

Concepts play a pivotal role in various human cognitive functions, including learning, reasoning and communication. However, there is very little work on endowing machines with the ability to form and reason with concepts. In particular,…

Computation and Language · Computer Science 2023-11-06 Chen Shani , Jilles Vreeken , Dafna Shahaf

Reasoning is a distinctive human-like characteristic attributed to LLMs in HCI due to their ability to simulate various human-level tasks. However, this work argues that the reasoning behavior of LLMs in HCI is often decontextualized from…

Human-Computer Interaction · Computer Science 2025-10-28 Ramaravind Kommiya Mothilal , Sally Zhang , Syed Ishtiaque Ahmed , Shion Guha

Commonsense reasoning aims to incorporate sets of commonsense facts, retrieved from Commonsense Knowledge Graphs (CKG), to draw conclusion about ordinary situations. The dynamic nature of commonsense knowledge postulates models capable of…

Artificial Intelligence · Computer Science 2021-05-17 Farhad Moghimifar , Lizhen Qu , Yue Zhuo , Gholamreza Haffari , Mahsa Baktashmotlagh

We investigate the degree to which human plausibility judgments of multiple-choice commonsense benchmark answers are subject to influence by (im)plausibility arguments for or against an answer, in particular, using rationales generated by…

Computation and Language · Computer Science 2026-02-25 Shramay Palta , Peter Rankel , Sarah Wiegreffe , Rachel Rudinger