English
Related papers

Related papers: Zero-shot Commonsense Reasoning over Machine Imagi…

200 papers

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

Compute scaling for language model (LM) pretraining has outpaced the growth of human-written texts, leading to concerns that data will become the bottleneck to LM scaling. To continue scaling pretraining in this data-constrained regime, we…

Machine Learning · Computer Science 2025-09-30 Yangjun Ruan , Neil Band , Chris J. Maddison , Tatsunori Hashimoto

Recently, large pretrained language models have achieved compelling performance on commonsense benchmarks. Nevertheless, it is unclear what commonsense knowledge the models learn and whether they solely exploit spurious patterns. Feature…

Computation and Language · Computer Science 2023-11-01 Xingbo Wang , Renfei Huang , Zhihua Jin , Tianqing Fang , Huamin Qu

Robots often fail at everyday tasks because instructions skip commonsense details like hidden preconditions and small subgoals. Traditional symbolic planners need these details to be written explicitly, which is time consuming and often…

Robotics · Computer Science 2025-12-02 Ohad Bachner , Bar Gamliel

Pre-trained language models (PTLMs) have achieved impressive performance on commonsense inference benchmarks, but their ability to employ commonsense to make robust inferences, which is crucial for effective communications with humans, is…

Computation and Language · Computer Science 2021-09-13 Pei Zhou , Rahul Khanna , Seyeon Lee , Bill Yuchen Lin , Daniel Ho , Jay Pujara , Xiang Ren

Analogical reasoning is a fundamental capacity of human cognition that allows us to reason abstractly about novel situations by relating them to past experiences. While it is thought to be essential for robust reasoning in AI systems,…

Artificial Intelligence · Computer Science 2023-06-06 Xiaoyang Hu , Shane Storks , Richard L. Lewis , Joyce Chai

Visual navigation is an essential skill for home-assistance robots, providing the object-searching ability to accomplish long-horizon daily tasks. Many recent approaches use Large Language Models (LLMs) for commonsense inference to improve…

Robotics · Computer Science 2024-10-15 Xinxin Zhao , Wenzhe Cai , Likun Tang , Teng Wang

Recent work has demonstrated that pre-trained language models (PLMs) are zero-shot learners. However, most existing zero-shot methods involve heavy human engineering or complicated self-training pipelines, hindering their application to new…

Computation and Language · Computer Science 2022-11-24 Yu Fei , Ping Nie , Zhao Meng , Roger Wattenhofer , Mrinmaya Sachan

We address the general task of structured commonsense reasoning: given a natural language input, the goal is to generate a graph such as an event -- or a reasoning-graph. To employ large language models (LMs) for this task, existing…

Computation and Language · Computer Science 2022-12-07 Aman Madaan , Shuyan Zhou , Uri Alon , Yiming Yang , Graham Neubig

Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI). There is a wide range of strategies that can be employed to make progress on this challenge. This article deals with the aspects of…

Artificial Intelligence · Computer Science 2020-06-16 Alexander Gavrilenko , Katerina Morozova

We propose LENS, a modular approach for tackling computer vision problems by leveraging the power of large language models (LLMs). Our system uses a language model to reason over outputs from a set of independent and highly descriptive…

Computation and Language · Computer Science 2023-06-29 William Berrios , Gautam Mittal , Tristan Thrush , Douwe Kiela , Amanpreet Singh

Semantic 3D scene understanding is a problem of critical importance in robotics. While significant advances have been made in simultaneous localization and mapping algorithms, robots are still far from having the common sense knowledge…

Robotics · Computer Science 2022-06-22 William Chen , Siyi Hu , Rajat Talak , Luca Carlone

Commonsense question answering (QA) research requires machines to answer questions based on commonsense knowledge. However, this research requires expensive labor costs to annotate data as the basis of research, and models that rely on…

Computation and Language · Computer Science 2023-05-11 Xin Guan , Biwei Cao , Qingqing Gao , Zheng Yin , Bo Liu , Jiuxin Cao

Pretrained large Language Models (LLMs) are able to answer questions that are unlikely to have been encountered during training. However a diversity of potential applications exist in the broad domain of reasoning systems and considerations…

Computation and Language · Computer Science 2024-11-27 Tim Hartill

How can we extend a pre-trained model to many language understanding tasks, without labeled or additional unlabeled data? Pre-trained language models (PLMs) have been effective for a wide range of NLP tasks. However, existing approaches…

Computation and Language · Computer Science 2023-05-29 Xuandong Zhao , Siqi Ouyang , Zhiguo Yu , Ming Wu , Lei Li

Recently, Large Language Models (LLMs) have been serving as general-purpose interfaces, posing a significant demand for comprehensive visual knowledge. However, it remains unclear how well current LLMs and their visually augmented…

Computation and Language · Computer Science 2023-10-24 Heming Xia , Qingxiu Dong , Lei Li , Jingjing Xu , Tianyu Liu , Ziwei Qin , Zhifang Sui

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's…

Artificial Intelligence · Computer Science 2020-10-21 Mo Yu , Xiaoxiao Guo , Yufei Feng , Xiaodan Zhu , Michael Greenspan , Murray Campbell

Under pure textual modality, Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning tasks by decomposing them into simpler sub-problems. However, Multimodal Large Language Models (MLLMs) still struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingming Liu , Yumeng Li , Boyuan Xiao , Yichang Jian , Ziang Qin , Tianjia Shao , Yao-Xiang Ding , Kun Zhou

As humans, we can modify our assumptions about a scene by imagining alternative objects or concepts in our minds. For example, we can easily anticipate the implications of the sun being overcast by rain clouds (e.g., the street will get…

Computation and Language · Computer Science 2022-07-11 Hyounghun Kim , Abhay Zala , Mohit Bansal

In this paper, we introduce a novel Artificial Intelligence (AI) system inspired by the philosophical and psychoanalytical concept of imagination as a ``Re-construction of Experiences". Our AI system is equipped with an imagination-inspired…