English
Related papers

Related papers: Probing Physical Reasoning with Counter-Commonsens…

200 papers

We present DiscoSense, a benchmark for commonsense reasoning via understanding a wide variety of discourse connectives. We generate compelling distractors in DiscoSense using Conditional Adversarial Filtering, an extension of Adversarial…

Computation and Language · Computer Science 2022-10-25 Prajjwal Bhargava , Vincent Ng

Plausibility Estimation (PE) plays a crucial role for enabling language models to objectively comprehend the real world. While large language models (LLMs) demonstrate remarkable capabilities in PE tasks but sometimes produce trivial…

Computation and Language · Computer Science 2024-12-31 Chong Liu , Zaiwen Feng , Lin Liu , Zhenyun Deng , Jiuyong Li , Ruifang Zhai , Debo Cheng , Li Qin

Commonsense norms are defeasible by context: reading books is usually great, but not when driving a car. While contexts can be explicitly described in language, in embodied scenarios, contexts are often provided visually. This type of…

Machine Learning · Computer Science 2023-11-14 Seungju Han , Junhyeok Kim , Jack Hessel , Liwei Jiang , Jiwan Chung , Yejin Son , Yejin Choi , Youngjae Yu

We study the role of linguistic context in predicting quantifiers (`few', `all'). We collect crowdsourced data from human participants and test various models in a local (single-sentence) and a global context (multi-sentence) condition.…

Computation and Language · Computer Science 2018-06-04 Sandro Pezzelle , Shane Steinert-Threlkeld , Raffaela Bernardi , Jakub Szymanik

Learning commonsense knowledge from natural language text is nontrivial due to reporting bias: people rarely state the obvious, e.g., "My house is bigger than me." However, while rarely stated explicitly, this trivial everyday knowledge…

Computation and Language · Computer Science 2017-07-14 Maxwell Forbes , Yejin Choi

Large language models (LLMs) have mastered abundant simple and explicit commonsense knowledge through pre-training, enabling them to achieve human-like performance in simple commonsense reasoning. Nevertheless, LLMs struggle to reason with…

Computation and Language · Computer Science 2025-06-10 Kai Xiong , Xiao Ding , Yixin Cao , Yuxiong Yan , Li Du , Yufei Zhang , Jinglong Gao , Jiaqian Liu , Bing Qin , Ting Liu

The possible consequences for the same context may vary depending on the situation we refer to. However, current studies in natural language processing do not focus on situated commonsense reasoning under multiple possible scenarios. This…

Computation and Language · Computer Science 2022-09-19 Mana Ashida , Saku Sugawara

Large language models have demonstrated strong capabilities to learn in-context, where exemplar input-output pairings are appended to the prompt for demonstration. However, existing work has demonstrated the ability of models to learn…

Computation and Language · Computer Science 2025-02-11 Stephanie Schoch , Yangfeng Ji

Deep learning models perform poorly on tasks that require commonsense reasoning, which often necessitates some form of world-knowledge or reasoning over information not immediately present in the input. We collect human explanations for…

Computation and Language · Computer Science 2019-06-07 Nazneen Fatema Rajani , Bryan McCann , Caiming Xiong , Richard Socher

In this study, we explore the sophisticated domain of task planning for robust household embodied agents, with a particular emphasis on the intricate task of selecting substitute objects. We introduce the CommonSense Object Affordance Task…

Artificial Intelligence · Computer Science 2024-10-24 Ayush Agrawal , Raghav Prabhakar , Anirudh Goyal , Dianbo Liu

How do language models use contextual information to answer health questions? How are their responses impacted by conflicting contexts? We assess the ability of language models to reason over long, conflicting biomedical contexts using…

Computation and Language · Computer Science 2025-12-03 Boya Zhang , Alban Bornet , Rui Yang , Nan Liu , Douglas Teodoro

Understanding interpersonal communication requires, in part, understanding the social context and norms in which a message is said. However, current methods for identifying offensive content in such communication largely operate independent…

Computation and Language · Computer Science 2023-07-07 David Jurgens , Agrima Seth , Jackson Sargent , Athena Aghighi , Michael Geraci

Exploiting relationships among objects has achieved remarkable progress in interpreting images or videos by natural language. Most existing methods resort to first detecting objects and their relationships, and then generating textual…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Jingyi Hou , Xinxiao Wu , Yayun Qi , Wentian Zhao , Jiebo Luo , Yunde Jia

Spatial commonsense, the knowledge about spatial position and relationship between objects (like the relative size of a lion and a girl, and the position of a boy relative to a bicycle when cycling), is an important part of commonsense…

Computation and Language · Computer Science 2022-04-28 Xiao Liu , Da Yin , Yansong Feng , Dongyan Zhao

Commonsense knowledge is essential for many AI applications, including those in natural language processing, visual processing, and planning. Consequently, many sources that include commonsense knowledge have been designed and constructed…

Artificial Intelligence · Computer Science 2021-07-30 Filip Ilievski , Alessandro Oltramari , Kaixin Ma , Bin Zhang , Deborah L. McGuinness , Pedro Szekely

As humans, we can modify our assumptions about a scene by imagining alternative objects or concepts in our minds. For example, we can easily anticipate the implications of the sun being overcast by rain clouds (e.g., the street will get…

Computation and Language · Computer Science 2022-07-11 Hyounghun Kim , Abhay Zala , Mohit Bansal

Large language models are able to learn new tasks in context, where they are provided with instructions and a few annotated examples. However, the effectiveness of in-context learning is dependent on the provided context, and the…

Computation and Language · Computer Science 2023-12-25 Afra Amini , Massimiliano Ciaramita

Over the past few years, the abilities of large language models (LLMs) have received extensive attention, which have performed exceptionally well in complicated scenarios such as logical reasoning and symbolic inference. A significant…

Computation and Language · Computer Science 2024-02-20 Junbing Yan , Chengyu Wang , Jun Huang , Wei Zhang

Embodied language comprehension emphasizes that language understanding is not solely a matter of mental processing in the brain but also involves interactions with the physical and social environment. With the explosive growth of Large…

Computation and Language · Computer Science 2023-10-23 Chang Shu , Jiuzhou Han , Fangyu Liu , Ehsan Shareghi , Nigel Collier

Large Language Models (LLMs) are increasingly deployed across diverse real-world applications and user communities. As such, it is crucial that these models remain both morally grounded and knowledge-aware. In this work, we uncover a…

Computation and Language · Computer Science 2026-03-11 Saugata Purkayastha , Pranav Kushare , Pragya Paramita Pal , Sukannya Purkayastha