English
Related papers

Related papers: CauSight: Learning to Supersense for Visual Causal…

200 papers

Causal induction, i.e., identifying unobservable mechanisms that lead to the observable relations among variables, has played a pivotal role in modern scientific discovery, especially in scenarios with only sparse and limited data. Humans,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Chi Zhang , Baoxiong Jia , Mark Edmonds , Song-Chun Zhu , Yixin Zhu

Causal discovery is essential for advancing data-driven fields such as scientific AI and data analysis, yet existing approaches face significant time- and space-efficiency bottlenecks when scaling to large graphs. To address this challenge,…

Machine Learning · Computer Science 2026-02-10 Bo Peng , Sirui Chen , Jiaguo Tian , Yu Qiao , Chaochao Lu

Existing 3D scene generation methods often struggle to model the complex logical dependencies and physical constraints between objects, limiting their ability to adapt to dynamic and realistic environments. We propose CausalStruct, a novel…

Graphics · Computer Science 2025-09-22 Shen Chen , Ruiyu Zhao , Jiale Zhou , Zongkai Wu , Jenq-Neng Hwang , Lei Li

Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have transitioned from…

Machine Learning · Computer Science 2022-09-15 Hang Chen , Keqing Du , Xinyu Yang , Chenguang Li

Humans use causality and hypothetical retrospection in their daily decision-making, planning, and understanding of life events. The human mind, while retrospecting a given situation, think about questions such as "What was the cause of the…

Artificial Intelligence · Computer Science 2022-01-12 Utkarshani Jaimini , Amit Sheth

Visual arguments, often used in advertising or social causes, rely on images to persuade viewers to do or believe something. Understanding these arguments requires selective vision: only specific visual stimuli within an image are relevant…

Computation and Language · Computer Science 2024-10-24 Jiwan Chung , Sungjae Lee , Minseo Kim , Seungju Han , Ashkan Yousefpour , Jack Hessel , Youngjae Yu

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

Modern computer vision applications rely on learning-based perception modules parameterized with neural networks for tasks like object detection. These modules frequently have low expected error overall but high error on atypical groups of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Cinjon Resnick , Or Litany , Amlan Kar , Karsten Kreis , James Lucas , Kyunghyun Cho , Sanja Fidler

Machine learning is the science of discovering statistical dependencies in data, and the use of those dependencies to perform predictions. During the last decade, machine learning has made spectacular progress, surpassing human performance…

Machine Learning · Statistics 2016-07-13 David Lopez-Paz

Despite the impressive performance of vision-language models (VLMs) on downstream tasks, their ability to understand and reason about causal relationships in visual inputs remains unclear. Robust causal reasoning is fundamental to solving…

Computation and Language · Computer Science 2026-02-05 Zhaotian Weng , Haoxuan Li , Xin Eric Wang , Kuan-Hao Huang , Jieyu Zhao

Causal discovery is fundamental to scientific understanding and reliable decision-making. Existing approaches face critical limitations: purely data-driven methods suffer from statistical indistinguishability and modeling assumptions, while…

Computation and Language · Computer Science 2026-01-21 Bo Peng , Sirui Chen , Lei Xu , Chaochao Lu

Causal discovery is a difficult problem that typically relies on strong assumptions on the data-generating model, such as non-Gaussianity. In practice, many modern applications provide multiple related views of the same system, which has…

Machine Learning · Computer Science 2025-09-29 Ambroise Heurtebise , Omar Chehab , Pierre Ablin , Alexandre Gramfort , Aapo Hyvärinen

Humans can look at a static scene and instantly predict what happens next -- will moving this object cause a collision? We call this ability Causal Spatial Reasoning. However, current multimodal large language models (MLLMs) cannot do this,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Wenxin Ma , Chenlong Wang , Ruisheng Yuan , Hao Chen , Nanru Dai , S. Kevin Zhou , Yijun Yang , Alan Yuille , Jieneng Chen

Reasoning about temporal causality, particularly irreversible transformations of objects governed by real-world knowledge (e.g., fruit decay and human aging), is a fundamental aspect of human visual understanding. Unlike temporal perception…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Zeqing Wang , Shiyuan Zhang , Chengpei Tang , Keze Wang

Visual understanding requires comprehending complex visual relations between objects within a scene. Here, we seek to characterize the computational demands for abstract visual reasoning. We do this by systematically assessing the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Mohit Vaishnav , Remi Cadene , Andrea Alamia , Drew Linsley , Rufin VanRullen , Thomas Serre

Causal discovery aims at revealing causal relations from observational data, which is a fundamental task in science and engineering. We describe $\textit{causal-learn}$, an open-source Python library for causal discovery. This library…

Machine Learning · Computer Science 2024-04-12 Yujia Zheng , Biwei Huang , Wei Chen , Joseph Ramsey , Mingming Gong , Ruichu Cai , Shohei Shimizu , Peter Spirtes , Kun Zhang

We conducted an exploratory study in virtual reality to examine if people can discover causal relations in a realistic sensorimotor context and how such learning is represented at different processing levels (conscious-cognitive vs.…

Human-Computer Interaction · Computer Science 2026-01-15 Nikolai Bahr , Christoph Zetzsche , Jaime Maldonado , Kerstin Schill

Visual understanding goes well beyond object recognition. With one glance at an image, we can effortlessly imagine the world beyond the pixels: for instance, we can infer people's actions, goals, and mental states. While this task is easy…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Rowan Zellers , Yonatan Bisk , Ali Farhadi , Yejin Choi

Large language model (LLM) agents are increasingly capable of orchestrating complex tasks in low-code environments. However, these agents often exhibit hallucinations and logical inconsistencies because their inherent reasoning mechanisms…

Artificial Intelligence · Computer Science 2025-10-09 Jiexi Xu , Jiaqi Liu , Lanruo Wang , Su Liu

Deep learning has led to tremendous success in computer vision, largely due to Convolutional Neural Networks (CNNs). However, CNNs have been shown to be vulnerable to crafted adversarial perturbations. This vulnerability of adversarial…

Machine Learning · Computer Science 2026-01-21 Hichem Debbi