English
Related papers

Related papers: CauSight: Learning to Supersense for Visual Causal…

200 papers

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

With the advancement of data science, the collection of increasingly complex datasets has become commonplace. In such datasets, the data dimension can be extremely high, and the underlying data generation process can be unknown and highly…

Machine Learning · Statistics 2024-03-29 Yaxin Fang , Faming Liang

Causal questions inquire about causal relationships between different events or phenomena. They are important for a variety of use cases, including virtual assistants and search engines. However, many current approaches to causal question…

Artificial Intelligence · Computer Science 2024-03-26 Lukas Blübaum , Stefan Heindorf

Learning causality from observational data has received increasing interest across various scientific fields. However, most existing methods assume the absence of latent confounders and restrict the underlying causal graph to be acyclic,…

Methodology · Statistics 2025-11-18 Wei Jin , Lang Lang , Amanda B. Spence , Leah H. Rubin , Yanxun Xu

After a decade of prosperity, the development of video understanding has reached a critical juncture, where the sole reliance on massive data and complex architectures is no longer a one-size-fits-all solution to all situations. The…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Li Yicong

Computer vision has undergone a dramatic revolution in performance, driven in large part through deep features trained on large-scale supervised datasets. However, much of these improvements have focused on static image analysis; video…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rohit Girdhar , Deva Ramanan

We present Causal Generative Neural Networks (CGNNs) to learn functional causal models from observational data. CGNNs leverage conditional independencies and distributional asymmetries to discover bivariate and multivariate causal…

A major challenge in research involving artificial intelligence (AI) is the development of algorithms that can find solutions to problems that can generalize to different environments and tasks. Unlike AI, humans are adept at finding…

Artificial Intelligence · Computer Science 2021-10-12 Semir Tatlidil , Yanqi Liu , Emily Sheetz , R. Iris Bahar , Steven Sloman

Causal discovery problems use a set of observations to deduce causality between variables in the real world, typically to answer questions about biological or physical systems. These observations are often recorded at regular time…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Kurt Butler , Damian Machlanski , Panagiotis Dimitrakopoulos , Sotirios A. Tsaftaris

A vexing problem in artificial intelligence is reasoning about events that occur in complex, changing visual stimuli such as in video analysis or game play. Inspired by a rich tradition of visual reasoning and memory in cognitive psychology…

Artificial Intelligence · Computer Science 2018-07-23 Guangyu Robert Yang , Igor Ganichev , Xiao-Jing Wang , Jonathon Shlens , David Sussillo

Identifiable causal representation learning seeks to uncover the true causal relationships underlying a data generation process. In medical imaging, this presents opportunities to improve the generalisability and robustness of task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Rajat Rasal , Avinash Kori , Ben Glocker

Video causal reasoning aims to achieve a high-level understanding of videos from a causal perspective. However, it exhibits limitations in its scope, primarily executed in a question-answering paradigm and focusing on brief video segments…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Tieyuan Chen , Huabin Liu , Yi Wang , Yihang Chen , Tianyao He , Chaofan Gan , Huanyu He , Weiyao Lin

Latent visual reasoning aims to mimic human's imagination process by meditating through hidden states of Multimodal Large Language Models. While recognized as a promising paradigm for visual reasoning, the underlying mechanisms driving its…

Computation and Language · Computer Science 2026-02-27 You Li , Chi Chen , Yanghao Li , Fanhu Zeng , Kaiyu Huang , Jinan Xu , Maosong Sun

The ability to perform causal and counterfactual reasoning are central properties of human intelligence. Decision-making systems that can perform these types of reasoning have the potential to be more generalizable and interpretable.…

Artificial Intelligence · Computer Science 2021-06-28 Daniel McDuff , Yale Song , Jiyoung Lee , Vibhav Vineet , Sai Vemprala , Nicholas Gyde , Hadi Salman , Shuang Ma , Kwanghoon Sohn , Ashish Kapoor

Video analytics systems based on deep learning models are often opaque and brittle and require explanation systems to help users debug. Current model explanation system are very good at giving literal explanations of behavior in terms of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Jinjin Zhao , Ted Shaowang , Stavos Sintos , Sanjay Krishnan

Video understanding has achieved great success in representation learning, such as video caption, video object grounding, and video descriptive question-answer. However, current methods still struggle on video reasoning, including evidence…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jiangtong Li , Li Niu , Liqing Zhang

With the rise of Large Language Models(LLMs), it has become crucial to understand their capabilities and limitations in deciphering and explaining the complex web of causal relationships that language entails. Current methods use either…

Findings in recent years on the sensitivity of convolutional neural networks to additive noise, light conditions and to the wholeness of the training dataset, indicate that this technology still lacks the robustness needed for the…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Dan Malowany , Hugo Guterman

When building artificial intelligence systems that can reason and answer questions about visual data, we need diagnostic tests to analyze our progress and discover shortcomings. Existing benchmarks for visual question answering can help,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-22 Justin Johnson , Bharath Hariharan , Laurens van der Maaten , Li Fei-Fei , C. Lawrence Zitnick , Ross Girshick

Causality helps people reason about and understand complex systems, particularly through what-if analyses that explore how interventions might alter outcomes. Although existing methods embrace causal reasoning using interventions and…

Human-Computer Interaction · Computer Science 2025-07-22 Yanming Zhang , Krishnakumar Hegde , Klaus Mueller