English
Related papers

Related papers: Towards Causal Physical Error Discovery in Video A…

200 papers

Deep neural perception and control networks have become key components of self-driving vehicles. User acceptance is likely to benefit from easy-to-interpret textual explanations which allow end-users to understand what triggered a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Jinkyu Kim , Anna Rohrbach , Trevor Darrell , John Canny , Zeynep Akata

Temporal prediction is inherently uncertain, but representing the ambiguity in natural image sequences is a challenging high-dimensional probabilistic inference problem. For natural scenes, the curse of dimensionality renders explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Pierre-Étienne H. Fiquet , Eero P. Simoncelli

We address causal reasoning in multivariate time series data generated by stochastic processes. Existing approaches are largely restricted to static settings, ignoring the continuity and emission of variations across time. In contrast, we…

Machine Learning · Computer Science 2024-02-29 Mehdi Fatemi , Sindhu Gowda

Explainable recommendation systems leverage transparent reasoning to foster user trust and improve decision-making processes. Current approaches typically decouple recommendation generation from explanation creation, violating causal…

Artificial Intelligence · Computer Science 2025-03-12 Guanrong Li , Haolin Yang , Xinyu Liu , Zhen Wu , Xinyu Dai

Causality knowledge is crucial for many artificial intelligence systems. Conventional textual-based causality knowledge acquisition methods typically require laborious and expensive human annotations. As a result, their scale is often…

Artificial Intelligence · Computer Science 2020-12-15 Hongming Zhang , Yintong Huo , Xinran Zhao , Yangqiu Song , Dan Roth

Concept-based explanation approach is a popular model interpertability tool because it expresses the reasons for a model's predictions in terms of concepts that are meaningful for the domain experts. In this work, we study the problem of…

Machine Learning · Computer Science 2021-05-25 Mohammad Taha Bahadori , David E. Heckerman

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

This work shows how to leverage causal inference to understand the behavior of complex learning systems interacting with their environment and predict the consequences of changes to the system. Such predictions allow both humans and…

Predictive Process Analytics is becoming an essential aid for organizations, providing online operational support of their processes. However, process stakeholders need to be provided with an explanation of the reasons why a given process…

Inferring the effect of interventions within complex systems is a fundamental problem of statistics. A widely studied approach employs structural causal models that postulate noisy functional relations among a set of interacting variables.…

Methodology · Statistics 2024-02-14 David Strieder , Mathias Drton

Background: Symbolic models, particularly decision trees, are widely used in software engineering for explainable analytics in defect prediction, configuration tuning, and software quality assessment. Most of these models rely on…

Software Engineering · Computer Science 2026-02-19 Amirali Rayegan , Tim Menzies

The paper reviews methods that seek to draw causal inference from observational data and demonstrates how they can be applied to empirical problems in engineering research. It presents a framework for causal identification based on the…

Applications · Statistics 2022-11-28 Daniel J Graham

This paper describes the development of a causal diagnosis approach for troubleshooting an industrial environment on the basis of the technical language expressed in Return on Experience records. The proposed method leverages the vectorized…

Artificial Intelligence · Computer Science 2024-07-31 Alexandre Trilla , Ossee Yiboe , Nenad Mijatovic , Jordi Vitrià

Medical image analysis is a vibrant research area that offers doctors and medical practitioners invaluable insight and the ability to accurately diagnose and monitor disease. Machine learning provides an additional boost for this area.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Athanasios Vlontzos , Daniel Rueckert , Bernhard Kainz

Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Jingze Wu , Quan Zhang , Hongfei Suo , Zeqiang Cai , Hongbo Chen

Generating explanations for reinforcement learning (RL) is challenging as actions may produce long-term effects on the future. In this paper, we develop a novel framework for explainable RL by learning a causal world model without prior…

Machine Learning · Computer Science 2024-01-19 Zhongwei Yu , Jingqing Ruan , Dengpeng Xing

Software engineering increasingly involves making high-stakes decisions under uncertainty, using signals from code, field data, and socio-technical processes. Recent AI-driven support (e.g., anomaly detection, predictive analytics, AIOps,…

Software Engineering · Computer Science 2026-05-05 Roberto Pietrantuono , Luca Giamattei , Stefano Russo , Julien Siebert , Neil Walkinshaw

In this paper, we propose a Disentangled Counterfactual Learning~(DCL) approach for physical audiovisual commonsense reasoning. The task aims to infer objects' physics commonsense based on both video and audio input, with the main challenge…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Changsheng Lv , Shuai Zhang , Yapeng Tian , Mengshi Qi , Huadong Ma

Computer vision has undergone a dramatic revolution in performance, driven in large part through deep features trained on large-scale supervised datasets. However, much of these improvements have focused on static image analysis; video…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rohit Girdhar , Deva Ramanan

Learning causal relationships in high-dimensional data (images, videos) is a hard task, as they are often defined on low dimensional manifolds and must be extracted from complex signals dominated by appearance, lighting, textures and also…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Steeven Janny , Fabien Baradel , Natalia Neverova , Madiha Nadri , Greg Mori , Christian Wolf