English
Related papers

Related papers: Interpreting Low-level Vision Models with Causal E…

200 papers

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

Causal reasoning is fundamental to human intelligence and crucial for effective decision-making in real-world environments. Despite recent advancements in large vision-language models (LVLMs), their ability to comprehend causality remains…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Meiqi Chen , Bo Peng , Yan Zhang , Chaochao Lu

With the rise of Large Language Models(LLMs), it has become crucial to understand their capabilities and limitations in deciphering and explaining the complex web of causal relationships that language entails. Current methods use either…

We present a domain-general account of causation that applies to settings in which macro-level causal relations between two systems are of interest, but the relevant causal features are poorly understood and have to be aggregated from vast…

Machine Learning · Statistics 2015-12-29 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister

One of the central elements of any causal inference is an object called structural causal model (SCM), which represents a collection of mechanisms and exogenous sources of random variation of the system under investigation (Pearl, 2000). An…

Machine Learning · Computer Science 2022-10-05 Kevin Xia , Kai-Zhan Lee , Yoshua Bengio , Elias Bareinboim

Decisions made by convolutional neural networks(CNN) can be understood and explained by visualizing discriminative regions on images. To this end, Class Activation Map (CAM) based methods were proposed as powerful interpretation tools,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yi Liao , Yongsheng Gao , Weichuan Zhang

Deep Neural Networks (DNNs) are widely used for visual classification tasks, but their complex computation process and black-box nature hinder decision transparency and interpretability. Class activation maps (CAMs) and recent variants…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Townim Faisal Chowdhury , Kewen Liao , Vu Minh Hieu Phan , Minh-Son To , Yutong Xie , Kevin Hung , David Ross , Anton van den Hengel , Johan W. Verjans , Zhibin Liao

Context-Aware Emotion Recognition (CAER) is a crucial and challenging task that aims to perceive the emotional states of the target person with contextual information. Recent approaches invariably focus on designing sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dingkang Yang , Zhaoyu Chen , Yuzheng Wang , Shunli Wang , Mingcheng Li , Siao Liu , Xiao Zhao , Shuai Huang , Zhiyan Dong , Peng Zhai , Lihua Zhang

Convolutional Neural Networks (CNNs) have been used extensively for computer vision tasks and produce rich feature representation for objects or parts of an image. But reasoning about scenes requires integration between the low-level…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Syed Ashar Javed , Anil Kumar Nelakanti

Mechanistic interpretability aims to reverse engineer neural networks by uncovering which high-level algorithms they implement. Causal abstraction provides a precise notion of when a network implements an algorithm, i.e., a causal model of…

Machine Learning · Computer Science 2025-03-17 Theodora-Mara Pîslar , Sara Magliacane , Atticus Geiger

Causality can be described in terms of a structural causal model (SCM) that carries information on the variables of interest and their mechanistic relations. For most processes of interest the underlying SCM will only be partially…

Machine Learning · Computer Science 2021-10-26 Matej Zečević , Devendra Singh Dhami , Petar Veličković , Kristian Kersting

A number of methods have been proposed for causal effect estimation, yet few have demonstrated efficacy in handling data with complex structures, such as images. To fill this gap, we propose Causal Multi-task Deep Ensemble (CMDE), a novel…

Machine Learning · Computer Science 2023-05-30 Ziyang Jiang , Zhuoran Hou , Yiling Liu , Yiman Ren , Keyu Li , David Carlson

The problem of explaining the results produced by machine learning methods continues to attract attention. Neural network (NN) models, along with gradient boosting machines, are expected to be utilized even in tabular data with high…

Machine Learning · Computer Science 2025-12-29 Takashi Isozaki , Masahiro Yamamoto , Atsushi Noda

Causal inference has gained much popularity in recent years, with interests ranging from academic, to industrial, to educational, and all in between. Concurrently, the study and usage of neural networks has also grown profoundly (albeit at…

Machine Learning · Statistics 2024-05-07 Demetrios Papakostas , Andrew Herren , P. Richard Hahn , Francisco Castillo

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

Although deep learning models have been successfully applied to a variety of tasks, due to the millions of parameters, they are becoming increasingly opaque and complex. In order to establish trust for their widespread commercial use, it is…

Machine Learning · Computer Science 2018-11-13 Tanmayee Narendra , Anush Sankaran , Deepak Vijaykeerthy , Senthil Mani

Causal structure learning with data from multiple contexts carries both opportunities and challenges. Opportunities arise from considering shared and context-specific causal graphs enabling to generalize and transfer causal knowledge across…

Machine Learning · Computer Science 2024-10-29 Martin Rabel , Wiebke Günther , Jakob Runge , Andreas Gerhardus

Causal inference is capable of estimating the treatment effect (i.e., the causal effect of treatment on the outcome) to benefit the decision making in various domains. One fundamental challenge in this research is that the treatment…

Machine Learning · Computer Science 2021-12-28 Qian Li , Zhichao Wang , Shaowu Liu , Gang Li , Guandong Xu

We consider the problem of visually explaining similarity models, i.e., explaining why a model predicts two images to be similar in addition to producing a scalar score. While much recent work in visual model interpretability has focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu