English
Related papers

Related papers: Using Causal Analysis for Conceptual Deep Learning…

200 papers

Deep learning models achieve high predictive performance but lack intrinsic interpretability, hindering our understanding of the learned prediction behavior. Existing local explainability methods focus on associations, neglecting the causal…

Machine Learning · Computer Science 2025-09-18 Niklas Penzel , Joachim Denzler

Interpreting the decisions of deep image classifiers remains challenging, particularly in black-box settings where model internals are inaccessible. We introduce OCCAM, a framework for open-set causal concept explanation and ontology…

Artificial Intelligence · Computer Science 2026-05-19 Chiara Maria Russo , Simone Carnemolla , Simone Palazzo , Daniela Giordano , Concetto Spampinato , Matteo Pennisi

Machine learning algorithms generally suffer from a problem of explainability. Given a classification result from a model, it is typically hard to determine what caused the decision to be made, and to give an informative explanation. We…

Machine Learning · Computer Science 2019-06-26 Jonathan Moore , Nils Hammerla , Chris Watkins

Causal reasoning is essential for business process interventions and improvement, requiring a clear understanding of causal relationships among activity execution times in an event log. Recent work introduced a method for discovering causal…

Artificial Intelligence · Computer Science 2025-05-30 Yuval David , Fabiana Fournier , Lior Limonad , Inna Skarbovsky

Causal representation learning seeks to uncover causal relationships among high-level latent variables from low-level, entangled, and noisy observations. Existing approaches often either rely on deep neural networks, which lack…

Methodology · Statistics 2026-03-27 Wenjin Zhang , Yixin Wang , Yuqi Gu

*Concept-based explanations* offer a promising approach for explaining the predictions of deep neural networks in terms of high-level, human-understandable concepts. However, existing methods either do not establish a causal connection…

Machine Learning · Computer Science 2026-05-08 Ronaldo Canizales , Divya Gopinath , Corina Păsăreanu , Ravi Mangal

The black-box nature of deep learning models prevents them from being completely trusted in domains like biomedicine. Most explainability techniques do not capture the concept-based reasoning that human beings follow. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Avinash Kori , Parth Natekar , Ganapathy Krishnamurthi , Balaji Srinivasan

Recent developments in generative artificial intelligence (AI) rely on machine learning techniques such as deep learning and generative modeling to achieve state-of-the-art performance across wide-ranging domains. These methods' surprising…

Machine Learning · Statistics 2026-01-27 Gemma E. Moran , Bryon Aragam

Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them…

Machine Learning · Computer Science 2023-10-18 Thomas Decker , Michael Lebacher , Volker Tresp

Explaining the decisions of Deep Neural Networks (DNNs) for medical images has become increasingly important. Existing attribution methods have difficulty explaining the meaning of pixels while existing concept-based methods are limited by…

Artificial Intelligence · Computer Science 2024-08-20 Weiji Kong , Xun Gong , Juan Wang

Interpretability and explainability of deep neural networks are challenging due to their scale, complexity, and the agreeable notions on which the explaining process rests. Previous work, in particular, has focused on representing internal…

Computation and Language · Computer Science 2020-11-09 Quan Tran , Nhan Dam , Tuan Lai , Franck Dernoncourt , Trung Le , Nham Le , Dinh Phung

Causality knowledge is vital to building robust AI systems. Deep learning models often perform poorly on tasks that require causal reasoning, which is often derived using some form of commonsense knowledge not immediately available in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Aman Chadha , Vinija Jain

Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a…

Machine Learning · Computer Science 2016-08-10 Marco Tulio Ribeiro , Sameer Singh , Carlos Guestrin

Objective: The growing availability of large-scale observational clinical datasets and challenges in conducting randomized controlled trials have spurred enthusiasm in using causal machine learning (ML) for causal inference in observational…

Concept-based explanations translate the internal representations of deep learning models into a language that humans are familiar with: concepts. One popular method for finding concepts is Concept Activation Vectors (CAVs), which are…

Machine Learning · Computer Science 2025-02-14 Angus Nicolson , Lisa Schut , J. Alison Noble , Yarin Gal

Accurate and interpretable diagnostic models are crucial in the safety-critical field of medicine. We investigate the interpretability of our proposed biomarker-based lung ultrasound diagnostic pipeline to enhance clinicians' diagnostic…

Explainable AI aims to overcome the black-box nature of complex ML models like neural networks by generating explanations for their predictions. Explanations often take the form of a heatmap identifying input features (e.g. pixels) that are…

Machine Learning · Computer Science 2024-04-16 Pattarawat Chormai , Jan Herrmann , Klaus-Robert Müller , Grégoire Montavon

The concept of causal abstraction got recently popularised to demystify the opaque decision-making processes of machine learning models; in short, a neural network can be abstracted as a higher-level algorithm if there exists a function…

Machine Learning · Computer Science 2025-11-13 Denis Sutter , Julian Minder , Thomas Hofmann , Tiago Pimentel

Explainability of a classification model is crucial when deployed in real-world decision support systems. Explanations make predictions actionable to the user and should inform about the capabilities and limitations of the system. Existing…

Machine Learning · Computer Science 2022-12-13 Erwin Walraven , Ajaya Adhikari , Cor J. Veenman