English
Related papers

Related papers: DeCoDEx: Confounder Detector Guidance for Improved…

200 papers

Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Understanding and explaining the behavior of machine learning models is essential for building transparent and trustworthy AI systems. We introduce DEXTER, a data-free framework that employs diffusion models and large language models to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Simone Carnemolla , Matteo Pennisi , Sarinda Samarasinghe , Giovanni Bellitto , Simone Palazzo , Daniela Giordano , Mubarak Shah , Concetto Spampinato

Recent advances in diffusion models have spurred research into their application for Reconstruction-based unsupervised anomaly detection. However, these methods may struggle with maintaining structural integrity and recovering the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Farzad Beizaee , Gregory A. Lodygensky , Christian Desrosiers , Jose Dolz

Counterfactual explanations and adversarial attacks have a related goal: flipping output labels with minimal perturbations regardless of their characteristics. Yet, adversarial attacks cannot be used directly in a counterfactual explanation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Deep neural networks do not discriminate between spurious and causal patterns, and will only learn the most predictive ones while ignoring the others. This shortcut learning behaviour is detrimental to a network's ability to generalize to…

Machine Learning · Computer Science 2023-01-11 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

Machine learning models that operate on graph-structured data, such as molecular graphs or social networks, often make accurate predictions but offer little insight into why certain predictions are made. Counterfactual explanations address…

Machine Learning · Computer Science 2025-11-21 David Bechtoldt , Sidney Bender

Accurate estimation of counterfactual outcomes in high-dimensional data is crucial for decision-making and understanding causal relationships and intervention outcomes in various domains, including healthcare, economics, and social…

Machine Learning · Computer Science 2024-07-31 Jiageng Zhu , Hanchen Xie , Jiazhi Li , Wael Abd-Almageed

We introduce DeCaFlow, a deconfounding causal generative model. Training once per dataset using just observational data and the underlying causal graph, DeCaFlow enables accurate causal inference on continuous variables under the presence…

Machine Learning · Computer Science 2025-10-27 Alejandro Almodóvar , Adrián Javaloy , Juan Parras , Santiago Zazo , Isabel Valera

Counterfactual explanations have emerged as a promising method for elucidating the behavior of opaque black-box models. Recently, several works leveraged pixel-space diffusion models for counterfactual generation. To handle noisy,…

Machine Learning · Computer Science 2023-10-11 Karim Farid , Simon Schrodi , Max Argus , Thomas Brox

As black-box AI-driven decision-making systems become increasingly widespread in modern document processing workflows, improving their transparency and reliability has become critical, especially in high-stakes applications where biases or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Machine learning algorithms generally suffer from a problem of explainability. Given a classification result from a model, it is typically hard to determine what caused the decision to be made, and to give an informative explanation. We…

Machine Learning · Computer Science 2019-06-26 Jonathan Moore , Nils Hammerla , Chris Watkins

Causal inference on time series data is a challenging problem, especially in the presence of unobserved confounders. This work focuses on estimating the causal effect between two time series that are confounded by a third, unobserved time…

Machine Learning · Statistics 2024-11-19 Felix Schur , Jonas Peters

Diffusion models are a new class of generative models, and have dramatically promoted image generation with unprecedented quality and diversity. Existing diffusion models mainly try to reconstruct input image from a corrupted one with a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Jingwei Liu , Shenda Hong , Zhilong Zhang , Zhilin Huang , Zheming Cai , Wentao Zhang , Bin Cui

We present DiffExplainer, a novel framework that, leveraging language-vision models, enables multimodal global explainability. DiffExplainer employs diffusion models conditioned on optimized text prompts, synthesizing images that maximize…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Matteo Pennisi , Giovanni Bellitto , Simone Palazzo , Mubarak Shah , Concetto Spampinato

Traditional recommender systems aim to estimate a user's rating to an item based on observed ratings from the population. As with all observational studies, hidden confounders, which are factors that affect both item exposures and user…

Machine Learning · Computer Science 2022-11-22 Yaochen Zhu , Jing Yi , Jiayi Xie , Zhenzhong Chen

As deep learning models are increasingly used in safety-critical applications, explainability and trustworthiness become major concerns. For simple images, such as low-resolution face portraits, synthesizing visual counterfactual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Paul Jacob , Éloi Zablocki , Hédi Ben-Younes , Mickaël Chen , Patrick Pérez , Matthieu Cord

Discerning between authentic content and that generated by advanced AI methods has become increasingly challenging. While previous research primarily addresses the detection of fake faces, the identification of generated natural images has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Lorenzo Baraldi , Federico Cocchi , Marcella Cornia , Lorenzo Baraldi , Alessandro Nicolosi , Rita Cucchiara

Interpreting a large number of neurons in deep learning is difficult. Our proposed `CLAssifier-DECoder' architecture (ClaDec) facilitates the understanding of the output of an arbitrary layer of neurons or subsets thereof. It uses a decoder…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Johannes Schneider , Michail Vlachos

Foundation models, despite their robust zero-shot capabilities, remain vulnerable to spurious correlations and 'Clever Hans' strategies. Existing mitigation methods often rely on unavailable group labels or computationally expensive…

Machine Learning · Computer Science 2026-05-07 Sidney Bender , Marco Morik

Explanation techniques that synthesize small, interpretable changes to a given image while producing desired changes in the model prediction have become popular for introspecting black-box models. Commonly referred to as counterfactuals,…

Machine Learning · Computer Science 2021-10-06 Jayaraman J. Thiagarajan , Vivek Narayanaswamy , Deepta Rajan , Jason Liang , Akshay Chaudhari , Andreas Spanias