English
Related papers

Related papers: SAFE: Saliency-Aware Counterfactual Explanations f…

200 papers

Convolutional Neural Networks (CNN) for object detection, lane detection, and segmentation now sit at the head of most autonomy pipelines, and yet, their safety analysis remains an important challenge. Formal analysis of perception models…

Robotics · Computer Science 2023-09-13 Chiao Hsieh , Keyur Joshi , Sasa Misailovic , Sayan Mitra

Generative models aim to learn the distribution of datasets, such as images, so as to be able to generate samples that statistically resemble real data. However, learning the underlying probability distribution can be very challenging and…

Machine Learning · Computer Science 2024-09-20 Zeyang Yu , Shengxi Li , Danilo Mandic

In Autonomous Driving (AD) transparency and safety are paramount, as mistakes are costly. However, neural networks used in AD systems are generally considered black boxes. As a countermeasure, we have methods of explainable AI (XAI), such…

Machine Learning · Computer Science 2024-04-29 Mohamed Roshdi , Julian Petzold , Mostafa Wahby , Hussein Ebrahim , Mladen Berekovic , Heiko Hamann

Deep learning classifiers achieve state-of-the-art performance in various risk detection applications. They explore rich semantic representations and are supposed to automatically discover risk behaviors. However, due to the lack of…

Cryptography and Security · Computer Science 2025-05-15 Yiling He , Jian Lou , Zhan Qin , Kui Ren

Deep learning models in computer vision have made remarkable progress, but their lack of transparency and interpretability remains a challenge. The development of explainable AI can enhance the understanding and performance of these models.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Bismillah Khan , Syed Ali Tariq , Tehseen Zia , Muhammad Ahsan , David Windridge

Explaining the decisions of machine learning models is becoming a necessity in many areas where trust in ML models decision is key to their accreditation/adoption. The ability to explain models decisions also allows to provide diagnosis in…

Machine Learning · Computer Science 2021-06-01 Pierre Blanchart

The recent Control Argumentation Framework (CAF) is a generalization of Dung's Argumentation Framework which handles argumentation dynamics under uncertainty; especially it can be used to model the behavior of an agent which can anticipate…

Artificial Intelligence · Computer Science 2020-09-11 Jean-Guy Mailly

Counterfactual explanations offer an intuitive way to interpret graph neural networks (GNNs) by identifying minimal changes that alter a model's prediction, thereby answering "what must differ for a different outcome?". In this work, we…

Machine Learning · Computer Science 2026-02-09 Yu Zhang , Sean Bin Yang , Arijit Khan , Cuneyt Gurcan Akcora

Configurable systems typically consist of reusable assets that have dependencies between each other. To specify such dependencies, feature models are commonly used. As feature models in practice are often complex, automated reasoning is…

Artificial Intelligence · Computer Science 2025-05-12 Chico Sundermann , Stefan Vill , Elias Kuiter , Sebastian Krieter , Thomas Thüm , Matthias Tichy

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

Counterfactual explanations (CFEs) are a popular approach in explainable artificial intelligence (xAI), highlighting changes to input data necessary for altering a model's output. A CFE can either describe a scenario that is better than the…

Artificial Intelligence · Computer Science 2023-10-26 Ulrike Kuhl , André Artelt , Barbara Hammer

The growing reliance of machine learning models in high-stakes, highly regulated domains such as finance and insurance has created a growing tension between predictive performance, interpretability, and regulatory fairness requirements. In…

Machine Learning · Computer Science 2026-04-30 Panyi Dong , Zhiyu Quan

Counterfactual explanations (CFE) for deep image classifiers aim to reveal how minimal input changes lead to different model decisions, providing critical insights for model interpretation and improvement. However, existing CFE methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Townim Faisal Chowdhury , Vu Minh Hieu Phan , Kewen Liao , Nanyu Dong , Minh-Son To , Anton Hengel , Johan Verjans , Zhibin Liao

Interpretable machine learning and explainable artificial intelligence have become essential in many applications. The trade-off between interpretability and model performance is the traitor to developing intrinsic and model-agnostic…

Machine Learning · Computer Science 2023-09-06 Chiara Balestra , Bin Li , Emmanuel Müller

We tackle the problem of computing counterfactual explanations -- minimal changes to the features that flip an undesirable model prediction. We propose a solution to this question for linear Support Vector Machine (SVMs) models. Moreover,…

Machine Learning · Computer Science 2022-12-16 Sebastian Salazar , Samuel Denton , Ansaf Salleb-Aouissi

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

We introduce a gradient-free framework for identifying minimal, sufficient, and decision-preserving explanations in vision models by isolating the smallest subset of representational units whose joint activation preserves predictions.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Krishna Khadka , Yu Lei , Raghu N. Kacker , D. Richard Kuhn

With their increase in performance, neural network architectures also become more complex, necessitating explainability. Therefore, many new and improved methods are currently emerging, which often generate so-called saliency maps in order…

Machine Learning · Computer Science 2024-12-24 Leonid Schwenke , Martin Atzmueller

Counterfactual Explanations (CFEs) have grown in popularity as a means of offering actionable guidance by identifying the minimum changes in feature values required to flip an ML model's prediction to something more desirable.…

Machine Learning · Computer Science 2026-03-31 Firdaus Ahmed Choudhury , Ethan Leicht , Jude Ethan Bislig , Hangzhi Guo , Amulya Yadav

Counterfactual examples (CFs) are one of the most popular methods for attaching post-hoc explanations to machine learning (ML) models. However, existing CF generation methods either exploit the internals of specific models or depend on each…

Machine Learning · Computer Science 2023-08-10 Ziheng Chen , Fabrizio Silvestri , Jia Wang , He Zhu , Hongshik Ahn , Gabriele Tolomei