English
Related papers

Related papers: Optimizing Explanations by Network Canonization an…

200 papers

The advancement of machine learning (ML) models has led to the development of ML-based approaches to improve numerous software engineering tasks in software maintenance and evolution. Nevertheless, research indicates that despite their…

Software Engineering · Computer Science 2024-07-22 Md Abdul Awal , Chanchal K. Roy

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

Explainable Artificial Intelligence (XAI) aims to provide transparent insights into machine learning models, yet the reliability of many feature attribution methods remains a critical challenge. Prior research (Haufe et al., 2014; Wilming…

Machine Learning · Computer Science 2026-02-11 Benedict Clark , Stoyan Karastoyanov , Rick Wilming , Stefan Haufe

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Canonicalization is a widely used strategy in equivariant machine learning, enforcing symmetry in neural networks by mapping each input to a standard form. Yet, it often introduces discontinuities that can affect stability during training,…

Machine Learning · Computer Science 2026-04-17 Ya-Wei Eileen Lin , Ron Levie

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

The field of Explainable AI (XAI) offers a wide range of techniques for making complex models interpretable. Yet, in practice, generating meaningful explanations is a context-dependent task that requires intentional design choices to ensure…

Computers and Society · Computer Science 2025-08-14 Ruchira Dhar , Stephanie Brandl , Ninell Oldenburg , Anders Søgaard

In recent years, Explainable AI (XAI) methods have facilitated profound validation and knowledge extraction from ML models. While extensively studied for classification, few XAI solutions have addressed the challenges specific to regression…

Machine Learning · Computer Science 2025-07-21 Simon Letzgus , Klaus-Robert Müller , Grégoire Montavon

The demand for Explainable AI (XAI) has triggered an explosion of methods, producing a landscape so fragmented that we now rely on surveys of surveys. Yet, fundamental challenges persist: conflicting metrics, failed sanity checks, and…

Machine Learning · Computer Science 2026-03-31 Amir-Hossein Karimi

Equivariant networks are specifically designed to ensure consistent behavior with respect to a set of input transformations, leading to higher sample efficiency and more accurate and robust predictions. However, redesigning each component…

Machine Learning · Computer Science 2023-10-31 Arnab Kumar Mondal , Siba Smarak Panigrahi , Sékou-Oumar Kaba , Sai Rajeswar , Siamak Ravanbakhsh

Explanation methods and their evaluation have become a significant issue in explainable artificial intelligence (XAI) due to the recent surge of opaque AI models in decision support systems (DSS). Since the most accurate AI models are…

Artificial Intelligence · Computer Science 2023-08-30 Helena Löfström , Karl Hammar , Ulf Johansson

This work introduces a novel approach to achieving architecture-agnostic equivariance in deep learning, particularly addressing the limitations of traditional layerwise equivariant architectures and the inefficiencies of the existing…

Machine Learning · Computer Science 2024-11-18 Siba Smarak Panigrahi , Arnab Kumar Mondal

Understanding the reasoning behind deep learning model predictions is crucial in cheminformatics and drug discovery, where molecular design determines their properties. However, current evaluation frameworks for Explainable AI (XAI) in this…

Machine Learning · Computer Science 2025-05-29 Magdalena Proszewska , Tomasz Danel , Dawid Rymarczyk

The complexity and opacity of neural networks (NNs) pose significant challenges, particularly in high-stakes fields such as healthcare, finance, and law, where understanding decision-making processes is crucial. To address these issues, the…

Machine Learning · Computer Science 2025-11-13 Helena Monke , Benjamin Sae-Chew , Benjamin Fresz , Marco F. Huber

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

Artificial Intelligence · Computer Science 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

The lack of interpretability is a major barrier that limits the practical usage of AI models. Several eXplainable AI (XAI) techniques (e.g., SHAP, LIME) have been employed to interpret these models' performance. However, users often face…

Software Engineering · Computer Science 2025-04-21 Saumendu Roy , Saikat Mondal , Banani Roy , Chanchal Roy

In recent years, AI systems in the medical domain have advanced significantly. However, despite outperforming humans, they are rarely used in practice since it is often not clear how they make their decisions. Optimal explanation and…

Human-Computer Interaction · Computer Science 2026-05-06 Julia Wagner , Tim Schlippe

Explainable AI (XAI) has revolutionized the field of deep learning by empowering users to have more trust in neural network models. The field of XAI allows users to probe the inner workings of these algorithms to elucidate their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Prithwijit Chowdhury , Mohit Prabhushankar , Ghassan AlRegib , Mohamed Deriche

The field of explainable artificial intelligence (XAI) aims to explain how black-box machine learning models work. Much of the work centers around the holy grail of providing post-hoc feature attributions to any model architecture. While…

Machine Learning · Computer Science 2023-11-15 Brian Barr , Noah Fatsi , Leif Hancox-Li , Peter Richter , Daniel Proano , Caleb Mok

Artificial intelligence now outperforms humans in several scientific and engineering tasks, yet its internal representations often remain opaque. In this Perspective, we argue that explainable artificial intelligence (XAI), combined with…

Artificial Intelligence · Computer Science 2026-02-17 Ricardo Vinuesa , Steven L. Brunton , Gianmarco Mengaldo