English
Related papers

Related papers: Meta-evaluating stability measures: MAX-Senstivity…

200 papers

As Machine Learning models are considered for autonomous decisions with significant social impact, the need for understanding how these models work rises rapidly. Explainable Artificial Intelligence (XAI) aims to provide interpretations for…

Machine Learning · Computer Science 2023-05-05 Jaime Pizarroso , David Alfaya , José Portela , Antonio Muñoz

The Model Parameter Randomisation Test (MPRT) is widely acknowledged in the eXplainable Artificial Intelligence (XAI) community for its well-motivated evaluative principle: that the explanation function should be sensitive to changes in the…

Artificial Intelligence · Computer Science 2024-01-15 Anna Hedström , Leander Weber , Sebastian Lapuschkin , Marina MC Höhne

Artificial Intelligence (AI) shows promising applications for the perception and planning tasks in autonomous driving (AD) due to its superior performance compared to conventional methods. However, inscrutable AI systems exacerbate the…

Robotics · Computer Science 2024-11-12 Anton Kuznietsov , Balint Gyevnar , Cheng Wang , Steven Peters , Stefano V. Albrecht

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

Research on explainable AI (XAI) has frequently focused on explaining model predictions. More recently, methods have been proposed to explain prediction uncertainty by attributing it to input features (uncertainty attributions). However,…

Machine Learning · Computer Science 2026-03-26 Emily Schiller , Teodor Chiaburu , Marco Zullich , Luca Longo

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

Human-Computer Interaction · Computer Science 2023-03-22 Savio Rozario , George Čevora

Explainable AI has become a common term in the literature, scrutinized by computer scientists and statisticians and highlighted by psychological or philosophical researchers. One major effort many researchers tackle is constructing general…

Artificial Intelligence · Computer Science 2025-09-12 Carina Newen , Daniel Bodemer , Sonja Glantz , Emmanuel Müller , Magdalena Wischnewski , Lenka Schnaubert

In recent years, Explainable AI (xAI) attracted a lot of attention as various countries turned explanations into a legal right. xAI allows for improving models beyond the accuracy metric by, e.g., debugging the learned pattern and…

Software Engineering · Computer Science 2022-10-05 Mohamed Karim Belaid , Eyke Hüllermeier , Maximilian Rabus , Ralf Krestel

The need for interpretable and accountable intelligent systems grows along with the prevalence of artificial intelligence applications used in everyday life. Explainable intelligent systems are designed to self-explain the reasoning behind…

Human-Computer Interaction · Computer Science 2020-08-06 Sina Mohseni , Niloofar Zarei , Eric D. Ragan

Explainable AI (XAI) has revolutionized the field of deep learning by empowering users to have more trust in neural network models. The field of XAI allows users to probe the inner workings of these algorithms to elucidate their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Prithwijit Chowdhury , Mohit Prabhushankar , Ghassan AlRegib , Mohamed Deriche

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

Cryptography and Security · Computer Science 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

Explainable Artificial Intelligence (XAI) has re-emerged in response to the development of modern AI and ML systems. These systems are complex and sometimes biased, but they nevertheless make decisions that impact our lives. XAI systems are…

Artificial Intelligence · Computer Science 2021-02-10 Shane T. Mueller , Elizabeth S. Veinott , Robert R. Hoffman , Gary Klein , Lamia Alam , Tauseef Mamun , William J. Clancey

Explainable Artificial Intelligence (XAI) methods are intended to help human users better understand the decision making of an AI agent. However, many modern XAI approaches are unintuitive to end users, particularly those without prior AI…

Machine Learning · Computer Science 2022-09-09 Faraz Khadivpour , Arghasree Banerjee , Matthew Guzdial

The Model Parameter Randomisation Test (MPRT) is highly recognised in the eXplainable Artificial Intelligence (XAI) community due to its fundamental evaluative criterion: explanations should be sensitive to the parameters of the model they…

Machine Learning · Statistics 2024-05-07 Anna Hedström , Leander Weber , Sebastian Lapuschkin , Marina Höhne

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

Machine Learning · Computer Science 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

In this paper we criticize the robustness measure traditionally employed to assess the performance of machine learning models deployed in adversarial settings. To mitigate the limitations of robustness, we introduce a new measure called…

Machine Learning · Computer Science 2021-12-07 Stefano Calzavara , Lorenzo Cazzaro , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

Explainable artificial intelligence (XAI) methods are portrayed as a remedy for debugging and trusting statistical and deep learning models, as well as interpreting their predictions. However, recent advances in adversarial machine learning…

Cryptography and Security · Computer Science 2025-07-30 Hubert Baniecki , Przemyslaw Biecek

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Despite significant progress, evaluation of explainable artificial intelligence remains elusive and challenging. In this paper we propose a fine-grained validation framework that is not overly reliant on any one facet of these…

Human-Computer Interaction · Computer Science 2024-03-20 Kacper Sokol , Julia E. Vogt

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita