English
Related papers

Related papers: Meta-evaluating stability measures: MAX-Senstivity…

200 papers

The evolving landscape of explainable artificial intelligence (XAI) aims to improve the interpretability of intricate machine learning (ML) models, yet faces challenges in formalisation and empirical validation, being an inherently…

Explainable Artificial Intelligence (XAI) is increasingly rec ognized as essential for deploying machine learning systems in safety critical environments. In Automatic Target Recognition (ATR), where models operate on image, video, radar,…

Artificial Intelligence · Computer Science 2026-05-08 Vanessa Buhrmester , David Muench , Dimitri Bulatov , Michael Arens

The advancement of deep learning in human activity recognition (HAR) using 3D skeleton data is critical for applications in healthcare, security, sports, and human-computer interaction. This paper tackles a well-known gap in the field,…

Machine Learning · Computer Science 2024-02-21 Kimji N. Pellano , Inga Strümke , Espen Alexander F. Ihlen

The field of explainable artificial intelligence (XAI) aims to explain how black-box machine learning models work. Much of the work centers around the holy grail of providing post-hoc feature attributions to any model architecture. While…

Machine Learning · Computer Science 2023-11-15 Brian Barr , Noah Fatsi , Leif Hancox-Li , Peter Richter , Daniel Proano , Caleb Mok

Interpretability of Deep Learning (DL) is a barrier to trustworthy AI. Despite great efforts made by the Explainable AI (XAI) community, explanations lack robustness -- indistinguishable input perturbations may lead to different XAI…

Machine Learning · Computer Science 2023-08-01 Wei Huang , Xingyu Zhao , Gaojie Jin , Xiaowei Huang

Explainable artificially intelligent (XAI) systems form part of sociotechnical systems, e.g., human+AI teams tasked with making decisions. Yet, current XAI systems are rarely evaluated by measuring the performance of human+AI teams on…

Artificial Intelligence · Computer Science 2020-01-24 Zana Buçinca , Phoebe Lin , Krzysztof Z. Gajos , Elena L. Glassman

Recent work has investigated the vulnerability of local surrogate methods to adversarial perturbations on a machine learning (ML) model's inputs, where the explanation is manipulated while the meaning and structure of the original input…

Machine Learning · Computer Science 2025-01-20 Christopher Burger , Charles Walter , Thai Le

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements…

Human-Computer Interaction · Computer Science 2024-10-17 Tobias Labarta , Elizaveta Kulicheva , Ronja Froelian , Christian Geißler , Xenia Melman , Julian von Klitzing

This paper investigates a unexplored yet impactful vulnerability in AI explainability used in intrusion detection (IDS): multicollinearity-induced instability. Despite extensive reliance on post-hoc explainability tools such as SHAP or…

Machine Learning · Computer Science 2026-05-22 Ioannis J. Vourganas , Anna Lito Michala

The rapid integration of Artificial Intelligence (AI) systems across critical domains necessitates robust security evaluation frameworks. We propose a novel approach that introduces three metrics: System Complexity Index (SCI), Lyapunov…

Cryptography and Security · Computer Science 2024-04-18 B Kereopa-Yorke

Explainable AI (XAI) in high-stakes domains should help stakeholders trust and verify system outputs. Yet Chain-of-Thought methods reason before concluding, and logical gaps or hallucinations can yield conclusions that do not reliably align…

Artificial Intelligence · Computer Science 2026-01-13 Chen Qian , Yimeng Wang , Yu Chen , Lingfei Wu , Andreas Stathopoulos

Reliable explainability is not only a technical goal but also a cornerstone of private AI governance. As AI models enter high-stakes sectors, private actors such as auditors, insurers, certification bodies, and procurement agencies require…

Artificial Intelligence · Computer Science 2025-11-21 Pratinav Seth , Vinay Kumar Sankarapu

Reliable pattern recognition systems should exhibit consistent behavior across similar inputs, and their explanations should remain stable. However, most Explainable AI evaluations remain instance centric and do not explicitly quantify…

Artificial Intelligence · Computer Science 2026-04-07 Abu Noman Md Sakib , Zhensen Wang , Merjulah Roby , Zijie Zhang

Current Explainable AI (ExAI) methods, especially in the NLP field, are conducted on various datasets by employing different metrics to evaluate several aspects. The lack of a common evaluation framework is hindering the progress tracking…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mohamad Mansour , Basel Mousi , Mariette Awad

The increasing complexity of LLMs presents significant challenges to their transparency and interpretability, necessitating the use of eXplainable AI (XAI) techniques to enhance trustworthiness and usability. This study introduces a…

Computation and Language · Computer Science 2025-04-09 Melkamu Abay Mersha , Mesay Gemeda Yigezu , Hassan Shakil , Ali K. AlShami , Sanghyun Byun , Jugal Kalita

The lack of ground truth explanation labels is a fundamental challenge for quantitative evaluation in explainable artificial intelligence (XAI). This challenge becomes especially problematic when evaluation methods have numerous…

Artificial Intelligence · Computer Science 2024-12-10 Kristoffer Wickstrøm , Marina Marie-Claire Höhne , Anna Hedström

As attribution-based explanation methods are increasingly used to establish model trustworthiness in high-stakes situations, it is critical to ensure that these explanations are stable, e.g., robust to infinitesimal perturbations to an…

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

Human-Computer Interaction · Computer Science 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

Research into the explanation of machine learning models, i.e., explainable AI (XAI), has seen a commensurate exponential growth alongside deep artificial neural networks throughout the past decade. For historical reasons, explanation and…

Human-Computer Interaction · Computer Science 2020-09-29 Brittany Davis , Maria Glenski , William Sealy , Dustin Arendt