English
Related papers

Related papers: Explainable AI does not provide the explanations e…

200 papers

Artificial intelligence methods are being increasingly applied across various domains, but their often opaque nature has raised concerns about accountability and trust. In response, the field of explainable AI (XAI) has emerged to address…

Neural and Evolutionary Computing · Computer Science 2024-10-18 Ryan Zhou , Jaume Bacardit , Alexander Brownlee , Stefano Cagnoni , Martin Fyvie , Giovanni Iacca , John McCall , Niki van Stein , David Walker , Ting Hu

Explainable AI (XAI) aims to improve user understanding and decisions when using AI models. However, despite innovations in XAI, recent user evaluations reveal that this goal remains elusive. Understanding human cognition can help explain…

Artificial Intelligence · Computer Science 2026-05-01 Louth Bin Rawshan , Zhuoyu Wang , Brian Y. Lim

Despite significant progress, evaluation of explainable artificial intelligence remains elusive and challenging. In this paper we propose a fine-grained validation framework that is not overly reliant on any one facet of these…

Human-Computer Interaction · Computer Science 2024-03-20 Kacper Sokol , Julia E. Vogt

As AI becomes more common in everyday living, there is an increasing demand for intelligent systems that are both performant and understandable. Explainable AI (XAI) systems aim to provide comprehensible explanations of decisions and…

Artificial Intelligence · Computer Science 2025-10-15 Aline Mangold , Juliane Zietz , Susanne Weinhold , Sebastian Pannasch

Artificial intelligence (AI) has huge potential to improve the health and well-being of people, but adoption in clinical practice is still limited. Lack of transparency is identified as one of the main barriers to implementation, as…

Artificial Intelligence · Computer Science 2021-01-06 Aniek F. Markus , Jan A. Kors , Peter R. Rijnbeek

Despite its technological breakthroughs, eXplainable Artificial Intelligence (XAI) research has limited success in producing the {\em effective explanations} needed by users. In order to improve XAI systems' usability, practical…

Human-Computer Interaction · Computer Science 2024-03-22 Thu Nguyen , Alessandro Canossa , Jichen Zhu

As machine learning (ML) systems take a more prominent and central role in contributing to life-impacting decisions, ensuring their trustworthiness and accountability is of utmost importance. Explanations sit at the core of these desirable…

Machine Learning · Computer Science 2021-06-16 Sahil Verma , Aditya Lahiri , John P. Dickerson , Su-In Lee

Artificial intelligence (AI) is becoming increasingly complex, making it difficult for users to understand how the AI has derived its prediction. Using explainable AI (XAI)-methods, researchers aim to explain AI decisions to users. So far,…

Human-Computer Interaction · Computer Science 2022-10-06 Lara Riefle , Patrick Hemmer , Carina Benz , Michael Vössing , Jannik Pries

With the emergence of Artificial Intelligence (AI)-based decision-making, explanations help increase new technology adoption through enhanced trust and reliability. However, our experimental study challenges the notion that every user…

Human-Computer Interaction · Computer Science 2024-05-01 Sabid Bin Habib Pias , Alicia Freel , Timothy Trammel , Taslima Akter , Donald Williamson , Apu Kapadia

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

Machine Learning · Computer Science 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

For synergistic interactions between humans and artificial intelligence (AI) systems, AI outputs often need to be explainable to people. Explainable AI (XAI) systems are commonly tested in human user studies. However, whether XAI…

Human-Computer Interaction · Computer Science 2024-03-12 Uwe Peters , Mary Carman

To benefit from AI advances, users and operators of AI systems must have reason to trust it. Trust arises from multiple interactions, where predictable and desirable behavior is reinforced over time. Providing the system's users with some…

Artificial Intelligence · Computer Science 2022-01-27 Stephanie Galaitsi , Benjamin D. Trump , Jeffrey M. Keisler , Igor Linkov , Alexander Kott

Previous research in Explainable Artificial Intelligence (XAI) suggests that a main aim of explainability approaches is to satisfy specific interests, goals, expectations, needs, and demands regarding artificial systems (we call these…

Artificial Intelligence · Computer Science 2021-02-17 Markus Langer , Daniel Oster , Timo Speith , Holger Hermanns , Lena Kästner , Eva Schmidt , Andreas Sesing , Kevin Baum

Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs and behaviors around XAI explanations. To address this gap and contribute to understanding how explainability can support…

Human-Computer Interaction · Computer Science 2023-02-20 Sunnie S. Y. Kim , Elizabeth Anne Watkins , Olga Russakovsky , Ruth Fong , Andrés Monroy-Hernández

Recent advances in artificial intelligence (AI) and robotics have drawn attention to the need for AI systems and robots to be understandable to human users. The explainable AI (XAI) and explainable robots literature aims to enhance human…

Robotics · Computer Science 2020-05-13 Lindsay Sanneman , Julie A. Shah

As systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications, understanding these black box models has become paramount. In response, Explainable AI (XAI) has emerged as a field of research…

The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we…

Artificial Intelligence · Computer Science 2019-02-04 Robert R. Hoffman , Shane T. Mueller , Gary Klein , Jordan Litman

Advances in AI technologies have resulted in superior levels of AI-based model performance. However, this has also led to a greater degree of model complexity, resulting in 'black box' models. In response to the AI black box problem, the…

Human-Computer Interaction · Computer Science 2022-10-25 Julie Gerlings , Millie Søndergaard Jensen , Arisa Shollo

Nowadays Artificial Intelligence (AI) has become a fundamental component of healthcare applications, both clinical and remote, but the best performing AI systems are often too complex to be self-explaining. Explainable AI (XAI) techniques…

Machine Learning · Computer Science 2022-09-15 Flavio Di Martino , Franca Delmastro

Explainable Artificial Intelligence (XAI) plays a crucial role in enabling human understanding and trust in deep learning systems. As models get larger, more ubiquitous, and pervasive in aspects of daily life, explainability is necessary to…

Machine Learning · Computer Science 2024-05-29 Vinitra Swamy , Jibril Frej , Tanja Käser