English
Related papers

Related papers: Does Your Model Think Like an Engineer? Explainabl…

200 papers

A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural…

Machine Learning · Computer Science 2022-07-13 Jacob Kauffmann , Malte Esders , Lukas Ruff , Grégoire Montavon , Wojciech Samek , Klaus-Robert Müller

The accelerated progress of artificial intelligence (AI) has popularized deep learning models across various domains, yet their inherent opacity poses challenges, particularly in critical fields like healthcare, medicine, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Michail Mamalakis , Antonios Mamalakis , Ingrid Agartz , Lynn Egeland Mørch-Johnsen , Graham Murray , John Suckling , Pietro Lio

Recent research has developed a number of eXplainable AI (XAI) techniques, such as gradient-based approaches, input perturbation-base methods, and black-box explanation methods. While these XAI techniques can extract meaningful insights…

Machine Learning · Computer Science 2025-03-10 Xu Zheng , Farhad Shirani , Zhuomin Chen , Chaohao Lin , Wei Cheng , Wenbo Guo , Dongsheng Luo

Despite significant advancements in XAI, scholars note a persistent lack of solid conceptual foundations and integration with broader scientific discourse on explanation. In response, emerging research draws on explanatory strategies from…

Machine Learning · Computer Science 2026-05-22 Marcin Rabiza

Explainable AI (XAI) is widely used to analyze AI systems' decision-making, such as providing counterfactual explanations for recourse. When unexpected explanations occur, users may want to understand the training data properties shaping…

Machine Learning · Computer Science 2025-03-26 André Artelt , Barbara Hammer

The development of many vision models mainly focuses on improving their performance using metrics such as accuracy, IoU, and mAP, with less attention to explainability due to the complexity of applying xAI methods to provide a meaningful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Phu-Vinh Nguyen , Tan-Hanh Pham , Chris Ngo , Truong Son Hy

As the societal impact of Deep Neural Networks (DNNs) grows, the goals for advancing DNNs become more complex and diverse, ranging from improving a conventional model accuracy metric to infusing advanced human virtues such as fairness,…

Artificial Intelligence · Computer Science 2022-12-09 Yuyang Gao , Siyi Gu , Junji Jiang , Sungsoo Ray Hong , Dazhou Yu , Liang Zhao

Despite significant progress, evaluation of explainable artificial intelligence remains elusive and challenging. In this paper we propose a fine-grained validation framework that is not overly reliant on any one facet of these…

Human-Computer Interaction · Computer Science 2024-03-20 Kacper Sokol , Julia E. Vogt

Artificial intelligence (AI) enables machines to learn from human experience, adjust to new inputs, and perform human-like tasks. AI is progressing rapidly and is transforming the way businesses operate, from process automation to cognitive…

Machine Learning · Computer Science 2021-12-17 Ambreen Hanif

Rapid development of advanced modelling techniques gives an opportunity to develop tools that are more and more accurate. However as usually, everything comes with a price and in this case, the price to pay is to loose interpretability of a…

Explainable artificial intelligence (XAI) aims to develop transparent explanatory approaches for "black-box" deep learning models. However,it remains difficult for existing methods to achieve the trade-off of the three key criteria in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Changqi Sun , Hao Xu , Yuntian Chen , Dongxiao Zhang

In recent years, Explainable AI (XAI) methods have facilitated profound validation and knowledge extraction from ML models. While extensively studied for classification, few XAI solutions have addressed the challenges specific to regression…

Machine Learning · Computer Science 2025-07-21 Simon Letzgus , Klaus-Robert Müller , Grégoire Montavon

In the realm of human activity recognition (HAR), the integration of explainable Artificial Intelligence (XAI) emerges as a critical necessity to elucidate the decision-making processes of complex models, fostering transparency and trust.…

Artificial Intelligence · Computer Science 2024-08-22 Yiran Huang , Yexu Zhou , Haibin Zhao , Till Riedel , Michael Beigl

Many high-performance models suffer from a lack of interpretability. There has been an increasing influx of work on explainable artificial intelligence (XAI) in order to disentangle what is meant and expected by XAI. Nevertheless, there is…

Machine Learning · Computer Science 2019-10-23 Adrien Bennetot , Jean-Luc Laurent , Raja Chatila , Natalia Díaz-Rodríguez

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

Artificial Intelligence · Computer Science 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

In this survey paper, we deep dive into the field of Explainable Artificial Intelligence (XAI). After introducing the scope of this paper, we start by discussing what an "explanation" really is. We then move on to discuss some of the…

Artificial Intelligence · Computer Science 2023-06-06 Clive Gomes , Lalitha Natraj , Shijun Liu , Anushka Datta

Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. While black-boxing AI systems can make the user experience seamless, hiding the seams risks disempowering users to mitigate fallouts…

Human-Computer Interaction · Computer Science 2024-03-07 Upol Ehsan , Q. Vera Liao , Samir Passi , Mark O. Riedl , Hal Daume

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex…

Artificial Intelligence · Computer Science 2020-11-16 Jonas Andrulis , Ole Meyer , Grégory Schott , Samuel Weinbach , Volker Gruhn