English
Related papers

Related papers: Evaluating Explainable AI Attribution Methods in N…

200 papers

Ensuring the trustworthiness and interpretability of machine learning models is critical to their deployment in real-world applications. Feature attribution methods have gained significant attention, which provide local explanations of…

Machine Learning · Computer Science 2023-09-20 Md Abdul Kadir , Gowtham Krishna Addluri , Daniel Sonntag

Attribution methods calculate attributions that visually explain the predictions of deep neural networks (DNNs) by highlighting important parts of the input features. In particular, gradient-based attribution (GBA) methods are widely used…

Machine Learning · Computer Science 2021-02-16 Jae-Hong Lee , Joon-Hyuk Chang

The development of machine learning applications has increased significantly in recent years, motivated by the remarkable ability of learning-powered systems to discover and generalize intricate patterns hidden in massive datasets. Modern…

Machine Learning · Computer Science 2025-04-25 Evandro S. Ortigossa , Fábio F. Dias , Brian Barr , Claudio T. Silva , Luis Gustavo Nonato

This paper studies interpretable and fair artificial intelligence architectures for understanding English reading. Introduced transformer-based models, integrating advanced attention mechanisms and gradient-based feature attribution. The…

Computation and Language · Computer Science 2026-04-28 Ping Li

Explaining recommendations enables users to understand whether recommended items are relevant to their needs and has been shown to increase their trust in the system. More generally, if designing explainable machine learning models is key…

Machine Learning · Computer Science 2020-08-27 Darius Afchar , Romain Hennequin

Attribution methods compute importance scores for input features to explain model predictions. However, assessing the faithfulness of these methods remains challenging due to the absence of attribution ground truth to model predictions. In…

Cryptography and Security · Computer Science 2025-10-02 Peiyu Yang , Naveed Akhtar , Jiantong Jiang , Ajmal Mian

AI explainability improves the transparency of models, making them more trustworthy. Such goals are motivated by the emergence of deep learning models, which are obscure by nature; even in the domain of images, where deep learning has…

Machine Learning · Computer Science 2022-03-01 Anna Arias-Duart , Ferran Parés , Dario Garcia-Gasulla , Victor Gimenez-Abalos

The use of data-driven methods in fluid mechanics has surged dramatically in recent years due to their capacity to adapt to the complex and multi-scale nature of turbulent flows, as well as to detect patterns in large-scale simulations or…

Fluid Dynamics · Physics 2024-09-19 Andrés Cremades , Sergio Hoyas , Ricardo Vinuesa

Explainable AI (XAI) promises to provide insight into machine learning models' decision processes, where one goal is to identify failures such as shortcut learning. This promise relies on the field's assumption that input features marked as…

Machine Learning · Computer Science 2026-02-19 Benedict Clark , Marta Oliveira , Rick Wilming , Stefan Haufe

Explainable Artificial Intelligence (XAI) addresses the growing need for transparency and interpretability in AI systems, enabling trust and accountability in decision-making processes. This book offers a comprehensive guide to XAI,…

Good quality explanations strengthen the understanding of language models and data. Feature attribution methods, such as Integrated Gradient, are a type of post-hoc explainer that can provide token-level insights. However, explanations on…

Computation and Language · Computer Science 2026-04-21 Jonathan Kamp , Roos Bakker , Dominique Blok

Recent research has demonstrated that feature attribution methods for deep networks can themselves be incorporated into training; these attribution priors optimize for a model whose attributions have certain desirable properties -- most…

Machine Learning · Computer Science 2020-11-12 Gabriel Erion , Joseph D. Janizek , Pascal Sturmfels , Scott Lundberg , Su-In Lee

Large language models (LLMs) achieve strong performance across many natural language processing tasks, yet their decision processes remain difficult to interpret. This lack of transparency creates challenges for trust, debugging, and…

Computation and Language · Computer Science 2026-04-20 Venkata Abhinandan Kancharla

The need for explainable AI (XAI) is well established but relatively little has been published outside of the supervised learning paradigm. This paper focuses on a principled approach to applying explainability and interpretability to the…

Machine Learning · Computer Science 2022-07-26 John Sipple , Abdou Youssef

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

EXplainable AI (XAI) methods have been proposed to interpret how a deep neural network predicts inputs through model saliency explanations that highlight the parts of the inputs deemed important to arrive a decision at a specific target.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Yi-Shan Lin , Wen-Chuan Lee , Z. Berkay Celik

Value decomposition is widely used in cooperative multi-agent reinforcement learning, however, its implicit credit assignment mechanism is not yet fully understood due to black-box networks. In this work, we study an interpretable value…

Multiagent Systems · Computer Science 2024-01-30 Zichuan Liu , Yuanyang Zhu , Chunlin Chen

When users perceive AI systems as mindful, independent agents, they hold them responsible instead of the AI experts who created and designed these systems. So far, it has not been studied whether explanations support this shift in…

Artificial Intelligence · Computer Science 2023-12-20 Susanne Hindennach , Lei Shi , Filip Miletić , Andreas Bulling

Explainable AI (XAI) is the study on how humans can be able to understand the cause of a model's prediction. In this work, the problem of interest is Scene Text Recognition (STR) Explainability, using XAI to understand the cause of an STR…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Mark Vincent Ty , Rowel Atienza