English
Related papers

Related papers: On the stability, correctness and plausibility of …

200 papers

Feature attribution methods are popular for explaining neural network predictions, and they are often evaluated on metrics such as comprehensiveness and sufficiency. In this paper, we highlight an intriguing property of these metrics: their…

Machine Learning · Computer Science 2023-02-06 Yilun Zhou , Julie Shah

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

With increasing interest in explaining machine learning (ML) models, the first part of this two-part study synthesizes recent research on methods for explaining global and local aspects of ML models. This study distinguishes explainability…

Machine Learning · Statistics 2022-11-17 Montgomery Flora , Corey Potvin , Amy McGovern , Shawn Handler

Given a machine learning (ML) model and a prediction, explanations can be defined as sets of features which are sufficient for the prediction. In some applications, and besides asking for an explanation, it is also critical to understand…

Machine Learning · Computer Science 2023-02-08 Xuanxiang Huang , Martin C. Cooper , Antonio Morgado , Jordi Planes , Joao Marques-Silva

The relevance of machine learning (ML) in our daily lives is closely intertwined with its explainability. Explainability can allow end-users to have a transparent and humane reckoning of a ML scheme's capability and utility. It will also…

Machine Learning · Computer Science 2022-12-27 Payel Sadhukhan , Sarbani palit , Kausik Sengupta

Explainability algorithms aimed at interpreting decision-making AI systems usually consider balancing two critical dimensions: 1) \textit{faithfulness}, where explanations accurately reflect the model's inference process. 2)…

Artificial Intelligence · Computer Science 2024-04-02 Xiaolei Lu , Jianghong Ma

Explainable Artificial Intelligence (XAI) is increasingly rec ognized as essential for deploying machine learning systems in safety critical environments. In Automatic Target Recognition (ATR), where models operate on image, video, radar,…

Artificial Intelligence · Computer Science 2026-05-08 Vanessa Buhrmester , David Muench , Dimitri Bulatov , Michael Arens

The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we…

Artificial Intelligence · Computer Science 2019-02-04 Robert R. Hoffman , Shane T. Mueller , Gary Klein , Jordan Litman

Explainability in machine learning has become incredibly important as machine learning-powered systems become ubiquitous and both regulation and public sentiment begin to demand an understanding of how these systems make decisions. As a…

Machine Learning · Computer Science 2022-03-09 Erick Galinkin

With the growing pervasiveness of artificial intelligence, the ability to explain the inferences made by machine learning models has become increasingly important. Numerous techniques for model explainability have been proposed, with…

Human-Computer Interaction · Computer Science 2026-04-08 Nicola Rossberg , Bennett Kleinberg , Barry O'Sullivan , Luca Longo , Andrea Visentin

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

Explainable AI (XAI) aims to support appropriate human-AI reliance by increasing the interpretability of complex model decisions. Despite the proliferation of proposed methods, there is mixed evidence surrounding the effects of different…

Human-Computer Interaction · Computer Science 2024-10-29 Emma Casolin , Flora D. Salim , Ben Newell

Explainable machine learning and artificial intelligence models have been used to justify a model's decision-making process. This added transparency aims to help improve user performance and understanding of the underlying model. However,…

Human-Computer Interaction · Computer Science 2020-05-06 Mahsan Nourani , Chiradeep Roy , Tahrima Rahman , Eric D. Ragan , Nicholas Ruozzi , Vibhav Gogate

The use of eXplainable Artificial Intelligence (XAI) systems has introduced a set of challenges that need resolution. The XAI robustness, or stability, has been one of the goals of the community from its beginning. Multiple authors have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Miquel Miró-Nicolau , Antoni Jaume-i-Capó , Gabriel Moyà-Alcover

Research on bias in machine learning algorithms has generally been concerned with the impact of bias on predictive accuracy. We believe that there are other factors that should also play a role in the evaluation of bias. One such factor is…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

Recent years have witnessed the emergence of a variety of post-hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it remains an open…

Computation and Language · Computer Science 2022-04-04 Fan Yin , Zhouxing Shi , Cho-Jui Hsieh , Kai-Wei Chang

Current Explainable AI (ExAI) methods, especially in the NLP field, are conducted on various datasets by employing different metrics to evaluate several aspects. The lack of a common evaluation framework is hindering the progress tracking…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mohamad Mansour , Basel Mousi , Mariette Awad

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Explainable AI (XAI) aims to make the behaviour of machine learning models interpretable, yet many explanation methods remain difficult to understand. The integration of Natural Language Generation into XAI aims to deliver explanations in…

Computation and Language · Computer Science 2026-04-21 Mateusz Cedro , David Martens

While local explanations for AI models can offer insights into individual predictions, such as feature importance, they are plagued by issues like instability. The unreliability of feature weights, often skewed due to poorly calibrated ML…

Artificial Intelligence · Computer Science 2024-01-09 Helena Lofstrom , Tuwe Lofstrom , Ulf Johansson , Cecilia Sonstrod