English
Related papers

Related papers: Crowdsourcing Evaluation of Saliency-based XAI Met…

200 papers

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

Machine Learning · Computer Science 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift…

Machine Learning · Computer Science 2024-05-31 Jacob Dineen , Don Kridel , Daniel Dolk , David Castillo

Explainable Artificial Intelligence (XAI) methods in text summarization are essential for understanding the model behavior and fostering trust in model-generated summaries. Despite the effectiveness of XAI methods, recent studies have…

Artificial Intelligence · Computer Science 2025-11-07 Seema Aswani , Sujala D. Shetty

Explainable Artificial Intelligence (XAI) aims to provide insights into the decision-making process of AI models, allowing users to understand their results beyond their decisions. A significant goal of XAI is to improve the performance of…

Artificial Intelligence · Computer Science 2023-06-12 Andrea Apicella , Luca Di Lorenzo , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

Saliency maps are widely used for visual explanations in deep learning, but a fundamental lack of consensus persists regarding their intended purpose and alignment with diverse user queries. This ambiguity hinders the effective evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yehonatan Elisha , Seffi Cohen , Oren Barkan , Noam Koenigstein

Visual inspection tasks often require humans to cooperate with AI-based image classifiers. To enhance this cooperation, explainable artificial intelligence (XAI) can highlight those image areas that have contributed to an AI decision.…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller , David F. Reindel , Yannick D. Stadtfeld

In highly competitive software markets, user experience (UX) evaluation is crucial for ensuring software quality and fostering long-term product success. Such UX evaluations typically combine quantitative metrics from standardized…

Human-Computer Interaction · Computer Science 2026-02-02 Sandra Loop , Erik Bertram , Sebastian Juhl , Martin Schrepp

Explainable Artificial Intelligence (XAI) aims to create transparency in modern AI models by offering explanations of the models to human users. There are many ways in which researchers have attempted to evaluate the quality of these XAI…

Human-Computer Interaction · Computer Science 2025-11-07 Joe Shymanski , Jacob Brue , Sandip Sen

While a lot of research in explainable AI focuses on producing effective explanations, less work is devoted to the question of how people understand and interpret the explanation. In this work, we focus on this question through a study of…

Computation and Language · Computer Science 2022-06-20 Hendrik Schuff , Alon Jacovi , Heike Adel , Yoav Goldberg , Ngoc Thang Vu

Over the last years, many 'explainable artificial intelligence' (xAI) approaches have been developed, but these have not always been objectively evaluated. To evaluate the quality of heatmaps generated by various saliency methods, we…

Image and Video Processing · Electrical Eng. & Systems 2021-12-10 Céline Budding , Fabian Eitel , Kerstin Ritter , Stefan Haufe

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Rule-based models offer a human-understandable representation, i.e. they are interpretable. For this reason, they are used to explain the decisions of non-interpretable complex models, referred to as black box models. The generation of such…

Artificial Intelligence · Computer Science 2025-03-03 Michał Kozielski , Marek Sikora , Łukasz Wawrowski

This paper presents a new way of getting high-quality saliency maps for video, using a cheaper alternative to eye-tracking data. We designed a mouse-contingent video viewing system which simulates the viewers' peripheral vision based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Vitaliy Lyudvichenko , Dmitriy Vatolin

Explainable Artificial Intelligence (XAI) is an emerging research topic of machine learning aimed at unboxing how AI systems' black-box choices are made. This research field inspects the measures and models involved in decision-making and…

Artificial Intelligence · Computer Science 2021-02-04 Guang Yang , Qinghao Ye , Jun Xia

Despite promising developments in Explainable Artificial Intelligence, the practical value of XAI methods remains under-explored and insufficiently validated in real-world settings. Robust and context-aware evaluation is essential, not only…

Human-Computer Interaction · Computer Science 2025-06-18 Ivania Donoso-Guzmán , Kristýna Sirka Kacafírková , Maxwell Szymanski , An Jacobs , Denis Parra , Katrien Verbert

Scholars have increasingly investigated "crowdsourcing" as an alternative to expert-based judgment or purely data-driven approaches to predicting the future. Under certain conditions, scholars have found that crowdsourcing can outperform…

Physics and Society · Physics 2017-12-12 Daniel Martin Katz , Michael James Bommarito , Josh Blackman

Explainable Artificial Intelligence (XAI) emerged to reveal the internal mechanism of machine learning models and how the features affect the prediction outcome. Collinearity is one of the big issues that XAI methods face when identifying…

Machine Learning · Computer Science 2024-11-05 Ahmed M Salih

Explainable Artificial Intelligence (XAI) techniques are used to provide transparency to complex, opaque predictive models. However, these techniques are often designed for image and text data, and it is unclear how fit-for-purpose they are…

Computers and Society · Computer Science 2024-10-18 Mythreyi Velmurugan , Chun Ouyang , Yue Xu , Renuka Sindhgatta , Bemali Wickramanayake , Catarina Moreira