English
Related papers

Related papers: Predicting and Explaining Mobile UI Tappability wi…

200 papers

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

The pixels in an image, and the objects, scenes, and actions that they compose, determine whether an image will be memorable or forgettable. While memorability varies by image, it is largely independent of an individual observer. Observer…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Zoya Bylinskii , Lore Goetschalckx , Anelise Newman , Aude Oliva

We present a deformable prototypical part network (Deformable ProtoPNet), an interpretable image classifier that integrates the power of deep learning and the interpretability of case-based reasoning. This model classifies input images by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Jon Donnelly , Alina Jade Barnett , Chaofan Chen

This paper investigates the user experience of visualizations of a machine learning (ML) system that recognizes objects in images. This is important since even good systems can fail in unexpected ways as misclassifications on photo-sharing…

Human-Computer Interaction · Computer Science 2020-08-06 Hendrik Heuer , Andreas Breiter

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

Understanding the decision-making process of machine learning models provides valuable insights into the task, the data, and the reasons behind a model's failures. In this work, we propose a method that performs inherently interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Moritz Vandenhirtz , Julia E. Vogt

Recently, many methods to interpret and visualize deep neural network predictions have been proposed and significant progress has been made. However, a more class-discriminative and visually pleasing explanation is required. Thus, this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Dasom Seo , Kanghan Oh , Il-Seok Oh

Semantic segmentation aims to robustly predict coherent class labels for entire regions of an image. It is a scene understanding task that powers real-world applications (e.g., autonomous navigation). One important application, the use of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuxiang Zhang , Sachin Mehta , Anat Caspi

Interpretability in machine learning models is important in high-stakes decisions, such as whether to order a biopsy based on a mammographic exam. Mammography poses important challenges that are not present in other computer vision tasks:…

Machine Learning · Computer Science 2021-03-24 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

XAI gained considerable importance in recent years. Methods based on prototypical case-based reasoning have shown a promising improvement in explainability. However, these methods typically rely on additional post-hoc saliency techniques to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Steffen Meinert , Philipp Schlinge , Nils Strodthoff , Martin Atzmueller

The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on…

Machine Learning · Computer Science 2019-08-06 Dylan Slack , Sorelle A. Friedler , Carlos Scheidegger , Chitradeep Dutta Roy

Explainability is a longstanding challenge in deep learning, especially in high-stakes domains like healthcare. Common explainability methods highlight image regions that drive an AI model's decision. Humans, however, heavily rely on…

Artificial Intelligence · Computer Science 2023-11-21 Shobhit Agarwal , Yevgeniy R. Semenov , William Lotter

Robustness has become one of the most critical problems in machine learning (ML). The science of interpreting ML models to understand their behavior and improve their robustness is referred to as explainable artificial intelligence (XAI).…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Patrick Koller , Amil V. Dravid , Guido M. Schuster , Aggelos K. Katsaggelos

The abilities to understand the social interaction behaviors between a vehicle and its surroundings while predicting its trajectory in an urban environment are critical for road safety in autonomous driving. Social interactions are hard to…

Artificial Intelligence · Computer Science 2023-08-09 Amina Ghoul , Itheri Yahiaoui , Anne Verroust-Blondet , Fawzi Nashashibi

Visual affordance segmentation identifies image regions of an object an agent can interact with. Existing methods re-use and adapt learning-based architectures for semantic segmentation to the affordance segmentation task and evaluate on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tommaso Apicella , Alessio Xompero , Paolo Gastaldo , Andrea Cavallaro

Mobile manipulators require coordinated control between navigation and manipulation to accomplish tasks. Typically, coordinated mobile manipulation behaviors have base navigation to approach the goal followed by arm manipulation to reach…

Robotics · Computer Science 2024-10-29 Xiaoxu Feng , Takato Horii , Takayuki Nagai

Mounting evidence in explainability for artificial intelligence (XAI) research suggests that good explanations should be tailored to individual tasks and should relate to concepts relevant to the task. However, building task specific…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Teodor Chiaburu , Frank Haußer , Felix Bießmann

Deep saliency prediction algorithms complement the object recognition features, they typically rely on additional information, such as scene context, semantic relationships, gaze direction, and object dissimilarity. However, none of these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Bahar Aydemir , Ludo Hoffstetter , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

Current research on Explainable AI (XAI) heavily targets on expert users (data scientists or AI developers). However, increasing importance has been argued for making AI more understandable to nonexperts, who are expected to leverage AI…

Human-Computer Interaction · Computer Science 2021-10-20 Chao Wang , Pengcheng An

Explainable AI (XAI) is the study on how humans can be able to understand the cause of a model's prediction. In this work, the problem of interest is Scene Text Recognition (STR) Explainability, using XAI to understand the cause of an STR…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Mark Vincent Ty , Rowel Atienza