English
Related papers

Related papers: Do Users Benefit From Interpretable Vision? A User…

200 papers

Transparency, user trust, and human comprehension are popular ethical motivations for interpretable machine learning. In support of these goals, researchers evaluate model explanation performance using humans and real world applications.…

Artificial Intelligence · Computer Science 2019-10-31 Bernease Herman

Humans judge perceptual similarity according to diverse visual attributes, including scene layout, subject location, and camera pose. Existing vision models understand a wide range of semantic abstractions but improperly weigh these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Shobhita Sundaram , Stephanie Fu , Lukas Muttenthaler , Netanel Y. Tamir , Lucy Chai , Simon Kornblith , Trevor Darrell , Phillip Isola

Analysts often make visual causal inferences about possible data-generating models. However, visual analytics (VA) software tends to leave these models implicit in the mind of the analyst, which casts doubt on the statistical validity of…

Human-Computer Interaction · Computer Science 2021-07-29 Alex Kale , Yifan Wu , Jessica Hullman

Recently, face recognition systems have demonstrated remarkable performances and thus gained a vital role in our daily life. They already surpass human face verification accountability in many scenarios. However, they lack explanations for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Martin Knoche , Torben Teepe , Stefan Hörmann , Gerhard Rigoll

The continued improvements in the predictive accuracy of machine learning models have allowed for their widespread practical application. Yet, many decisions made with seemingly accurate models still require verification by domain experts.…

Human-Computer Interaction · Computer Science 2020-03-06 Oscar Gomez , Steffen Holter , Jun Yuan , Enrico Bertini

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

It is said that beauty is in the eye of the beholder. But how exactly can we characterize such discrepancies in interpretation? For example, are there any specific features of an image that makes person A regard an image as beautiful while…

Artificial Intelligence · Computer Science 2019-05-23 Philipp Blandfort , Jörn Hees , Desmond U. Patton

People often use visualizations not only to explore a dataset but also to draw generalizable conclusions about underlying models or phenomena. While previous research has viewed deviations from rational analysis as problematic, we…

Human-Computer Interaction · Computer Science 2024-11-20 Ratanond Koonchanok , Khairi Reda

For neural models to garner widespread public trust and ensure fairness, we must have human-intelligible explanations for their predictions. Recently, an increasing number of works focus on explaining the predictions of neural models in…

Computation and Language · Computer Science 2020-12-15 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

Traditional approaches to data visualization have often focused on comparing different subsets of data, and this is reflected in the many techniques developed and evaluated over the years for visual comparison. Similarly, common workflows…

Human-Computer Interaction · Computer Science 2024-02-27 David Borland , Arran Zeyu Wang , David Gotz

Existing visual explanation generating agents learn to fluently justify a class prediction. However, they may mention visual attributes which reflect a strong class prior, although the evidence may not actually be in the image. This is…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

Single neurons in neural networks are often interpretable in that they represent individual, intuitively meaningful features. However, many neurons exhibit $\textit{mixed selectivity}$, i.e., they represent multiple unrelated features. A…

Machine Learning · Statistics 2023-10-19 David Klindt , Sophia Sanborn , Francisco Acosta , Frédéric Poitevin , Nina Miolane

Explainability is widely regarded as essential for trustworthy artificial intelligence systems. However, the metrics commonly used to evaluate counterfactual explanations are algorithmic evaluation metrics that are rarely validated against…

Artificial Intelligence · Computer Science 2026-03-17 Felix Liedeker , Basil Ell , Philipp Cimiano , Christoph Düsing

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

With machine learning models being increasingly used to aid decision making even in high-stakes domains, there has been a growing interest in developing interpretable models. Although many supposedly interpretable models have been proposed,…

Artificial Intelligence · Computer Science 2021-08-17 Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan , Hanna Wallach

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Social media platforms today strive to improve user experience through AI recommendations, yet the value of such recommendations vanishes as users do not understand the reasons behind them. This issue arises because explainability in social…

Artificial Intelligence · Computer Science 2025-08-04 Banan Alkhateeb , Ellis Solaiman

Explaining to users why automated systems make certain mistakes is important and challenging. Researchers have proposed ways to automatically produce interpretations for deep neural network models. However, it is unclear how useful these…

Human-Computer Interaction · Computer Science 2020-08-31 Hua Shen , Ting-Hao Kenneth Huang

The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can…

Machine Learning · Statistics 2016-07-04 Nick Condry

Existing interpretation algorithms have found that, even deep models make the same and right predictions on the same image, they might rely on different sets of input features for classification. However, among these sets of features, some…

Machine Learning · Computer Science 2021-09-03 Xuhong Li , Haoyi Xiong , Siyu Huang , Shilei Ji , Dejing Dou