English
Related papers

Related papers: Towards credible visual model interpretation with …

200 papers

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

In spite of several claims stating that some models are more interpretable than others -- e.g., "linear models are more interpretable than deep neural networks" -- we still lack a principled notion of interpretability to formally compare…

Artificial Intelligence · Computer Science 2020-11-16 Pablo Barceló , Mikaël Monet , Jorge Pérez , Bernardo Subercaseaux

Concept explanation is a popular approach for examining how human-interpretable concepts impact the predictions of a model. However, most existing methods for concept explanations are tailored to specific models. To address this issue, this…

Machine Learning · Computer Science 2024-01-17 Zhili Feng , Michal Moshkovitz , Dotan Di Castro , J. Zico Kolter

The study of neural networks from the perspective of Fourier features has garnered significant attention. While existing analytical research suggests that neural networks tend to learn low-frequency features, a clear attribution method for…

Machine Learning · Computer Science 2025-07-16 Zechen Liu , Feiyang Zhang , Wei Song , Xiang Li , Wei Wei

Pattern extraction algorithms are enabling insights into the ever-growing amount of today's datasets by translating reoccurring data properties into compact representations. Yet, a practical problem arises: With increasing data volumes and…

Information Retrieval · Computer Science 2018-07-05 Michael Behrisch , Robert Krueger , Fritz Lekschas , Tobias Schreck , Nils Gehlenborg , Hanspeter Pfister

Feature attribution methods are popular in interpretable machine learning. These methods compute the attribution of each input feature to represent its importance, but there is no consensus on the definition of "attribution", leading to…

Machine Learning · Computer Science 2021-12-16 Yilun Zhou , Serena Booth , Marco Tulio Ribeiro , Julie Shah

Despite excellent performance of deep neural networks (DNNs) in image classification, detection, and prediction, characterizing how DNNs make a given decision remains an open problem, resulting in a number of interpretability methods.…

Machine Learning · Computer Science 2023-09-13 Lennart Brocki , Neo Christopher Chung

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Namhyuk Ahn , Wonhyuk Ahn , KiYoon Yoo , Daesik Kim , Seung-Hun Nam

The thriving research field of concept-based explainable artificial intelligence (C-XAI) investigates how human-interpretable semantic concepts embed in the latent spaces of deep neural networks (DNNs). Post-hoc approaches therein use a set…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Gesina Schwalbe , Georgii Mikriukov , Edgar Heinert , Stavros Gerolymatos , Mert Keser , Alois Knoll , Matthias Rottmann , Annika Mütze

By providing substantial amounts of data and standardized evaluation protocols, datasets in computer vision have helped fuel advances across all areas of visual recognition. But even in light of breakthrough results on recent benchmarks, it…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Brandon RichardWebster , Samuel E. Anthony , Walter J. Scheirer

Temporal prediction is inherently uncertain, but representing the ambiguity in natural image sequences is a challenging high-dimensional probabilistic inference problem. For natural scenes, the curse of dimensionality renders explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Pierre-Étienne H. Fiquet , Eero P. Simoncelli

Feature attribution aims to explain the reasoning behind a black-box model's prediction by identifying the impact of each feature on the prediction. Recent work has extended feature attribution to interactions between multiple features.…

Machine Learning · Computer Science 2023-05-17 Yifan Jiang , Shane Steinert-Threlkeld

Visual tracking has made significant improvements in the past few decades. Most existing state-of-the-art trackers 1) merely aim for performance in ideal conditions while overlooking the real-world conditions; 2) adopt the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ziang Cao , Ziyuan Huang , Liang Pan , Shiwei Zhang , Ziwei Liu , Changhong Fu

Modeling car-following behavior is fundamental to microscopic traffic simulation, yet traditional deterministic models often fail to capture the full extent of variability and unpredictability in human driving. While many modern approaches…

Applications · Statistics 2026-01-30 Chengyuan Zhang , Zhengbing He , Cathy Wu , Lijun Sun

Interpretability research takes counterfactual theories of causality for granted. Most causal methods rely on counterfactual interventions to inputs or the activations of particular model components, followed by observations of the change…

Machine Learning · Computer Science 2024-07-08 Aaron Mueller

A variety of methods exist to explain image classification models. However, whether they provide any benefit to users over simply comparing various inputs and the model's respective predictions remains unclear. We conducted a user study…

Machine Learning · Computer Science 2022-04-26 Leon Sixt , Martin Schuessler , Oana-Iuliana Popescu , Philipp Weiß , Tim Landgraf

Concept-based machine learning methods have increasingly gained importance due to the growing interest in making neural networks interpretable. However, concept annotations are generally challenging to obtain, making it crucial to leverage…

Machine Learning · Computer Science 2024-11-06 Alba Carballo-Castro , Sonia Laguna , Moritz Vandenhirtz , Julia E. Vogt

Many research efforts have been committed to unsupervised domain adaptation (DA) problems that transfer knowledge learned from a labeled source domain to an unlabeled target domain. Various DA methods have achieved remarkable results…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Wenxiao Xiao , Zhengming Ding , Hongfu Liu

Graph Neural Networks (GNNs) achieve strong performance on node classification tasks but remain difficult to interpret, particularly with respect to which input features drive their predictions. Existing global GNN explainers operate at the…

Machine Learning · Computer Science 2026-05-06 Rishi Raj Sahoo , Subhankar Mishra

Causal additive models provide a tractable yet expressive framework for causal discovery in the presence of hidden variables. When unobserved backdoor or causal paths exist between two variables, their causal relationship is often…

Machine Learning · Computer Science 2026-05-25 Thong Pham , Takashi Nicholas Maeda , Shohei Shimizu