English
Related papers

Related papers: Better Understanding Differences in Attribution Me…

200 papers

While deep learning models have demonstrated remarkable success in numerous domains, their black-box nature remains a significant limitation, especially in critical fields such as medical image analysis and inference. Existing…

Machine Learning · Computer Science 2025-05-13 David Zucker

This article presents the prediction difference analysis method for visualizing the response of a deep neural network to a specific input. When classifying images, the method highlights areas in a given input image that provide evidence for…

Computer Vision and Pattern Recognition · Computer Science 2017-02-16 Luisa M Zintgraf , Taco S Cohen , Tameem Adel , Max Welling

Explaining artificial intelligence (AI) predictions is increasingly important and even imperative in many high-stakes applications where humans are the ultimate decision-makers. In this work, we propose two novel architectures of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Giang Nguyen , Mohammad Reza Taesiri , Anh Nguyen

Recent work has suggested post-hoc explainers might be ineffective for detecting spurious correlations in Deep Neural Networks (DNNs). However, we show there are serious weaknesses with the existing evaluation frameworks for this setting.…

Machine Learning · Computer Science 2022-11-16 Shea Cardozo , Gabriel Islas Montero , Dmitry Kazhdan , Botty Dimanov , Maleakhi Wijaya , Mateja Jamnik , Pietro Lio

A vastly growing literature on explaining deep learning models has emerged. This paper contributes to that literature by introducing a global gradient-based model-agnostic method, which we call Marginal Attribution by Conditioning on…

Machine Learning · Statistics 2021-03-23 M. Merz , R. Richman , T. Tsanakas , M. V. Wüthrich

Multi-modal image fusion synthesizes information from multiple sources into a single image, facilitating downstream tasks such as semantic segmentation. Current approaches primarily focus on acquiring informative fusion images at the visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Haowen Bai , Zixiang Zhao , Jiangshe Zhang , Baisong Jiang , Lilun Deng , Yukun Cui , Shuang Xu , Chunxia Zhang

As generative techniques become increasingly accessible, authentic visuals are frequently subjected to iterative alterations by various individuals employing a variety of tools. Currently, to avoid misinformation and ensure accountability,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zhiya Tan , Xin Zhang , Joey Tianyi Zhou

Although we have seen a proliferation of algorithms for recommending visualizations, these algorithms are rarely compared with one another, making it difficult to ascertain which algorithm is best for a given visual analysis scenario.…

Human-Computer Interaction · Computer Science 2021-09-08 Zehua Zeng , Phoebe Moh , Fan Du , Jane Hoffswell , Tak Yeon Lee , Sana Malik , Eunyee Koh , Leilani Battle

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

Recent research has demonstrated that feature attribution methods for deep networks can themselves be incorporated into training; these attribution priors optimize for a model whose attributions have certain desirable properties -- most…

Machine Learning · Computer Science 2020-11-12 Gabriel Erion , Joseph D. Janizek , Pascal Sturmfels , Scott Lundberg , Su-In Lee

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

Attentional Neural Network is a new framework that integrates top-down cognitive bias and bottom-up feature extraction in one coherent architecture. The top-down influence is especially effective when dealing with high noise or difficult…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Qian Wang , Jiaxing Zhang , Sen Song , Zheng Zhang

Deep neural networks have exhibited remarkable performance across a wide range of real-world tasks. However, comprehending the underlying reasons for their effectiveness remains a challenging problem. Interpreting deep neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Chenxu Zhao , Wei Qian , Yucheng Shi , Mengdi Huai , Ninghao Liu

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

Machine Learning · Computer Science 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

While diffusion models excel at image generation, their growing adoption raises critical concerns about copyright issues and model transparency. Existing attribution methods identify training examples influencing an entire image, but fall…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yonghyun Park , Chieh-Hsin Lai , Satoshi Hayakawa , Yuhta Takida , Naoki Murata , Wei-Hsiang Liao , Woosung Choi , Kin Wai Cheuk , Junghyun Koo , Yuki Mitsufuji

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

Data attribution methods aim to answer useful counterfactual questions like "what would a ML model's prediction be if it were trained on a different dataset?" However, estimation of data attribution models through techniques like empirical…

Machine Learning · Computer Science 2025-08-19 Ari Karchmer , Martin Pawelczyk , Seth Neel

We introduce FAIR-SIGHT, an innovative post-hoc framework designed to ensure fairness in computer vision systems by combining conformal prediction with a dynamic output repair mechanism. Our approach calculates a fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Arya Fayyazi , Mehdi Kamal , Massoud Pedram

As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Sam Sattarzadeh , Mahesh Sudhakar , Anthony Lem , Shervin Mehryar , K. N. Plataniotis , Jongseong Jang , Hyunwoo Kim , Yeonjeong Jeong , Sangmin Lee , Kyunghoon Bae