English
Related papers

Related papers: Interpretable and Fine-Grained Visual Explanations…

200 papers

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev

As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Sam Sattarzadeh , Mahesh Sudhakar , Anthony Lem , Shervin Mehryar , K. N. Plataniotis , Jongseong Jang , Hyunwoo Kim , Yeonjeong Jeong , Sangmin Lee , Kyunghoon Bae

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Image representations, from SIFT and bag of visual words to Convolutional Neural Networks (CNNs) are a crucial component of almost all computer vision systems. However, our understanding of them remains limited. In this paper we study…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Aravindh Mahendran , Andrea Vedaldi

Saliency post-hoc explainability methods are important tools for understanding increasingly complex NLP models. While these methods can reflect the model's reasoning, they may not align with human intuition, making the explanations not…

Computation and Language · Computer Science 2024-08-20 Lucas E. Resck , Marcos M. Raimundo , Jorge Poco

Revealing the transparency of Deep Neural Networks (DNNs) has been widely studied to describe the decision mechanisms of network inner structures. In this paper, we propose a novel post-hoc framework, Unfold and Conquer Attribution Guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jung-Ho Hong , Woo-Jeoung Nam , Kyu-Sung Jeon , Seong-Whan Lee

Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use. Explaining models helps to address the safety and ethical concerns and is essential for…

Computation and Language · Computer Science 2023-11-29 Andreas Madsen , Siva Reddy , Sarath Chandar

While deep neural network models offer unmatched classification performance, they are prone to learning spurious correlations in the data. Such dependencies on confounding information can be difficult to detect using performance metrics if…

Machine Learning · Computer Science 2023-08-09 Susu Sun , Lisa M. Koch , Christian F. Baumgartner

Visual arguments, often used in advertising or social causes, rely on images to persuade viewers to do or believe something. Understanding these arguments requires selective vision: only specific visual stimuli within an image are relevant…

Computation and Language · Computer Science 2024-10-24 Jiwan Chung , Sungjae Lee , Minseo Kim , Seungju Han , Ashkan Yousefpour , Jack Hessel , Youngjae Yu

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

While deep learning surpasses human-level performance in narrow and specific vision tasks, it is fragile and over-confident in classification. For example, minor transformations in perspective, illumination, or object deformation in the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Maryam Daniali , Edward Kim

Interpreting the decisions of complex computer vision models is crucial to establish trust and accountability, especially in safety-critical domains. An established approach to interpretability is generating visual attribution maps that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 David Schinagl , Christian Fruhwirth-Reisinger , Alexander Prutsch , Samuel Schulter , Horst Possegger

Originally inspired by game-theory, path attribution framework stands out among the post-hoc model interpretation tools due to its axiomatic nature. However, recent developments show that this framework can still suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Naveed Akhtar , Muhammad A. A. K. Jalwana

There have been several post-hoc explanation approaches developed to explain pre-trained black-box neural networks. However, there is still a gap in research efforts toward designing neural networks that are inherently explainable. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Subash Khanal , Benjamin Brodie , Xin Xing , Ai-Ling Lin , Nathan Jacobs

We propose a novel and low-cost test-time adversarial defense by devising interpretability-guided neuron importance ranking methods to identify neurons important to the output classes. Our method is a training-free approach that can…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Akshay Kulkarni , Tsui-Wei Weng

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Binh X. Nguyen , Tuong Do , Huy Tran , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Deep convolutional neural networks have proven their effectiveness, and have been acknowledged as the most dominant method for image classification. However, a severe drawback of deep convolutional neural networks is poor explainability.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Bin Wang , Wenbin Pei , Bing Xue , Mengjie Zhang

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Recently, deep learning has been advancing the state of the art in artificial intelligence to a new level, and humans rely on artificial intelligence techniques more than ever. However, even with such unprecedented advancements, the lack of…

Human-Computer Interaction · Computer Science 2018-04-10 Jaegul Choo , Shixia Liu

Clearly explaining a rationale for a classification decision to an end-user can be as important as the decision itself. Existing approaches for deep visual recognition are generally opaque and do not output any justification text;…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Lisa Anne Hendricks , Zeynep Akata , Marcus Rohrbach , Jeff Donahue , Bernt Schiele , Trevor Darrell