English
Related papers

Related papers: Towards Visually Explaining Video Understanding Ne…

200 papers

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

This article presents the prediction difference analysis method for visualizing the response of a deep neural network to a specific input. When classifying images, the method highlights areas in a given input image that provide evidence for…

Computer Vision and Pattern Recognition · Computer Science 2017-02-16 Luisa M Zintgraf , Taco S Cohen , Tameem Adel , Max Welling

This paper presents an interactive technique to explain visual patterns in network visualizations to analysts who do not understand these visualizations and who are learning to read them. Learning a visualization requires mastering its…

Human-Computer Interaction · Computer Science 2024-08-05 Xinhuan Shu , Alexis Pister , Junxiu Tang , Fanny Chevalier , Benjamin Bach

Explaining decisions of black-box classifiers is paramount in sensitive domains such as medical imaging since clinicians confidence is necessary for adoption. Various explanation approaches have been proposed, among which perturbation based…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Martin Charachon , Céline Hudelot , Paul-Henry Cournède , Camille Ruppli , Roberto Ardon

To verify and validate networks, it is essential to gain insight into their decisions, limitations as well as possible shortcomings of training data. In this work, we propose a post-hoc, optimization based visual explanation method, which…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Jörg Wagner , Jan Mathias Köhler , Tobias Gindele , Leon Hetzel , Jakob Thaddäus Wiedemer , Sven Behnke

The inherent "black box" nature of deep neural networks (DNNs) compromises their transparency and reliability. Recently, explainable AI (XAI) has garnered increasing attention from researchers. Several perturbation-based interpretations…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuran Hu , Mingzhe Zhu , Zhenpeng Feng , Miloš Daković , Ljubiša Stanković

Temporal Graph Neural Network (TGNN) has been receiving a lot of attention recently due to its capability in modeling time-evolving graph-related tasks. Similar to Graph Neural Networks, it is also non-trivial to interpret predictions made…

Machine Learning · Computer Science 2022-12-05 Minh N. Vu , My T. Thai

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Video understanding aims to enable models to perceive, reason about, and interact with the dynamic visual world. In contrast to image understanding, video understanding inherently requires modeling temporal dynamics and evolving visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhaochong An , Zirui Li , Mingqiao Ye , Feng Qiao , Jiaang Li , Zongwei Wu , Vishal Thengane , Chengzu Li , Lei Li , Luc Van Gool , Guolei Sun , Serge Belongie

Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them…

Machine Learning · Computer Science 2023-10-18 Thomas Decker , Michael Lebacher , Volker Tresp

While deep learning surpasses human-level performance in narrow and specific vision tasks, it is fragile and over-confident in classification. For example, minor transformations in perspective, illumination, or object deformation in the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Maryam Daniali , Edward Kim

Traditional deep learning interpretability methods which are suitable for model users cannot explain network behaviors at the global level and are inflexible at providing fine-grained explanations. As a solution, concept-based explanations…

Human-Computer Interaction · Computer Science 2022-10-26 Jinbin Huang , Aditi Mishra , Bum Chul Kwon , Chris Bryan

The ability of to explain neural network decisions goes hand in hand with their safe deployment. Several methods have been proposed to highlight features important for a given network decision. However, there is no consensus on how to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Agnieszka Grabska-Barwińska

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Visual explanations are logical arguments based on visual features that justify the predictions made by neural networks. Current modes of visual explanations answer questions of the form $`Why \text{ } P?'$. These $Why$ questions operate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Mohit Prabhushankar , Gukyeong Kwon , Dogancan Temel , Ghassan AlRegib

Neural networks are widely adopted to solve complex and challenging tasks. Especially in high-stakes decision-making, understanding their reasoning process is crucial, yet proves challenging for modern deep networks. Feature visualization…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Ada Gorgun , Bernt Schiele , Jonas Fischer

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

The practical impact of deep learning on complex supervised learning problems has been significant, so much so that almost every Artificial Intelligence problem, or at least a portion thereof, has been somehow recast as a deep learning…

Machine Learning · Statistics 2018-03-19 Housam Khalifa Bashier Babiker , Randy Goebel

Explaining deep learning models in a way that humans can easily understand is essential for responsible artificial intelligence applications. Attribution methods constitute an important area of explainable deep learning. The attribution…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Michal Byra , Henrik Skibbe