English
Related papers

Related papers: DiG-IN: Diffusion Guidance for Investigating Netwo…

200 papers

Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-play black-box…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Nikolaos Spanos , Maria Lymperaiou , Giorgos Filandrianos , Konstantinos Thomas , Athanasios Voulodimos , Giorgos Stamou

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

The continued improvements in the predictive accuracy of machine learning models have allowed for their widespread practical application. Yet, many decisions made with seemingly accurate models still require verification by domain experts.…

Human-Computer Interaction · Computer Science 2020-03-06 Oscar Gomez , Steffen Holter , Jun Yuan , Enrico Bertini

Artificial intelligence is increasingly leveraged across various domains to automate decision-making processes that significantly impact human lives. In medical image analysis, deep learning models have demonstrated remarkable performance.…

Machine Learning · Computer Science 2025-07-28 Julia Siekiera , Stefan Kramer

To classify images based on their content is one of the most studied topics in the field of computer vision. Nowadays, this problem can be addressed using modern techniques such as Convolutional Neural Networks (CNN), but over the years…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Òscar Lorente , Ian Riera , Aditya Rana

How can we understand classification decisions made by deep neural networks? Many existing explainability methods rely solely on correlations and fail to account for confounding, which may result in potentially misleading explanations. To…

Machine Learning · Computer Science 2020-03-02 Yash Goyal , Amir Feder , Uri Shalit , Been Kim

Deep Neural networks have gained lots of attention in recent years thanks to the breakthroughs obtained in the field of Computer Vision. However, despite their popularity, it has been shown that they provide limited robustness in their…

Machine Learning · Computer Science 2020-08-21 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

It is no secret that pornographic material is now a one-click-away from everyone, including children and minors. General social media networks are striving to isolate adult images and videos from normal ones. Intelligent image analysis…

Computer Vision and Pattern Recognition · Computer Science 2015-12-01 Mohamed Moustafa

In the computer vision community, Convolutional Neural Networks (CNNs), first proposed in the 1980's, have become the standard visual classification model. Recently, as alternatives to CNNs, Capsule Networks (CapsNets) and Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Jindong Gu

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

The ability of to explain neural network decisions goes hand in hand with their safe deployment. Several methods have been proposed to highlight features important for a given network decision. However, there is no consensus on how to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Agnieszka Grabska-Barwińska

Counterfactual explanations (CEs) aim to enhance the interpretability of machine learning models by illustrating how alterations in input features would affect the resulting predictions. Common CE approaches require an additional model and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Matan Atad , David Schinz , Hendrik Moeller , Robert Graf , Benedikt Wiestler , Daniel Rueckert , Nassir Navab , Jan S. Kirschke , Matthias Keicher

Deep neural networks have demonstrated superior performance in artificial intelligence applications, but the opaqueness of their inner working mechanism is one major drawback in their application. The prevailing unit-based interpretation is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Lei Lyu , Chen Pang , Jihua Wang

Convolutional Neural Networks (CNNs) currently achieve state-of-the-art accuracy in image classification. With a growing number of classes, the accuracy usually drops as the possibilities of confusion increase. Interestingly, the class…

Computer Vision and Pattern Recognition · Computer Science 2017-10-25 Bilal Alsallakh , Amin Jourabloo , Mao Ye , Xiaoming Liu , Liu Ren

Understanding and explaining the mistakes made by trained models is critical to many machine learning objectives, such as improving robustness, addressing concept drift, and mitigating biases. However, this is often an ad hoc process that…

Machine Learning · Computer Science 2022-06-16 Abubakar Abid , Mert Yuksekgonul , James Zou

Interpreting a large number of neurons in deep learning is difficult. Our proposed `CLAssifier-DECoder' architecture (ClaDec) facilitates the understanding of the output of an arbitrary layer of neurons or subsets thereof. It uses a decoder…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Johannes Schneider , Michail Vlachos

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Humans are able to categorize images very efficiently, in particular to detect the presence of an animal very quickly. Recently, deep learning algorithms based on convolutional neural networks (CNNs) have achieved higher than human accuracy…

Neurons and Cognition · Quantitative Biology 2023-06-01 Jean-Nicolas Jérémie , Laurent U Perrinet

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki