English
Related papers

Related papers: Neuron Shapley: Discovering the Responsible Neuron…

200 papers

Comparing representations of complex stimuli in neural network layers to human brain representations or behavioral judgments can guide model development. However, even qualitatively distinct neural network models often predict similar…

Neurons and Cognition · Quantitative Biology 2022-11-29 Tal Golan , Wenxuan Guo , Heiko H. Schütt , Nikolaus Kriegeskorte

The Shapley value is widely regarded as a trustworthy attribution metric. However, when people use Shapley values to explain the attribution of input variables of a deep neural network (DNN), it usually requires a very high computational…

Machine Learning · Computer Science 2023-12-04 Lu Chen , Siyu Lou , Keyan Zhang , Jin Huang , Quanshi Zhang

Structured pruning is a well-known technique to reduce the storage size and inference cost of neural networks. The usual pruning pipeline consists of ranking the network internal filters and activations with respect to their contributions…

Machine Learning · Computer Science 2020-06-03 Marco Ancona , Cengiz Öztireli , Markus Gross

This paper aims to explain deep neural networks (DNNs) from the perspective of multivariate interactions. In this paper, we define and quantify the significance of interactions among multiple input variables of the DNN. Input variables with…

Machine Learning · Computer Science 2021-02-04 Hao Zhang , Yichen Xie , Longjie Zheng , Die Zhang , Quanshi Zhang

NLP models often rely on superficial cues known as dataset biases to achieve impressive performance, and can fail on examples where these biases do not hold. Recent work sought to develop robust, unbiased models by filtering biased examples…

Computation and Language · Computer Science 2023-05-31 Yuval Reif , Roy Schwartz

The segmentation of cells and neurites in microscopy images of neuronal networks provides valuable quantitative information about neuron growth and neuronal differentiation, including the number of cells, neurites, neurite length and…

Quantitative Methods · Quantitative Biology 2023-10-20 Ka My Dang , Yi Jia Zhang , Tianchen Zhang , Chao Wang , Anton Sinner , Piero Coronica , Joyce K. S. Poon

Brain network is an important tool for understanding the brain, offering insights for scientific research and clinical diagnosis. Existing models for brain networks typically primarily focus on brain regions or overlook the complexity of…

Neurons and Cognition · Quantitative Biology 2024-05-30 Haoyu Hu , Hongrun Zhang , Chao Li

Deep convolutional neural networks (DCNNs) have become the state-of-the-art computational models of biological object recognition. Their remarkable success has helped vision science break new ground and recent efforts have started to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Leonard E. van Dyck , Walter R. Gruber

Understanding the inner working mechanism of deep neural networks (DNNs) is essential and important for researchers to design and improve the performance of DNNs. In this work, the entropy analysis is leveraged to study the neurons…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Longwei Wang , Peijie Chen

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper

Shapley additive explanations (SHAP) are widely recognised as computationally intractable for neural networks, since they induce an exponential search space over the input features. In this work, we take a first step towards scaling exact…

Machine Learning · Computer Science 2026-05-26 David Boetius , Shahaf Bassan , Guy Katz , Stefan Leue , Tobias Sutter

Deep learning has excelled in image recognition tasks through neural networks inspired by the human brain. However, the necessity for large models to improve prediction accuracy introduces significant computational demands and extended…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taigo Sakai , Kazuhiro Hotta

Understanding why a neural network model makes certain decisions can be as important as the inference performance. Various methods have been proposed to help practitioners explain the prediction of a neural network model, of which Shapley…

Machine Learning · Computer Science 2023-10-04 Yong Zhao , Runxin He , Nicholas Kersting , Can Liu , Shubham Agrawal , Chiranjeet Chetia , Yu Gu

Interpreting complex neural networks is crucial for understanding their decision-making processes, particularly in applications where transparency and accountability are essential. This proposed method addresses this need by focusing on…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Deepshikha Bhati , Fnu Neha , Md Amiruzzaman , Angela Guercio , Deepak Kumar Shukla , Ben Ward

Vision Transformer models exhibit immense power yet remain opaque to human understanding, posing challenges and risks for practical applications. While prior research has attempted to demystify these models through input attribution and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yifan Wang , Yifei Liu , Yingdong Shi , Changming Li , Anqi Pang , Sibei Yang , Jingyi Yu , Kan Ren

In this paper, we propose a new deep framework which predicts facial attributes and leverage it as a soft modality to improve face identification performance. Our model is an end to end framework which consists of a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Fariborz Taherkhani , Nasser M. Nasrabadi , Jeremy Dawson

High quality explanations of neural networks (NNs) should exhibit two key properties. Completeness ensures that they accurately reflect a network's function and interpretability makes them understandable to humans. Many existing methods…

Machine Learning · Computer Science 2025-03-20 Nolan Dey , Eric Taylor , Alexander Wong , Bryan Tripp , Graham W. Taylor

Deep neural networks demonstrate to have a high performance on image classification tasks while being more difficult to train. Due to the complexity and vanishing gradient problem, it normally takes a lot of time and more computational…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Mohammad Sadegh Ebrahimi , Hossein Karkeh Abadi

We propose a guided dropout regularizer for deep networks based on the evidence of a network prediction defined as the firing of neurons in specific paths. In this work, we utilize the evidence at each neuron to determine the probability of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Andrea Zunino , Sarah Adel Bargal , Pietro Morerio , Jianming Zhang , Stan Sclaroff , Vittorio Murino

Explainable artificial intelligence (XAI) holds immense significance in enhancing the deep neural network's transparency and credibility, particularly in some risky and high-cost scenarios, like synthetic aperture radar (SAR). Shapley is a…

Artificial Intelligence · Computer Science 2024-01-09 Xuran Hu , Mingzhe Zhu , Yuanjing Liu , Zhenpeng Feng , LJubisa Stankovic