English
Related papers

Related papers: Shapley Interpretation and Activation in Neural Ne…

200 papers

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in training datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Mohamed Trabelsi , Huseyin Uzunalioglu , Dan Kushnir

We study the use of binary activated neural networks as interpretable and explainable predictors in the context of regression tasks on tabular data; more specifically, we provide guarantees on their expressiveness, present an approach based…

Machine Learning · Computer Science 2024-06-11 Benjamin Leblanc , Pascal Germain

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

Machine Learning · Computer Science 2021-04-26 Ian Covert , Su-In Lee

The application of the deep learning model in classification plays an important role in the accurate detection of the target objects. However, the accuracy is affected by the activation function in the hidden and output layer. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Md. Mehedi Hasan , Md. Ali Hossain , Azmain Yakin Srizon , Abu Sayeed

Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines…

Machine Learning · Computer Science 2024-05-21 Shuyang Liu , Zixuan Chen , Ge Shi , Ji Wang , Changjie Fan , Yu Xiong , Runze Wu Yujing Hu , Ze Ji , Yang Gao

In this paper, we propose a Shapley value based method to evaluate operation contribution (Shapley-NAS) for neural architecture search. Differentiable architecture search (DARTS) acquires the optimal architectures by optimizing the…

Machine Learning · Computer Science 2022-06-22 Han Xiao , Ziwei Wang , Zheng Zhu , Jie Zhou , Jiwen Lu

Interpreting complex neural networks is crucial for understanding their decision-making processes, particularly in applications where transparency and accountability are essential. This proposed method addresses this need by focusing on…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Deepshikha Bhati , Fnu Neha , Md Amiruzzaman , Angela Guercio , Deepak Kumar Shukla , Ben Ward

Segmentation is the identification of anatomical regions of interest, such as organs, tissue, and lesions, serving as a fundamental task in computer-aided diagnosis in medical imaging. Although deep learning models have achieved remarkable…

Image and Video Processing · Electrical Eng. & Systems 2025-12-09 Tianyi Ren , Daniel Low , Pittra Jaengprajak , Juampablo Heras Rivera , Jacob Ruzevick , Mehmet Kurt

We introduce switched linear projections for expressing the activity of a neuron in a deep neural network in terms of a single linear projection in the input space. The method works by isolating the active subnetwork, a series of linear…

Machine Learning · Computer Science 2020-02-10 Lech Szymanski , Brendan McCane , Craig Atkinson

We consider the problem of learning an arbitrarily-biased ReLU activation (or neuron) over Gaussian marginals with the squared loss objective. Despite the ReLU neuron being the basic building block of modern neural networks, we still do not…

Machine Learning · Computer Science 2026-02-04 Anxin Guo , Aravindan Vijayaraghavan

For reinforcement learning systems to be widely adopted, their users must understand and trust them. We present a theoretical analysis of explaining reinforcement learning using Shapley values, following a principled approach from game…

Machine Learning · Computer Science 2023-06-12 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Deep Neural Networks are widely used in academy as well as corporate and public applications, including safety critical applications such as health care and autonomous driving. The ability to explain their output is critical for safety…

Machine Learning · Computer Science 2024-03-14 Florian Eilers , Xiaoyi Jiang

Neural networks are powerful functions with widespread use, but the theoretical behaviour of these functions is not fully understood. Creating deep neural networks by stacking many layers has achieved exceptional performance in many…

Machine Learning · Computer Science 2024-08-16 Cameron Jakub , Mihai Nica

Rectified linear activation units are important components for state-of-the-art deep convolutional networks. In this paper, we propose a novel S-shaped rectified linear activation unit (SReLU) to learn both convex and non-convex functions,…

Computer Vision and Pattern Recognition · Computer Science 2015-12-23 Xiaojie Jin , Chunyan Xu , Jiashi Feng , Yunchao Wei , Junjun Xiong , Shuicheng Yan

This paper investigates the ability of finite samples to identify two-layer irreducible shallow networks with various nonlinear activation functions, including rectified linear units (ReLU) and analytic functions such as the logistic…

Machine Learning · Computer Science 2025-03-18 Yu Xia , Zhiqiang Xu

Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to attribute model predictions to specific input features. However, computing Shapley values exactly is…

Machine Learning · Computer Science 2025-03-11 Christopher Musco , R. Teal Witter

Graph Neural Networks (GNNs) have demonstrated remarkable performance in various graph-based machine learning tasks, yet evaluating the importance of neighbors of testing nodes remains largely unexplored due to the challenge of assessing…

Machine Learning · Computer Science 2025-03-25 Hongliang Chi , Qiong Wu , Zhengyi Zhou , Yao Ma

The simulation of human neurons and neurotransmission mechanisms has been realized in deep neural networks based on the theoretical implementations of activation functions. However, recent studies have reported that the threshold potential…

Machine Learning · Computer Science 2023-05-11 Kyungsu Lee , Jaeseung Yang , Haeyun Lee , Jae Youn Hwang

The value and copyright of training data are crucial in the artificial intelligence industry. Service platforms should protect data providers' legitimate rights and fairly reward them for their contributions. Shapley value, a potent tool…

Machine Learning · Computer Science 2025-11-21 Haifeng Sun , Yu Xiong , Runze Wu , Xinyu Cai , Changjie Fan , Lan Zhang , Xiang-Yang Li

As modern deep learning architectures grow in complexity, representational ambiguity emerges as a critical barrier to their interpretability and reliable merging. For ReLU networks, identical functional mappings can be achieved through…

Machine Learning · Computer Science 2026-04-21 Kutomanov Hennadii