English
Related papers

Related papers: Neuron Shapley: Discovering the Responsible Neuron…

200 papers

Deep neural networks have gained momentum based on their accuracy, but their interpretability is often criticised. As a result, they are labelled as black boxes. In response, several methods have been proposed in the literature to explain…

Machine Learning · Computer Science 2022-07-05 Cosimo Izzo , Aldo Lipani , Ramin Okhrati , Francesca Medda

We developed a tool for visualizing and analyzing large pre-trained vision models by mapping them onto the brain, thus exposing their hidden inside. Our innovation arises from a surprising usage of brain encoding: predicting brain fMRI…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Huzheng Yang , James Gee , Jianbo Shi

The study of neuronal morphology is important not only for its potential relationship with neuronal dynamics, but also as a means to classify diverse types of cells and compare than among species, organs, and conditions. In the present…

Neurons and Cognition · Quantitative Biology 2024-03-11 Alexandre Benatti , Henrique F. de Arruda , Luciano da F. Costa

Deep learning techniques are increasingly being adopted for classification tasks over the past decade, yet explaining how deep learning architectures can achieve state-of-the-art performance is still an elusive goal. While all the training…

Machine Learning · Computer Science 2021-10-12 Sakib Mostafa , Debajyoti Mondal

Deep neural networks (DNNs) demonstrate outstanding performance across most computer vision tasks. Some critical applications, such as autonomous driving or medical imaging, also require investigation into their behavior and the reasons…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly , Xavier Fischer

The brain processes information through many layers of neurons. This deep architecture is representationally powerful, but it complicates learning by making it hard to identify the responsible neurons when a mistake is made. In machine…

Neurons and Cognition · Quantitative Biology 2014-11-04 Timothy P. Lillicrap , Daniel Cownden , Douglas B. Tweed , Colin J. Akerman

Deciding the amount of neurons during the design of a deep neural network to maximize performance is not intuitive. In this work, we attempt to search for the neuron (filter) configuration of a fixed network architecture that maximizes…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Eugene Lee , Chen-Yi Lee

Detection of cell nuclei in microscopic images is a challenging research topic, because of limitations in cellular image quality and diversity of nuclear morphology, i.e. varying nuclei shapes, sizes, and overlaps between multiple cell…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Mohammad Tofighi , Tiantong Guo , Jairam K. P. Vanamala , Vishal Monga

Large Language Models have demonstrated remarkable capabilities on multiple-choice question answering benchmarks, but the complex mechanisms underlying their large-scale neurons remain opaque, posing significant challenges for understanding…

Computation and Language · Computer Science 2026-03-06 Wenjie Li , Guansong Pang , Hezhe Qiao , Debin Gao , David Lo

Deep neural networks (DNNs) have achieved superior performance in various prediction tasks, but can be very vulnerable to adversarial examples or perturbations. Therefore, it is crucial to measure the sensitivity of DNNs to various forms of…

Machine Learning · Statistics 2019-12-23 Hai Shu , Hongtu Zhu

Visual perception relies on inference of 3D scene properties such as shape, pose, and lighting. To understand how visual sensory neurons enable robust perception, it is crucial to characterize their selectivity to such physically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Pavithra Elumalai , Mohammad Bashiri , Goirik Chakrabarty , Suhas Shrinivasan , Fabian H. Sinz

Despite deep learning (DL) has achieved remarkable progress in various domains, the DL models are still prone to making mistakes. This issue necessitates effective debugging tools for DL practitioners to interpret the decision-making…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yeong-Joon Ju , Ji-Hoon Park , Seong-Whan Lee

Classification of biological neuron types and networks poses challenges to the full understanding of the brain's organisation and functioning. In this paper, we develop a novel objective classification model of biological neuronal types and…

Neurons and Cognition · Quantitative Biology 2020-03-31 Michael Taynnan Barros , Harun Siljak , Peter Mullen , Constantinos Papadias , Jari Hyttinen , Nicola Marchetti

The robust estimation of dynamically changing features, such as the position of prey, is one of the hallmarks of perception. On an abstract, algorithmic level, nonlinear Bayesian filtering, i.e. the estimation of temporally changing signals…

Neurons and Cognition · Quantitative Biology 2022-01-05 Anna Kutschireiter , Simone Carlo Surace , Henning Sprekeler , Jean-Pascal Pfister

The need for more transparency of the decision-making processes in artificial neural networks steadily increases driven by their applications in safety critical and ethically challenging domains such as autonomous driving or medical…

Neural and Evolutionary Computing · Computer Science 2020-05-12 Richard Meyes , Constantin Waubert de Puiseau , Andres Posada-Moreno , Tobias Meisen

Neuron identification is a popular tool in mechanistic interpretability, aiming to uncover the human-interpretable concepts represented by individual neurons in deep networks. While algorithms such as Network Dissection and CLIP-Dissect…

Artificial Intelligence · Computer Science 2025-12-23 Ge Yan , Tuomas Oikarinen , Tsui-Wei , Weng

Recently, deep feedforward neural networks have achieved considerable success in modeling biological sensory processing, in terms of reproducing the input-output map of sensory neurons. However, such models raise profound questions about…

Neurons and Cognition · Quantitative Biology 2019-12-16 Hidenori Tanaka , Aran Nayebi , Niru Maheswaranathan , Lane McIntosh , Stephen A. Baccus , Surya Ganguli

Deep neural networks (DNNs) are being utilized in various aspects of our daily lives, including high-stakes decision-making applications that impact individuals. However, these systems reflect and amplify bias from the data used during…

Machine Learning · Computer Science 2025-08-12 Moses Openja , Paolo Arcaini , Foutse Khomh , Fuyuki Ishikawa

Artificial neural networks are functions depending on a finite number of parameters typically encoded as weights and biases. The identification of the parameters of the network from finite samples of input-output pairs is often referred to…

Machine Learning · Computer Science 2022-11-10 Massimo Fornasier , Timo Klock , Marco Mondelli , Michael Rauchensteiner

We study the use of binary activated neural networks as interpretable and explainable predictors in the context of regression tasks on tabular data; more specifically, we provide guarantees on their expressiveness, present an approach based…

Machine Learning · Computer Science 2024-06-11 Benjamin Leblanc , Pascal Germain