English

Methods for Estimating Neural Information

Neurons and Cognition 2023-04-05 v1 Information Theory math.IT
Authors: James V Stone
View on arXiv ↗ PDF ↗

Abstract

Estimating the Shannon information associated with individual neurons is a non-trivial problem. Three key methods used to estimate the mutual information between neuron inputs and outputs are described, and a list of further readings is provided.

Keywords

neural coding computational neuroscience

Cite

@article{arxiv.2304.01348,
  title  = {Methods for Estimating Neural Information},
  author = {James V Stone},
  journal= {arXiv preprint arXiv:2304.01348},
  year   = {2023}
}

Comments

7 pages, 2 figures

Related papers

View all related →
Neurons and Cognition · Quantitative Biology
Quantifying the information transmitted in a single stimulus
Michele Bezzi
2007-05-23
Neurons and Cognition · Quantitative Biology
Does a larger neural network mean greater information transmission efficiency?
Bartosz Paprocki, Agnieszka Pregowska, Janusz Szczepanski
2023-07-26
Information Theory · Computer Science
Estimating mutual information and multi--information in large networks
Noam Slonim, Gurinder S. Atwal, Gasper Tkacik, William Bialek
2007-07-13
Computation and Language · Computer Science
Evaluating Neuron Interpretation Methods of NLP Models
Yimin Fan, Fahim Dalvi, Nadir Durrani, Hassan Sajjad
2023-11-07
Signal Processing · Electrical Eng. & Systems
Bounds on mutual information of mixture data for classification tasks
Yijun Ding, Amit Ashok
2022-06-22
Neurons and Cognition · Quantitative Biology
Estimation of neural connections from partially observed neural spikes
Taishi Iwasaki, Hideitsu Hino, Masami Tatsuno, Shotaro Akaho +1
2018-01-23
Disordered Systems and Neural Networks · Physics
Independent neurons representing a finite set of stimuli: dependence of the mutual information on the number of units sampled
Ines Samengo
2007-05-23
Applications · Statistics
Estimating the number of neurons in multi-neuronal spike trains
Mengxin Li, Wei-Liem Loh
2011-04-15
Information Theory · Computer Science
On Study of Mutual Information and its Estimation Methods
Marshal Arijona Sinaga
2021-06-29
Disordered Systems and Neural Networks · Physics
Representational capacity of a set of independent neurons
Ines Samengo, Alessandro Treves
2007-05-23
Information Theory · Computer Science
How do correlations shape the landscape of information?
Ching-Peng Huang
2024-05-27
Neurons and Cognition · Quantitative Biology
Neural computation from first principles: Using the maximum entropy method to obtain an optimal bits-per-joule neuron
William B Levy, Toby Berger, Mustafa Sungkar
2017-12-21
Computation and Language · Computer Science
Neuron-Level Knowledge Attribution in Large Language Models
Zeping Yu, Sophia Ananiadou
2024-09-26
Machine Learning · Computer Science
Where is the Information in a Deep Neural Network?
Alessandro Achille, Giovanni Paolini, Stefano Soatto
2020-06-23
Neurons and Cognition · Quantitative Biology
A symbolic information approach applied to human intracranial data to characterize and distinguish different congnitive processes
Ícaro Rodolfo Soares Coelho Da Paz, Pedro F. A. Silva, Helena Bordini de Lucas, Sérgio H. A. Lira +2
2024-04-30
General Physics · Physics
Network analysis method: correlation values between two arbitrary points on a network
Akira Saito
2017-06-13
Neurons and Cognition · Quantitative Biology
Inferring and Learning from Neuronal Correspondences
Ashish Kapoor, E. Paxon Frady, Stefanie Jegelka, William B. Kristan +1
2015-01-28
Machine Learning · Computer Science
Linear Explanations for Individual Neurons
Tuomas Oikarinen, Tsui-Wei Weng
2024-05-14
Information Theory · Computer Science
Information-Theoretic Bounds and Approximations in Neural Population Coding
Wentao Huang, Kechen Zhang
2018-04-02
Machine Learning · Computer Science
Detecting unusual input to neural networks
Jörg Martin, Clemens Elster
2020-06-16
Neurons and Cognition · Quantitative Biology
Summary of Information Theoretic Quantities
Robin A. A. Ince, Stefano Panzeri, Simon R. Schultz
2015-01-09
Information Theory · Computer Science
InfoNet: Neural Estimation of Mutual Information without Test-Time Optimization
Zhengyang Hu, Song Kang, Qunsong Zeng, Kaibin Huang +1
2024-02-16
Neurons and Cognition · Quantitative Biology
Estimating Information-Theoretic Quantities
Robin A. A. Ince, Simon R. Schultz, Stefano Panzeri
2015-01-09
Information Theory · Computer Science
Multi-scale information content measurement method based on Shannon information
Zsolt Pocze
2023-05-23
Networking and Internet Architecture · Computer Science
Cognitive Information Measurements: A New Perspective
Min Chen, Yixue Hao, Hamid Gharavi, Victor C. M. Leung
2019-07-04
R2 v1 2026-06-28T09:47:47.945Z