English
Related papers

Related papers: From the entropy to the statistical structure of s…

200 papers

We derive a synaptic weight update rule for learning temporally precise spike train to spike train transformations in multilayer feedforward networks of spiking neurons. The framework, aimed at seamlessly generalizing error backpropagation…

Neural and Evolutionary Computing · Computer Science 2016-01-11 Arunava Banerjee

Understanding the structural complexity and predictability of complex networks is a central challenge in network science. Although recent studies have revealed a relationship between compression-based entropy and link prediction…

Social and Information Networks · Computer Science 2025-10-14 Sebastián Brzovic , Cristóbal Rojas , Andrés Abeliuk

As experiments advance to record from tens of thousands of neurons, statistical physics provides a framework for understanding how collective activity emerges from networks of fine-scale correlations. While modeling these populations is…

Biological Physics · Physics 2024-12-25 David P. Carcamo , Christopher W. Lynn

Stochastic processes under resetting at random times have attracted a lot of attention in recent years and served as illustrations of nontrivial and interesting static and dynamic features of stochastic dynamics. In this paper, we aim to…

Statistical Mechanics · Physics 2025-06-18 Yating Wang , Hanshuang Chen

Motivated by robotic surveillance applications, this paper studies the novel problem of maximizing the return time entropy of a Markov chain, subject to a graph topology with travel times and stationary distribution. The return time entropy…

Optimization and Control · Mathematics 2018-05-29 Xiaoming Duan , Mishel George , Francesco Bullo

This paper considers the use of recently proposed optimal transport-based multivariate test statistics, namely rank energy and its variant the soft rank energy derived from entropically regularized optimal transport, for the unsupervised…

Machine Learning · Statistics 2023-02-17 Matthew Werenski , Shoaib Bin Masud , James M. Murphy , Shuchin Aeron

Learning and memory in the brain are implemented by complex, time-varying changes in neural circuitry. The computational rules according to which synaptic weights change over time are the subject of much research, and are not precisely…

Machine Learning · Statistics 2014-11-18 Scott W. Linderman , Christopher H. Stock , Ryan P. Adams

Structural entropy is a metric that measures the amount of information embedded in graph structure data under a strategy of hierarchical abstracting. To measure the structural entropy of a dynamic graph, we need to decode the optimal…

Information Theory · Computer Science 2024-06-28 Runze Yang , Hao Peng , Chunyang Liu , Angsheng Li

Perceptions and actions, thoughts and memories result from coordinated activity in hundreds or even thousands of neurons in the brain. It is an old dream of the physics community to provide a statistical mechanics description for these and…

Disordered Systems and Neural Networks · Physics 2024-09-04 Leenoy Meshulam , William Bialek

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and study its…

Machine Learning · Statistics 2022-04-21 Lang Liu , Soumik Pal , Zaid Harchaoui

Measuring the complexity of tree structures can be beneficial in areas that use tree data structures for storage, communication, and processing purposes. This complexity can then be used to compress tree data structures to their…

Information Theory · Computer Science 2023-09-19 Amirmohammad Farzaneh , Mihai-Alin Badiu , Justin P. Coon

We wish to discriminate spike sequences based on the degree of irregularity. For this purpose, we search for a rational expressions of quadratic functions of consecutive interspike intervals that efficiently measures spiking irregularity.…

Neurons and Cognition · Quantitative Biology 2007-05-23 K. Miura , M. Okada , S. Shinomoto

Fueled in part by recent applications in neuroscience, the multivariate Hawkes process has become a popular tool for modeling the network of interactions among high-dimensional point process data. While evaluating the uncertainty of the…

Machine Learning · Statistics 2020-07-16 Xu Wang , Mladen Kolar , Ali Shojaie

We propose a method, based on persistent homology, to uncover topological properties of a priori unknown covariates of neuron activity. Our input data consist of spike train measurements of a set of neurons of interest, a candidate list of…

Neurons and Cognition · Quantitative Biology 2015-10-23 Gard Spreemann , Benjamin Dunn , Magnus Bakke Botnan , Nils A. Baas

We investigate the effect of electric synapses (gap junctions) on collective neuronal dynamics and spike statistics in a conductance-based Integrate-and-Fire neural network, driven by a Brownian noise, where conductances depend upon spike…

Biological Physics · Physics 2017-07-26 Rodrigo Cofré , Bruno Cessac

The determination of block-entropies is a well established method for the investigation of discrete data, also called symbols (7). There is a large variety of such symbolic sequences, ranging from texts written in natural languages,…

Disordered Systems and Neural Networks · Physics 2007-05-23 Miguel Angel Jimenez-Montano , Werner Ebeling , Thorsten Poeschel

Optimization results are one method for understanding neural computation from Nature's perspective and for defining the physical limits on neuron-like engineering. Earlier work looks at individual properties or performance criteria and…

Neurons and Cognition · Quantitative Biology 2017-12-21 William B Levy , Toby Berger , Mustafa Sungkar

We present exact results for two complementary measures of spatial structure generated by 1D spin systems with finite-range interactions. The first, excess entropy, measures the apparent spatial memory stored in configurations. The second,…

Statistical Mechanics · Physics 2009-10-30 James P. Crutchfield , David P. Feldman

Spike trains data find a growing list of applications in computational neuroscience, imaging, streaming data and finance. Machine learning strategies for spike trains are based on various neural network and probabilistic models. The…

Information Theory · Computer Science 2023-08-10 Mirosław Pawlak , Mateusz Pabian , Dominik Rzepka

When constructing models of the world, we aim for optimal compressions: models that include as few details as possible while remaining as accurate as possible. But which details -- or features measured in data -- should we choose to include…

Quantitative Methods · Quantitative Biology 2025-05-06 David P. Carcamo , Nicholas J. Weaver , Purushottam D. Dixit , Christopher W. Lynn