English
Related papers

Related papers: Sparse and Dense Encoding in Layered Associative N…

200 papers

The experimental study of neural networks requires simultaneous measurements of a massive number of neurons, while monitoring properties of the connectivity, synaptic strengths and delays. Current technological barriers make such a mission…

Neurons and Cognition · Quantitative Biology 2016-01-12 Amir Goldental , Pinhas Sabo , Shira Sardi , Roni Vardi , Ido Kanter

Kinetics of a balanced network of neurons with a sparse grid of synaptic links is well representable by the stochastic dynamics of a generic neuron subject to an effective shot noise. The rate of delta-pulses of the noise is determined…

Neurons and Cognition · Quantitative Biology 2025-10-31 Maria V. Ageeva , Denis S. Goldobin

We address the problem of finding patterns from multi-neuronal spike trains that give us insights into the multi-neuronal codes used in the brain and help us design better brain computer interfaces. We focus on the synchronous firings of…

Neural and Evolutionary Computing · Computer Science 2010-06-09 Raajay Viswanathan , P. S. Sastry , K. P. Unnikrishnan

Spiking neural networks (SNNs) present a promising computing paradigm for neuromorphic processing of event-based sensor data. The resonate-and-fire (RF) neuron, in particular, appeals through its biological plausibility, complex dynamics,…

Neural and Evolutionary Computing · Computer Science 2025-04-02 Thomas E. Huber , Jules Lecomte , Borislav Polovnikov , Axel von Arnim

We propose a formal mathematical model for sparse representations and active dendrites in neocortex. Our model is inspired by recent experimental findings on active dendritic processing and NMDA spikes in pyramidal neurons. These…

Neurons and Cognition · Quantitative Biology 2016-05-16 Subutai Ahmad , Jeff Hawkins

Spiking Neural Networks (SNNs) are valued for their ability to process spatio-temporal information efficiently, offering biological plausibility, low energy consumption, and compatibility with neuromorphic hardware. However, the commonly…

Neural and Evolutionary Computing · Computer Science 2025-02-18 Tianqing Zhang , Kairong Yu , Jian Zhang , Hongwei Wang

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule,…

Machine Learning · Computer Science 2011-02-22 Vincent Gripon , Claude Berrou

Efficient continual learning in humans is enabled by a rich set of neurophysiological mechanisms and interactions between multiple memory systems. The brain efficiently encodes information in non-overlapping sparse codes, which facilitates…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Information encoding in the nervous system is supported through the precise spike-timings of neurons; however, an understanding of the underlying processes by which such representations are formed in the first place remains unclear. Here we…

Neural and Evolutionary Computing · Computer Science 2015-12-01 Brian Gardner , Ioana Sporea , André Grüning

Synergies between wireless communications and artificial intelligence are increasingly motivating research at the intersection of the two fields. On the one hand, the presence of more and more wirelessly connected devices, each with its own…

Neural and Evolutionary Computing · Computer Science 2020-12-10 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

An associative memory has been discussed of neural networks consisting of spiking N (=100) Hodgkin-Huxley (HH) neurons with time-delayed couplings, which memorize P patterns in their synaptic weights. In addition to excitatory synapses…

Disordered Systems and Neural Networks · Physics 2009-10-31 Hideo Hasegawa

Working memory -- the ability to store and recall precise temporal patterns of neural activity -- remains an open challenge for spiking neural networks (SNNs). We propose a recurrent SNN of $N$ neurons in which each synapse is equipped with…

Neurons and Cognition · Quantitative Biology 2026-04-16 Laurent U Perrinet

Repetitive spatio-temporal propagation patterns are encountered in fields as wide-ranging as climatology, social communication and network science. In neuroscience, perfectly consistent repetitions of the same global propagation pattern are…

Data Analysis, Statistics and Probability · Physics 2017-05-24 Thomas Kreuz , Eero Satuvuori , Martin Pofahl , Mario Mulansky

Networks in the brain consist of different types of neurons. Here we investigate the influence of neuron diversity on the dynamics, phase space structure and computational capabilities of spiking neural networks. We find that already a…

Neurons and Cognition · Quantitative Biology 2019-10-09 Paul Manz , Sven Goedeke , Raoul-Martin Memmesheimer

Spiking neural networks (SNNs) are a promising paradigm for energy-efficient computation, yet their theoretical foundations-especially regarding stability and robustness-remain limited compared to artificial neural networks. In this work,…

Machine Learning · Computer Science 2025-11-25 Ernesto Araya , Massimiliano Datres , Gitta Kutyniok

The retrieval capabilities of associative neural networks can be impaired by different kinds of noise: the fast noise (which makes neurons more prone to failure), the slow noise (stemming from interference among stored memories), and…

Disordered Systems and Neural Networks · Physics 2020-12-10 Elena Agliari , Giordano De Marzo

Attractor networks are an influential theory for memory storage in brain systems. This theory has recently been challenged by the observation of strong temporal variability in neuronal recordings during memory tasks. In this work, we study…

Neurons and Cognition · Quantitative Biology 2021-12-02 Ulises Pereira-Obilinovic , Johnatan Aljadeff , Nicolas Brunel

While end-to-end training of Deep Neural Networks (DNNs) yields state of the art performance in an increasing array of applications, it does not provide insight into, or control over, the features being extracted. We report here on a…

Neural and Evolutionary Computing · Computer Science 2022-07-11 Metehan Cekic , Can Bakiskan , Upamanyu Madhow

We consider a ring network of quadratic integrate-and-fire neurons with nonlocal synaptic and gap junction coupling. The corresponding neural field model supports solutions such as standing and travelling waves, and also lurching waves. We…

Adaptation and Self-Organizing Systems · Physics 2024-08-26 Oleh E. Omel'chenko , Carlo R. Laing

High-level brain function such as memory, classification or reasoning can be realized by means of recurrent networks of simplified model neurons. Analog neuromorphic hardware constitutes a fast and energy efficient substrate for the…

Neurons and Cognition · Quantitative Biology 2016-06-10 Thomas Pfeil , Jakob Jordan , Tom Tetzlaff , Andreas Grübl , Johannes Schemmel , Markus Diesmann , Karlheinz Meier