English
Related papers

Related papers: Attractor networks and memory replay of phase code…

200 papers

We use a biophysical model of a local neuronal circuit to study the implications of synaptic plasticity for the detection of weak sensory stimuli. Networks with fast plastic coupling show behavior consistent with stochastic resonance.…

Neurons and Cognition · Quantitative Biology 2009-11-13 Vladislav Volman , Herbert Levine

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

The timing of individual neuronal spikes is essential for biological brains to make fast responses to sensory stimuli. However, conventional artificial neural networks lack the intrinsic temporal coding ability present in biological…

Neural and Evolutionary Computing · Computer Science 2020-11-18 Iulia M. Comsa , Krzysztof Potempa , Luca Versari , Thomas Fischbacher , Andrea Gesmundo , Jyrki Alakuijala

We introduce an algorithm to do backpropagation on a spiking network. Our network is "spiking" in the sense that our neurons accumulate their activation into a potential over time, and only send out a signal (a "spike") when this potential…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Peter O'Connor , Max Welling

Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-09-07 Wachirawit Ponghiran , Kaushik Roy

In recent years, Spiking Neural Networks (SNNs) have demonstrated great successes in completing various Machine Learning tasks. We introduce a method for learning image features by \textit{locally connected layers} in SNNs using…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Daniel J. Saunders , Devdhar Patel , Hananel Hazan , Hava T. Siegelmann , Robert Kozma

This paper studies the capability of a recurrent neural network model to memorize random dynamical firing patterns by a simple local learning rule. Two modes of learning/memorization are considered: The first mode is strictly online, with a…

Information Theory · Computer Science 2020-01-10 Patrick Murer , Hans-Andrea Loeliger

Recurrent spiking neural networks (RSNN) in the human brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and requires very few examples. This motivates the search for…

Neurons and Cognition · Quantitative Biology 2021-03-22 Paolo Muratore , Cristiano Capone , Pier Stanislao Paolucci

Spiking Neural Networks (SNNs) are brain-inspired, event-driven machine learning algorithms that have been widely recognized in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs based on synaptic…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Mingyuan Meng , Xingyu Yang , Lei Bi , Jinman Kim , Shanlin Xiao , Zhiyi Yu

Learning or memory formation are associated with the strengthening of the synaptic connections between neurons according to a pattern reflected by the input. According to this theory a retained memory sequence is associated to a dynamic…

Dynamical Systems · Mathematics 2016-03-23 Pascal Chossat , Martin Krupa

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

Sleep is thought to support memory consolidation and the recovery of optimal energetic regime by reorganizing synaptic connectivity, yet how plasticity across hierarchical brain circuits contributes to abstraction and energy efficiency…

Understanding how the brain learns to compute functions reliably, efficiently and robustly with noisy spiking activity is a fundamental challenge in neuroscience. Most sensory and motor tasks can be described as dynamical systems and could…

Neurons and Cognition · Quantitative Biology 2017-05-24 Sophie Denève , Alireza Alemi , Ralph Bourdoukan

A draft memory model (DM) for neural networks with spike propagation delay (SNNwD) is described. Novelty in this approach are that the DM learns immediately, with stimuli presented once, without synaptic weight changes, and without external…

Neural and Evolutionary Computing · Computer Science 2016-03-29 João Ranhel , João H. Albuquerque , Bruno P. M. Azevedo , Nathalia M. Cunha , Pedro J. Ishimaru

Learning and memory in the brain are implemented by complex, time-varying changes in neural circuitry. The computational rules according to which synaptic weights change over time are the subject of much research, and are not precisely…

Machine Learning · Statistics 2014-11-18 Scott W. Linderman , Christopher H. Stock , Ryan P. Adams

We study the synchronization of two model neurons coupled through a synapse having an activity-dependent strength. Our synapse follows the rules of Spike-Timing Dependent Plasticity (STDP). We show that this plasticity of the coupling…

Biological Physics · Physics 2009-11-07 Valentin P. Zhigulin , Mikhail I. Rabinovich , Ramon Huerta , Henry D. I. Abarbanel

Spiking neural networks are motivated from principles of neural systems and may possess unexplored advantages in the context of machine learning. A class of \textit{convolutional spiking neural networks} is introduced, trained to detect…

Neural and Evolutionary Computing · Computer Science 2018-08-27 Daniel J. Saunders , Hava T. Siegelmann , Robert Kozma , Miklós Ruszinkó

Dynamics and function of neuronal networks are determined by their synaptic connectivity. Current experimental methods to analyze synaptic network structure on the cellular level, however, cover only small fractions of functional neuronal…

Neurons and Cognition · Quantitative Biology 2015-07-28 Yury V. Zaytsev , Abigail Morrison , Moritz Deger

For the retrieval dynamics of sparsely coded attractor associative memory models with synaptic noise the inclusion of a macroscopic time-dependent threshold is studied. It is shown that if the threshold is chosen appropriately as a function…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Bolle' , R. Heylen

Predictive coding can be regarded as a function which reduces the error between an input signal and a top-down prediction. If reducing the error is equivalent to reducing the influence of stimuli from the environment, predictive coding can…

Neural and Evolutionary Computing · Computer Science 2019-11-22 Atsushi Masumori , Lana Sinapayen , Takashi Ikegami