English
Related papers

Related papers: Memory via Temporal Delays in weightless Spiking N…

200 papers

The vast majority of natural sensory data is temporally redundant. Video frames or audio samples which are sampled at nearby points in time tend to have similar values. Typically, deep learning algorithms take no advantage of this…

Neural and Evolutionary Computing · Computer Science 2017-06-14 Peter O'Connor , Efstratios Gavves , Max Welling

A draft memory model (DM) for neural networks with spike propagation delay (SNNwD) is described. Novelty in this approach are that the DM learns immediately, with stimuli presented once, without synaptic weight changes, and without external…

Neural and Evolutionary Computing · Computer Science 2016-03-29 João Ranhel , João H. Albuquerque , Bruno P. M. Azevedo , Nathalia M. Cunha , Pedro J. Ishimaru

We study the capacity of Hodgkin-Huxley neuron in a network to change temporarily or permanently their connections and behavior, the so called spike timing-dependent plasticity (STDP), as a function of their synchronous behavior. We…

Biological evidence suggests that adaptation of synaptic delays on short to medium timescales plays an important role in learning in the brain. Inspired by biology, we explore the feasibility and power of using synaptic delays to solve…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Edoardo W. Grappolini , Anand Subramoney

The brain is known to be a highly complex, asynchronous dynamical system that is highly tailored to encode temporal information. However, recent deep learning approaches to not take advantage of this temporal coding. Spiking Neural Networks…

Neural and Evolutionary Computing · Computer Science 2020-09-02 Matthew Evanusa , Cornelia Fermuller , Yiannis Aloimonos

We present a neuromorphic spiking neural network, the DELTRON, that can remember and store patterns by changing the delays of every connection as opposed to modifying the weights. The advantage of this architecture over traditional weight…

Neural and Evolutionary Computing · Computer Science 2014-02-28 Shaista Hussain , Arindam Basu , R. Wang , Tara Julia Hamilton

Spike-Timing Dependent Plasticity (STDP) is believed to play an important role in learning and the formation of computational function in the brain. The classical model of STDP which considers the timing between pairs of pre-synaptic and…

Neural and Evolutionary Computing · Computer Science 2013-03-21 Mostafa Rahimi Azghadi , Said Al-Sarawi , Nicolangelo Iannella , Derek Abbott

This paper suggests a learning-theoretic perspective on how synaptic plasticity benefits global brain functioning. We introduce a model, the selectron, that (i) arises as the fast time constant limit of leaky integrate-and-fire neurons…

Neurons and Cognition · Quantitative Biology 2012-09-26 David Balduzzi , Michel Besserve

Brain-inspired learning mechanisms, e.g. spike timing dependent plasticity (STDP), enable agile and fast on-the-fly adaptation capability in a spiking neural network. When incorporating emerging nanoscale resistive non-volatile memory (NVM)…

Neural and Evolutionary Computing · Computer Science 2020-02-19 Xinyu Wu , Vishal Saxena

Brain-inspired learning models attempt to mimic the cortical architecture and computations performed in the neurons and synapses constituting the human brain to achieve its efficiency in cognitive tasks. In this work, we present…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Learning and memory in the brain are implemented by complex, time-varying changes in neural circuitry. The computational rules according to which synaptic weights change over time are the subject of much research, and are not precisely…

Machine Learning · Statistics 2014-11-18 Scott W. Linderman , Christopher H. Stock , Ryan P. Adams

Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in spiking neural networks (SNN) to extract visual features of low or intermediate complexity in an unsupervised manner. These studies, however, used…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Saeed Reza Kheradpisheh , Mohammad Ganjtabesh , Simon J Thorpe , Timothée Masquelier

Cortical networks can maintain memories for decades despite the short lifetime of synaptic strength. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of random noise on the stability of…

Neurons and Cognition · Quantitative Biology 2012-06-01 Yi Wei , Alexei A. Koulakov

We investigate spike-timing dependent plasticity (STPD) in the case of a synapse connecting two neural cells. We develop a theoretical analysis of several STDP rules using Markovian theory. In this context there are two different…

Neurons and Cognition · Quantitative Biology 2021-11-16 Philippe Robert , Gaëtan Vignoud

Spiking Neural P systems, SNP systems for short, are biologically inspired computing devices based on how neurons perform computations. SNP systems use only one type of symbol, the spike, in the computations. Information is encoded in the…

Neural and Evolutionary Computing · Computer Science 2012-10-24 Francis George C. Cabarle , Kelvin C. Buño , Henry N. Adorna

Spiking neural networks (SNNs) could play a key role in unsupervised machine learning applications, by virtue of strengths related to learning from the fine temporal structure of event-based signals. However, some spike-timing-related…

Neural and Evolutionary Computing · Computer Science 2020-09-10 Timoleon Moraitis , Abu Sebastian , Irem Boybat , Manuel Le Gallo , Tomas Tuma , Evangelos Eleftheriou

Short-term plasticity (STP) is a mechanism that stores decaying memories in synapses of the cerebral cortex. In computing practice, STP has been used, but mostly in the niche of spiking neurons, even though theory predicts that it is the…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Hector Garcia Rodriguez , Qinghai Guo , Timoleon Moraitis

Spike-timing-dependent plasticity (STDP) provides a biologically-plausible learning mechanism for spiking neural networks (SNNs); however, Hebbian weight updates in architectures with recurrent connections suffer from pathological weight…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Andreas Massey , Aliaksandr Hubin , Stefano Nichele , Solve Sæbø

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

Precise spatio-temporal patterns of neuronal action potentials underly e.g. sensory representations and control of muscle activities. However, it is not known how the synaptic efficacies in the neuronal networks of the brain adapt such that…

Neurons and Cognition · Quantitative Biology 2015-02-24 Christian Albers , Maren Westkott , Klaus Pawelzik