English
Related papers

Related papers: Sleep-Based Homeostatic Regularization for Stabili…

200 papers

Cortical networks can maintain memories for decades despite the short lifetime of synaptic strength. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of random noise on the stability of…

Neurons and Cognition · Quantitative Biology 2012-06-01 Yi Wei , Alexei A. Koulakov

We present new theoretical foundations for unsupervised Spike-Timing-Dependent Plasticity (STDP) learning in spiking neural networks (SNNs). In contrast to empirical parameter search used in most previous works, we provide novel theoretical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Ali Safa , Ilja Ocket , André Bourdoux , Hichem Sahli , Francky Catthoor , Georges Gielen

Spiking Neural Networks (SNNs), recognized for their biological plausibility and energy efficiency, employ sparse and asynchronous spikes for communication. However, the training of SNNs encounters difficulties coming from…

Neurons and Cognition · Quantitative Biology 2024-05-09 Sushant Yadav , Santosh Chaudhary , Rajesh Kumar

A common view in the neuroscience community is that memory is encoded in the connection strength between neurons. This perception led artificial neural network models to focus on connection weights as the key variables to modulate learning.…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Hananel Hazan , Simon Caby , Christopher Earl , Hava Siegelmann , Michael Levin

Metal-oxide memristors have emerged as promising candidates for hardware implementation of artificial synapses - the key components of high-performance, analog neuromorphic networks - due to their excellent scaling prospects. Since some…

Other Condensed Matter · Physics 2016-10-10 M. Prezioso , F. Merrikh-Bayat , B. Hoskins , K. Likharev , D. Strukov

Spike-timing-dependent plasticity(STDP) is a biological process in which the precise order and timing of neuronal spikes affect the degree of synaptic modification. While there have been numerous research focusing on the role of STDP in…

Neurons and Cognition · Quantitative Biology 2021-08-10 Hong-Gyu Yoon , Pilwon Kim

Magnetic skyrmions, as scalable and non-volatile spin textures, can dynamically interact with fields and currents, making them promising for unconventional computing. This paper presents a neuromorphic device based on skyrmion manipulation…

Mesoscale and Nanoscale Physics · Physics 2024-05-14 Zulfidin Khodzhaev , Jean Anne C. Incorvia

Learning is based on synaptic plasticity, which affects and is driven by neural activity. Because pre- and postsynaptic spiking activity is shaped by randomness, the synaptic weights follow a stochastic process, requiring a probabilistic…

Neurons and Cognition · Quantitative Biology 2026-01-14 Jakob Stubenrauch , Naomi Auer , Richard Kempter , Benjamin Lindner

Compared with artificial neural networks (ANNs), spiking neural networks (SNNs) are promising to explore the brain-like behaviors since the spikes could encode more spatio-temporal information. Although pre-training from ANN or direct…

Neural and Evolutionary Computing · Computer Science 2018-09-18 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

Spiking neural networks (SNNs) could play a key role in unsupervised machine learning applications, by virtue of strengths related to learning from the fine temporal structure of event-based signals. However, some spike-timing-related…

Neural and Evolutionary Computing · Computer Science 2020-09-10 Timoleon Moraitis , Abu Sebastian , Irem Boybat , Manuel Le Gallo , Tomas Tuma , Evangelos Eleftheriou

We study the synchronization of two model neurons coupled through a synapse having an activity-dependent strength. Our synapse follows the rules of Spike-Timing Dependent Plasticity (STDP). We show that this plasticity of the coupling…

Biological Physics · Physics 2009-11-07 Valentin P. Zhigulin , Mikhail I. Rabinovich , Ramon Huerta , Henry D. I. Abarbanel

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

In neural systems, synaptic plasticity is usually driven by spike trains. Due to the inherent noises of neurons, synapses and networks, spike trains typically exhibit externally uncontrollable variability such as spatial heterogeneity and…

Neurons and Cognition · Quantitative Biology 2015-06-18 Zedong Bi , Changsong Zhou , Hai-Jun Zhou

Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in spiking neural networks (SNN) to extract visual features of low or intermediate complexity in an unsupervised manner. These studies, however, used…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Saeed Reza Kheradpisheh , Mohammad Ganjtabesh , Simon J Thorpe , Timothée Masquelier

Recently, the use of bio-inspired learning techniques such as Hebbian learning and its closely-related Spike-Timing-Dependent Plasticity (STDP) variant have drawn significant attention for the design of compute-efficient AI systems that can…

Neural and Evolutionary Computing · Computer Science 2024-11-19 Ali Safa

We present a fully memristive spiking neural network (MSNN) consisting of physically-realizable memristive neurons and memristive synapses to implement an unsupervised Spiking Time Dependent Plasticity (STDP) learning rule. The system is…

Neural and Evolutionary Computing · Computer Science 2022-03-11 Peng Zhou , Dong-Uk Choi , Jason K. Eshraghian , Sung-Mo Kang

The occurrence of sleep passed through the evolutionary sieve and is widespread in animal species. Sleep is known to be beneficial to cognitive and mnemonic tasks, while chronic sleep deprivation is detrimental. Despite the importance of…

Neurons and Cognition · Quantitative Biology 2019-11-19 Cristiano Capone , Elena Pastorelli , Bruno Golosio , Pier Stanislao Paolucci

The brain is known to be a highly complex, asynchronous dynamical system that is highly tailored to encode temporal information. However, recent deep learning approaches to not take advantage of this temporal coding. Spiking Neural Networks…

Neural and Evolutionary Computing · Computer Science 2020-09-02 Matthew Evanusa , Cornelia Fermuller , Yiannis Aloimonos

Artificial Neural Networks (ANN) have gained significant popularity thanks to their ability to learn using the well-known backpropagation algorithm. Conversely, Spiking Neural Networks (SNNs), despite having broader capabilities than ANNs,…

Neural and Evolutionary Computing · Computer Science 2024-06-26 Sergio Davies , Andrew Gait , Andrew Rowley , Alessandro Di Nuovo

The collective dynamics of excitatory pulse coupled neurons with spike timing dependent plasticity (STDP) is studied. The introduction of STDP induces persistent irregular oscillations between strongly and weakly synchronized states,…

Neurons and Cognition · Quantitative Biology 2013-05-21 Kaare Mikkelsen , Alberto Imparato , Alessandro Torcini