English
Related papers

Related papers: A new stochastic STDP Rule in a neural Network Mod…

200 papers

A dynamic Boltzmann machine (DyBM) has been proposed as a model of a spiking neural network, and its learning rule of maximizing the log-likelihood of given time-series has been shown to exhibit key properties of spike-timing dependent…

Neural and Evolutionary Computing · Computer Science 2016-12-16 Takayuki Osogami

Cortical networks can maintain memories for decades despite the short lifetime of synaptic strength. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of random noise on the stability of…

Neurons and Cognition · Quantitative Biology 2012-06-01 Yi Wei , Alexei A. Koulakov

In this paper, we investigated the neural spikes synchronisation in a neural network with synaptic plasticity and external perturbation. In the simulations the neural dynamics is described by the Hodgkin Huxley model considering chemical…

We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. The dynamics of the neurons is described by a set of stochastic differential equations in discrete time. The neurons interact…

Probability · Mathematics 2014-07-10 Olivier Faugeras , James MacLaurin

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Neuronal circuits can learn and replay firing patterns evoked by sequences of sensory stimuli. After training, a brief cue can trigger a spatiotemporal pattern of neural activity similar to that evoked by a learned stimulus sequence.…

Neurons and Cognition · Quantitative Biology 2015-07-03 Alan Veliz-Cuba , Harel Shouval , Kresimir Josic , Zachary P. Kilpatrick

Neural networks with synaptic weights constructed according to the weighted Hebb rule, a variant of the familiar Hebb rule, are studied in the presence of noise(finite temperature), when the number of stored patterns is finite and in the…

Condensed Matter · Physics 2009-10-22 Caren Marzban , Raju Viswanathan

A steadily increasing body of evidence suggests that the brain performs probabilistic inference to interpret and respond to sensory input and that trial-to-trial variability in neural activity plays an important role. The neural sampling…

Neurons and Cognition · Quantitative Biology 2017-07-07 Ilja Bytschok , Dominik Dold , Johannes Schemmel , Karlheinz Meier , Mihai A. Petrovici

We analyse mathematically the constraints on weights resulting from Hebbian and STDP learning rules applied to a spiking neuron with weight normalisation. In the case of pure Hebbian learning, we find that the normalised weights equal the…

Machine Learning · Computer Science 2020-12-15 Dominique Chu , Huy Le Nguyen

Stochasticity and limited precision of synaptic weights in neural network models are key aspects of both biological and hardware modeling of learning processes. Here we show that a neural network model with stochastic binary weights…

Disordered Systems and Neural Networks · Physics 2018-07-04 Carlo Baldassi , Federica Gerace , Hilbert J. Kappen , Carlo Lucibello , Luca Saglietti , Enzo Tartaglione , Riccardo Zecchina

Biological neural networks are characterized by their high degree of plasticity, a core property that enables the remarkable adaptability of natural organisms. Importantly, this ability affects both the synaptic strength and the topology of…

Neural and Evolutionary Computing · Computer Science 2024-06-17 Erwan Plantec , Joachin W. Pedersen , Milton L. Montero , Eleni Nisioti , Sebastian Risi

The drive to develop artificial neural networks that efficiently utilize resources has generated significant interest in bio-inspired Spiking Neural Networks (SNNs). These networks are particularly attractive due to their potential in…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Lars Graf , Zhe Su , Giacomo Indiveri

In the study of dynamical processes on networks, there has been intense focus on network structure -- i.e., the arrangement of edges and their associated weights -- but the effects of the temporal patterns of edges remains poorly…

Physics and Society · Physics 2015-06-16 Till Hoffmann , Mason A. Porter , Renaud Lambiotte

Direct training of Spiking Neural Networks (SNNs) on neuromorphic hardware has the potential to significantly reduce the energy consumption of artificial neural network training. SNNs trained with Spike Timing-Dependent Plasticity (STDP)…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Gaspard Goupy , Pierre Tirilly , Ioan Marius Bilasco

We consider an excitatory population of subthreshold Izhikevich neurons which cannot fire spontaneously without noise. As the coupling strength passes a threshold, individual neurons exhibit noise-induced burstings. This neuronal population…

Neurons and Cognition · Quantitative Biology 2017-11-28 Sang-Yoon Kim , Woochang Lim

The evolution of the human brain has led to the development of complex synaptic plasticity, enabling dynamic adaptation to a constantly evolving world. This progress inspires our exploration into a new paradigm for Spiking Neural Networks…

Neural and Evolutionary Computing · Computer Science 2024-02-02 Guobin Shen , Dongcheng Zhao , Yiting Dong , Yang Li , Feifei Zhao , Yi Zeng

We propose a biologically inspired model of spiking neurons based on the dynamics of a damped, driven pendulum. Unlike traditional models such as the Leaky Integrate-and-Fire (LIF) neurons, the pendulum neuron incorporates second-order,…

Neural and Evolutionary Computing · Computer Science 2025-07-31 Joy Bose

The use of analog resistance states for storing weights in neuromorphic systems is impeded by fabrication imprecision and device stochasticity that limit the precision of synapse weights. This challenge can be resolved by emulating analog…

Neural and Evolutionary Computing · Computer Science 2021-12-13 Peng Zhou , Julie A. Smith , Laura Deremo , Stephen K. Heinrich-Barna , Joseph S. Friedman

Information in neural networks is represented as weighted connections, or synapses, between neurons. This poses a problem as the primary computational bottleneck for neural networks is the vector-matrix multiply when inputs are multiplied…

We consider a discrete-time model of continuous-time distributed optimization over dynamic directed-graphs (digraphs) with applications to distributed learning. Our optimization algorithm works over general strongly connected dynamic…

Optimization and Control · Mathematics 2024-03-27 Mohammadreza Doostmohammadian , Wei Jiang , Muwahida Liaquat , Alireza Aghasi , Houman Zarrabi