English
Related papers

Related papers: Contrastive-Signal-Dependent Plasticity: Self-Supe…

200 papers

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by the goal of…

Neural and Evolutionary Computing · Computer Science 2022-11-02 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

The impressive lifelong learning in animal brains is primarily enabled by plastic changes in synaptic connectivity. Importantly, these changes are not passive, but are actively controlled by neuromodulation, which is itself under the…

Neural and Evolutionary Computing · Computer Science 2021-07-06 Thomas Miconi , Aditya Rawal , Jeff Clune , Kenneth O. Stanley

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Understanding how biological neural networks are shaped via local plasticity mechanisms can lead to energy-efficient and self-adaptive information processing systems, which promises to mitigate some of the current roadblocks in edge…

Neural and Evolutionary Computing · Computer Science 2025-04-10 Willian Soares Girão , Nicoletta Risi , Elisabetta Chicca

On metrics of density and power efficiency, neuromorphic technologies have the potential to surpass mainstream computing technologies in tasks where real-time functionality, adaptability, and autonomy are essential. While algorithmic…

Emerging Technologies · Computer Science 2019-10-09 M. E. Fouda , F. Kurdahi , A. Eltawil , E. Neftci

Networks of interconnected neurons communicating through spiking signals offer the bedrock of neural computations. Our brains spiking neural networks have the computational capacity to achieve complex pattern recognition and cognitive…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Naresh Ravichandran , Anders Lansner , Pawel Herman

Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

Spike Timing Dependent Plasticity is form of learning that has been demonstrated in real cortical tissue, but attempts to use it for artificial systems have not produced good results. This paper seeks to remedy this with two significant…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Simon Davidson , Stephen B. Furber , Oliver Rhodes

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking Neural Networks (SNNs) are brain-inspired, event-driven machine learning algorithms that have been widely recognized in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs based on synaptic…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Mingyuan Meng , Xingyu Yang , Lei Bi , Jinman Kim , Shanlin Xiao , Zhiyi Yu

Spike-timing dependent plasticity (STDP) which observed in the brain has proven to be important in biological learning. On the other hand, artificial neural networks use a different way to learn, such as Back-Propagation or Contrastive…

Neural and Evolutionary Computing · Computer Science 2021-06-10 Shiyuan Li

Spike-Timing-Dependent Plasticity (STDP) provides a biologically grounded learning rule for spiking neural networks (SNNs), but its reliance on precise spike timing and pairwise updates limits fast learning of weights. We introduce a…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Gouri Lakshmi S , Athira Chandrasekharan , Harshit Kumar , Muhammed Sahad E , Bikas C Das , Saptarshi Bej

Spiking neural networks (SNNs) possess energy-efficient potential due to event-based computation. However, supervised training of SNNs remains a challenge as spike activities are non-differentiable. Previous SNNs training methods can be…

Neural and Evolutionary Computing · Computer Science 2019-10-08 Yunzhe Hao , Xuhui Huang , Meng Dong , Bo Xu

Learning is based on synaptic plasticity, which affects and is driven by neural activity. Because pre- and postsynaptic spiking activity is shaped by randomness, the synaptic weights follow a stochastic process, requiring a probabilistic…

Neurons and Cognition · Quantitative Biology 2026-01-14 Jakob Stubenrauch , Naomi Auer , Richard Kempter , Benjamin Lindner

Deep learning's success comes with growing energy demands, raising concerns about the long-term sustainability of the field. Spiking neural networks, inspired by biological neurons, offer a promising alternative with potential computational…

Neural and Evolutionary Computing · Computer Science 2025-03-05 Adalbert Fono , Manjot Singh , Ernesto Araya , Philipp C. Petersen , Holger Boche , Gitta Kutyniok

Children possess the ability to learn multiple cognitive tasks sequentially, which is a major challenge toward the long-term goal of artificial general intelligence. Existing continual learning frameworks are usually applicable to Deep…

Artificial Intelligence · Computer Science 2023-08-10 Bing Han , Feifei Zhao , Yi Zeng , Wenxuan Pan , Guobin Shen

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

Understanding cognitive flexibility and task-switching mechanisms in neural systems requires biologically plausible computational models. This tutorial presents a step-by-step approach to constructing a spiking neural network (SNN) that…

Neurons and Cognition · Quantitative Biology 2025-03-07 Ashwin Viswanathan Kannan , Madhumitha Ganesan

Bayesian inference provides a principled framework for understanding brain function, while neural activity in the brain is inherently spike-based. This paper bridges these two perspectives by designing spiking neural networks that simulate…

Neurons and Cognition · Quantitative Biology 2026-01-01 Sepideh Adamiat , Wouter M. Kouw , Bert de Vries

Spiking neural networks (SNNs) are gaining popularity in the computational simulation and artificial intelligence fields owing to their biological plausibility and computational efficiency. This paper explores the historical development of…

Neural and Evolutionary Computing · Computer Science 2024-08-29 Tianyu Zheng , Liyuan Han , Tielin Zhang