English
Related papers

Related papers: Integration of Contrastive Predictive Coding and S…

200 papers

Inspired by the mammal's auditory localization pathway, in this paper we propose a pure spiking neural network (SNN) based computational model for precise sound localization in the noisy real-world environment, and implement this algorithm…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-08 Zihan Pan , Malu Zhang , Jibin Wu , Haizhou Li

$\textbf{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Gehua Ma , Rui Yan , Huajin Tang

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Spiking neural networks (SNNs) have emerged as a class of bio -inspired networks that leverage sparse, event-driven signaling to achieve low-power computation while inherently modeling temporal dynamics. Such characteristics align closely…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Hemanth Sabbella , Archit Mukherjee , Thivya Kandappu , Sounak Dey , Arpan Pal , Archan Misra , Dong Ma

The brain is known to be a highly complex, asynchronous dynamical system that is highly tailored to encode temporal information. However, recent deep learning approaches to not take advantage of this temporal coding. Spiking Neural Networks…

Neural and Evolutionary Computing · Computer Science 2020-09-02 Matthew Evanusa , Cornelia Fermuller , Yiannis Aloimonos

Machine learning applications that are implemented with spike-based computation model, e.g., Spiking Neural Network (SNN), have a great potential to lower the energy consumption when they are executed on a neuromorphic hardware. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-13 Shihao Song , Adarsha Balaji , Anup Das , Nagarajan Kandasamy , James Shackleford

Spiking neural networks (SNNs) have been recently brought to light due to their promising capabilities. SNNs simulate the brain with higher biological plausibility compared to previous generations of neural networks. Learning with fewer…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

This paper addresses the robustness of a network to sustain its connectivity and controllability against malicious attacks. This kind of network robustness is typically measured by the time-consuming attack simulation, which returns a…

Machine Learning · Computer Science 2024-02-06 Chengpei Wu , Yang Lou , Lin Wang , Junli Li , Xiang Li , Guanrong Chen

Spiking neural networks (SNNs) with adaptive synapses reflect core properties of biological neural networks. Speech recognition, as an application involving audio coding and dynamic learning, provides a good test problem to study SNN…

Neural and Evolutionary Computing · Computer Science 2017-03-14 Amirhossein Tavanaei , Anthony S Maida

Based on the predictive coding theory in neuroscience, we designed a bi-directional and recurrent neural net, namely deep predictive coding networks (PCN). It has feedforward, feedback, and recurrent connections. Feedback connections from a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Haiguang Wen , Kuan Han , Junxing Shi , Yizhen Zhang , Eugenio Culurciello , Zhongming Liu

Spiking neural networks (SNNs) offer a biologically grounded and energy-efficient alternative to conventional neural architectures; however, they struggle with long-range temporal dependencies due to fixed synaptic and membrane time…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Sarim Chaudhry

Biological neurons communicate with a sparing exchange of pulses - spikes. It is an open question how real spiking neurons produce the kind of powerful neural computation that is possible with deep artificial neural networks, using only so…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Davide Zambrano , Sander M. Bohte

Third-generation neural networks, or Spiking Neural Networks (SNNs), aim at harnessing the energy efficiency of spike-domain processing by building on computing elements that operate on, and exchange, spikes. In this paper, the problem of…

Machine Learning · Statistics 2018-02-23 Alireza Bagheri , Osvaldo Simeone , Bipin Rajendran

Inspired by the brain's information processing using binary spikes, spiking neural networks (SNNs) offer significant reductions in energy consumption and are more adept at incorporating multi-scale biological characteristics. In SNNs,…

Neural and Evolutionary Computing · Computer Science 2025-02-26 Yinqian Sun , Feifei Zhao , Zhuoya Zhao , Yi Zeng

Comparing different neural network representations and determining how representations evolve over time remain challenging open questions in our understanding of the function of neural networks. Comparing representations in neural networks…

Machine Learning · Statistics 2018-10-25 Ari S. Morcos , Maithra Raghu , Samy Bengio

Humans interpret and perceive the world by integrating sensory information from multiple modalities, such as vision and hearing. Spiking Neural Networks (SNNs), as brain-inspired computational models, exhibit unique advantages in emulating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Xiang He , Dongcheng Zhao , Yiting Dong , Guobin Shen , Xin Yang , Yi Zeng

Contrastive Predictive Coding (CPC) is a representation learning method that maximizes the mutual information between intermediate latent representations and the output of a given model. It can be used to effectively initialize the encoder…

Computation and Language · Computer Science 2023-02-06 Aparna Khare , Minhua Wu , Saurabhchand Bhati , Jasha Droppo , Roland Maas

A long-standing proposition is that by emulating the operation of the brain's neocortex, a spiking neural network (SNN) can achieve similar desirable features: flexible learning, speed, and efficiency. Temporal neural networks (TNNs) are…

Neural and Evolutionary Computing · Computer Science 2021-02-24 James E. Smith

By exploiting discrete signal processing and simulating brain neuron communication, Spiking Neural Networks (SNNs) offer a low-energy alternative to Artificial Neural Networks (ANNs). However, existing SNN models, still face high…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Wenxuan Pan , Feifei Zhao , Bing Han , Haibo Tong , Yi Zeng

Neuromorphic computing and spiking neural networks (SNN) mimic the behavior of biological systems and have drawn interest for their potential to perform cognitive tasks with high energy efficiency. However, some factors such as temporal…

Hardware Architecture · Computer Science 2021-05-10 Haowen Fang , Brady Taylor , Ziru Li , Zaidao Mei , Hai Li , Qinru Qiu