English
Related papers

Related papers: Integration of Contrastive Predictive Coding and S…

200 papers

Spiking neural networks (SNNs) can be used in low-power and embedded systems (such as emerging neuromorphic chips) due to their event-based nature. Also, they have the advantage of low computation cost in contrast to conventional artificial…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Ali Samadzadeh , Fatemeh Sadat Tabatabaei Far , Ali Javadi , Ahmad Nickabadi , Morteza Haghir Chehreghani

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li

Spiking Neural Networks (SNN) are known to be very effective for neuromorphic processor implementations, achieving orders of magnitude improvements in energy efficiency and computational latency over traditional deep learning approaches.…

Neural and Evolutionary Computing · Computer Science 2022-07-15 Sidi Yaya Arnaud Yarga , Jean Rouat , Sean U. N. Wood

The brain efficiently performs nonlinear computations through its intricate networks of spiking neurons, but how this is done remains elusive. While nonlinear computations can be implemented successfully in spiking neural networks, this…

Neurons and Cognition · Quantitative Biology 2021-11-23 Michele Nardin , James W Phillips , William F Podlaski , Sander W Keemink

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Spiking Neural Networks (SNNs), providing more realistic neuronal dynamics, have been shown to achieve performance comparable to Artificial Neural Networks (ANNs) in several machine learning tasks. Information is processed as spikes within…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Jiaqi Lin , Sen Lu , Malyaban Bal , Abhronil Sengupta

Predictive coding (PC) is a general theory of cortical function. The local, gradient-based learning rules found in one kind of PC model have recently been shown to closely approximate backpropagation. This finding suggests that this…

Neural and Evolutionary Computing · Computer Science 2021-12-09 Nick Alonso , Emre Neftci

Biological spiking neural networks (SNNs) can temporally encode information in their outputs, e.g. in the rank order in which neurons fire, whereas artificial neural networks (ANNs) conventionally do not. As a result, models of SNNs for…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Alan Jeffares , Qinghai Guo , Pontus Stenetorp , Timoleon Moraitis

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

Hardware Architecture · Computer Science 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze

Inspired by "predictive coding" - a theory in neuroscience, we develop a bi-directional and dynamic neural network with local recurrent processing, namely predictive coding network (PCN). Unlike feedforward-only convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Kuan Han , Haiguang Wen , Yizhen Zhang , Di Fu , Eugenio Culurciello , Zhongming Liu

Spiking neural network (SNN) has emerged as a promising paradigm in computational neuroscience and artificial intelligence, offering advantages such as low energy consumption and small memory footprint. However, their practical adoption is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Nhan T. Luu , Duong T. Luu , Nam N. Pham , Thang C. Truong

This work presents a novel spiking neural network (SNN) decoding method, combining SNNs with Hyperdimensional computing (HDC). The goal is to create a decoding method with high accuracy, high noise robustness, low latency and low energy…

Artificial Intelligence · Computer Science 2026-04-24 Cedrick Kinavuidi , Luca Peres , Oliver Rhodes

Predictive coding (PC) networks are a biologically interesting class of neural networks. Their layered hierarchy mimics the reciprocal connectivity pattern observed in the mammalian cortex, and they can be trained using local learning rules…

Neural and Evolutionary Computing · Computer Science 2019-10-29 Jeff Orchard , Wei Sun

Predictive coding networks (PCNs) constitute a biologically inspired framework for understanding hierarchical computation in the brain, and offer an alternative to traditional feedforward neural networks in ML. This note serves as a quick,…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Mikko Stenlund

Recently, brain-inspired computing models have shown great potential to outperform today's deep learning solutions in terms of robustness and energy efficiency. Particularly, Spiking Neural Networks (SNNs) and HyperDimensional Computing…

Neural and Evolutionary Computing · Computer Science 2021-10-04 Zhuowen Zou , Haleh Alimohamadi , Farhad Imani , Yeseong Kim , Mohsen Imani

Brain-inspired learning models attempt to mimic the cortical architecture and computations performed in the neurons and synapses constituting the human brain to achieve its efficiency in cognitive tasks. In this work, we present…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Spiking neural networks are motivated from principles of neural systems and may possess unexplored advantages in the context of machine learning. A class of \textit{convolutional spiking neural networks} is introduced, trained to detect…

Neural and Evolutionary Computing · Computer Science 2018-08-27 Daniel J. Saunders , Hava T. Siegelmann , Robert Kozma , Miklós Ruszinkó

Backpropagation (BP) is the standard algorithm for training the deep neural networks that power modern artificial intelligence including large language models. However, BP is energy inefficient and unlikely to be implemented by the brain.…

Machine Learning · Computer Science 2025-10-30 Francesco Innocenti

A Spiking Neural Network (SNN) can be trained indirectly by first training an Artificial Neural Network (ANN) with the conventional backpropagation algorithm, then converting it into an SNN. The conventional rate-coding method for SNNs uses…

Neural and Evolutionary Computing · Computer Science 2021-06-15 Ming Zhang , Nenggan Zheng , De Ma , Gang Pan , Zonghua Gu