English
Related papers

Related papers: Integration of Contrastive Predictive Coding and S…

200 papers

Spiking Neural Networks (SNNs) emulate the integrated-fire-leak mechanism found in biological neurons, offering a compelling combination of biological realism and energy efficiency. In recent years, they have gained considerable research…

Neural and Evolutionary Computing · Computer Science 2024-06-06 Lihao Wang , Zhaofei Yu

Spiking Neural Networks (SNNs) have a greater potential for modeling time series data than Artificial Neural Networks (ANNs), due to their inherent neuron dynamics and low energy consumption. However, it is difficult to demonstrate their…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Chenxi Sun , Hongyan Li , Moxian Song , Derun Can , Shenda Hong

Spiking Neural Networks (SNN) are models for "realistic" neuronal computation, which makes them somehow different in scope from "ordinary" deep-learning models widely used in AI platforms nowadays. SNNs focus on timed latency (and possibly…

Artificial Intelligence · Computer Science 2025-06-17 Zhen Yao , Elisabetta De Maria , Robert De Simone

Spiking neural networks are biologically plausible counterparts of the artificial neural networks, artificial neural networks are usually trained with stochastic gradient descent and spiking neural networks are trained with spike timing…

Neural and Evolutionary Computing · Computer Science 2019-09-26 Ruthvik Vaila , John Chiasson , Vishal Saxena

We have presented a Spiking Convolutional Neural Network (SCNN) that incorporates retinal foveal-pit inspired Difference of Gaussian filters and rank-order encoding. The model is trained using a variant of the backpropagation algorithm…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Shriya T. P. Gupta , Basabdatta Sen Bhattacharya

This paper presents a new learning algorithm, termed Deep Bi-directional Predictive Coding (DBPC) that allows developing networks to simultaneously perform classification and reconstruction tasks using the same weights. Predictive Coding…

Machine Learning · Computer Science 2023-05-31 Senhui Qiu , Saugat Bhattacharyya , Damien Coyle , Shirin Dora

Spiking neural network (SNN) has attracted much attention due to their powerful spatio-temporal information representation ability. Capsule Neural Network (CapsNet) does well in assembling and coupling features at different levels. Here, we…

Neural and Evolutionary Computing · Computer Science 2021-11-16 Dongcheng Zhao , Yang Li , Yi Zeng , Jihang Wang , Qian Zhang

In recent years, Spiking Neural Networks (SNNs) have gathered significant interest due to their temporal understanding capabilities. This work introduces, to the best of our knowledge, the first Cortical Column like hybrid architecture for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Aaron Bateni

Automatic detection of phoneme or word-like units is one of the core objectives in zero-resource speech processing. Recent attempts employ self-supervised training methods, such as contrastive predictive coding (CPC), where the next frame…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Saurabhchand Bhati , Jesús Villalba , Piotr Żelasko , Laureano Moro-Velazquez , Najim Dehak

Predictive Coding (PC) is an influential account of cortical learning. Much of recent work has focused on comparing PC to Backpropagation (BP) to find whether PC offers any advantages. Small scale experiments show that PC enables learning…

Machine Learning · Computer Science 2026-05-13 Gaspard Oliviers , Elene Lominadze , Rafal Bogacz

This review explores the intersection of bio-plausible artificial intelligence in the form of Spiking Neural Networks (SNNs) with the analog In-Memory Computing (IMC) domain, highlighting their collective potential for low-power edge…

Neural and Evolutionary Computing · Computer Science 2024-09-20 Abhishek Moitra , Abhiroop Bhattacharjee , Yuhang Li , Youngeun Kim , Priyadarshini Panda

Brain-computer interfaces (BCIs), is ways for electronic devices to communicate directly with the brain. For most medical-type brain-computer interface tasks, the activity of multiple units of neurons or local field potentials is sufficient…

Machine Learning · Computer Science 2022-05-25 Lang Qian , Shengjie Zheng , Chunshan Deng , Cheng Yang , Xiaojian Li

In a spiking neural network (SNN), individual neurons operate autonomously and only communicate with other neurons sparingly and asynchronously via spike signals. These characteristics render a massively parallel hardware implementation of…

Machine Learning · Computer Science 2017-05-17 Ping Tak Peter Tang , Tsung-Han Lin , Mike Davies

Brain-inspired machine learning is gaining increasing consideration, particularly in computer vision. Several studies investigated the inclusion of top-down feedback connections in convolutional networks; however, it remains unclear how and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Andrea Alamia , Milad Mozafari , Bhavin Choksi , Rufin VanRullen

Spiking neural networks (SNNs) are being explored in an attempt to mimic brain's capability to learn and recognize at low power. Crossbar architecture with highly scalable Resistive RAM or RRAM array serving as synaptic weights and neuronal…

Neural and Evolutionary Computing · Computer Science 2018-08-08 Aditya Shukla , Udayan Ganguly

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Biological image processing is performed by complex neural networks composed of thousands of neurons interconnected via thousands of synapses, some of which are excitatory and others inhibitory. Spiking neural models are distinguished from…

Neural and Evolutionary Computing · Computer Science 2019-09-19 Pedro Machado , Georgina Cosma , T. M McGinnity

Predictive coding can be regarded as a function which reduces the error between an input signal and a top-down prediction. If reducing the error is equivalent to reducing the influence of stimuli from the environment, predictive coding can…

Neural and Evolutionary Computing · Computer Science 2019-11-22 Atsushi Masumori , Lana Sinapayen , Takashi Ikegami

Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 William Bjorndahl , Jack Easton , Austin Modoff , Eric C. Larson , Joseph Camp , Prasanna Rangarajan