English
Related papers

Related papers: A Temporal Neural Network Architecture for Online …

200 papers

Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs), while providing computational and modeling advantages due to…

Machine Learning · Computer Science 2019-02-19 Emre Aksan , Otmar Hilliges

Spiking neural networks (SNNs) have manifested remarkable advantages in power consumption and event-driven property during the inference process. To take full advantage of low power consumption and improve the efficiency of these models…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Jiangrong Shen , Qi Xu , Jian K. Liu , Yueming Wang , Gang Pan , Huajin Tang

Spiking Neural Networks (SNNs) compute in an event-based matter to achieve a more efficient computation than standard Neural Networks. In SNNs, neuronal outputs (i.e. activations) are not encoded with real-valued activations but with…

Hardware Architecture · Computer Science 2023-08-08 Jan Sommer , M. Akif Özkan , Oliver Keszocze , Jürgen Teich

Spiking-neural-networks (SNNs) are promising at edge devices since the event-driven operations of SNNs provides significantly lower power compared to analog-neural-networks (ANNs). Although it is difficult to efficiently train SNNs, many…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Nguyen-Dong Ho , Ik-Joon Chang

Spiking neural networks (SNNs) are being explored in an attempt to mimic brain's capability to learn and recognize at low power. Crossbar architecture with highly scalable Resistive RAM or RRAM array serving as synaptic weights and neuronal…

Neural and Evolutionary Computing · Computer Science 2018-08-08 Aditya Shukla , Udayan Ganguly

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

Spiking neural networks (SNNs) are known as a typical kind of brain-inspired models with their unique features of rich neuronal dynamics, diverse coding schemes and low power consumption properties. How to obtain a high-accuracy model has…

Neural and Evolutionary Computing · Computer Science 2022-03-07 Yihan Lin , Yifan Hu , Shijie Ma , Guoqi Li , Dongjie Yu

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by the goal of…

Neural and Evolutionary Computing · Computer Science 2022-11-02 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

The demand for low-power inference and training of deep neural networks (DNNs) on edge devices has intensified the need for algorithms that are both scalable and energy-efficient. While spiking neural networks (SNNs) allow for efficient…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Marco Paul E. Apolinario , Kaushik Roy , Charlotte Frenkel

The highly irregular spiking activity of cortical neurons and behavioral variability suggest that the brain could operate in a fundamentally probabilistic way. Mimicking how the brain implements and learns probabilistic computation could be…

Neural and Evolutionary Computing · Computer Science 2024-04-23 Yang Qi , Zhichao Zhu , Yiming Wei , Lu Cao , Zhigang Wang , Jie Zhang , Wenlian Lu , Jianfeng Feng

A Temporal Neural Network (TNN) architecture for implementing efficient online reinforcement learning is proposed and studied via simulation. The proposed T-learning system is composed of a frontend TNN that implements online unsupervised…

Neural and Evolutionary Computing · Computer Science 2022-04-13 James E. Smith

Spiking neural networks (SNNs) have emerged as energy-efficient neural networks with temporal information. SNNs have shown a superior efficiency on neuromorphic devices, but the devices are susceptible to noise, which hinders them from…

Neural and Evolutionary Computing · Computer Science 2021-04-23 Seongsik Park , Dongjin Lee , Sungroh Yoon

In a spiking neural network (SNN), individual neurons operate autonomously and only communicate with other neurons sparingly and asynchronously via spike signals. These characteristics render a massively parallel hardware implementation of…

Machine Learning · Computer Science 2017-05-17 Ping Tak Peter Tang , Tsung-Han Lin , Mike Davies

Spiking neural networks (SNNs) promise energy-efficient artificial intelligence on neuromorphic hardware but struggle with tasks requiring both fast adaptation and long-term memory, especially in continual learning. We propose Local…

Machine Learning · Computer Science 2025-10-16 Ansh Tiwari , Ayush Chauhan

The tremendous energy consumption of deep neural networks (DNNs) has become a serious problem in deep learning. Spiking neural networks (SNNs), which mimic the operations in the human brain, have been studied as prominent energy-efficient…

Neural and Evolutionary Computing · Computer Science 2021-06-07 Seongsik Park , Sungroh Yoon

Artificial Neural Networks (ANNs) are bio-inspired models of neural computation that have proven highly effective. Still, ANNs lack a natural notion of time, and neural units in ANNs exchange analog values in a frame-based manner, a…

Neural and Evolutionary Computing · Computer Science 2017-10-16 Davide Zambrano , Roeland Nusselder , H. Steven Scholte , Sander Bohte

Biological neurons communicate with a sparing exchange of pulses - spikes. It is an open question how real spiking neurons produce the kind of powerful neural computation that is possible with deep artificial neural networks, using only so…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Davide Zambrano , Sander M. Bohte

In recent years, Spiking Neural Networks (SNNs) have demonstrated great successes in completing various Machine Learning tasks. We introduce a method for learning image features by \textit{locally connected layers} in SNNs using…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Daniel J. Saunders , Devdhar Patel , Hananel Hazan , Hava T. Siegelmann , Robert Kozma

Spiking neural network (SNN) is interesting due to its strong bio-plausibility and high energy efficiency. However, its performance is falling far behind conventional deep neural networks (DNNs). In this paper, considering a general class…

Machine Learning · Computer Science 2020-10-16 Shibo Zhou , Xiaohua Li

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen