English
Related papers

Related papers: Advancing Spiking Neural Networks towards Deep Res…

200 papers

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

The rapid advancement of artificial intelligence (AI) and deep learning (DL) has catalyzed the emergence of several optimization-driven subfields, notably neuromorphic computing and quantum machine learning. Leveraging the differentiable…

Neural and Evolutionary Computing · Computer Science 2026-03-17 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tasks. To understand the success and limitations of RNNs, it is…

Information Theory · Computer Science 2017-01-30 Adam Charles , Dong Yin , Christopher Rozell

Spiking Neural Networks (SNNs) are emerging as a brain-inspired alternative to traditional Artificial Neural Networks (ANNs), prized for their potential energy efficiency on neuromorphic hardware. Despite this, SNNs often suffer from…

Machine Learning · Computer Science 2025-05-29 Chengting Yu , Xiaochen Zhao , Lei Liu , Shu Yang , Gaoang Wang , Erping Li , Aili Wang

Land cover maps generated from semantic segmentation of high-resolution remotely sensed images have drawn mucon in the photogrammetry and remote sensing research community. Currently, massive fine-resolution remotely sensed (FRRS) images…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Naftaly Wambugu , Ruisheng Wang , Bo Guo , Tianshu Yu , Sheng Xu , Mohammed Elhassan

Spiking neural networks (SNNs) are well known as the brain-inspired models with high computing efficiency, due to a key component that they utilize spikes as information units, close to the biological neural systems. Although spiking based…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Qi Xu , Yaxin Li , Jiangrong Shen , Jian K Liu , Huajin Tang , Gang Pan

Currently, most spiking neural networks (SNNs) still mimic the chain-like hierarchical architecture in traditional artificial neural networks (ANNs). This method significantly differs from random connections between neurons found in…

Neural and Evolutionary Computing · Computer Science 2025-12-19 Yongsheng Huang , Peibo Duan , Zhipeng Liu , Kai Sun , Changsheng Zhang , Bin Zhang , Mingkun Xu

$\textbf{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Gehua Ma , Rui Yan , Huajin Tang

Spiking neural networks (SNNs) have captured apparent interest over the recent years, stemming from neuroscience and reaching the field of artificial intelligence. However, due to their nature SNNs remain far behind in achieving the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Katerina Maria Oikonomou , Vasiliki Balaska , Konstantinos A. Tsintotas , Christos N. Mavridis , Ioannis Kansizoglou , Antonios Gasteratos

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Eike-Manuel Edelmann

Recent advances in the design of convolutional neural network (CNN) have yielded significant improvements in the performance of image super-resolution (SR). The boost in performance can be attributed to the presence of residual or dense…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Kuldeep Purohit , Srimanta Mandal , A. N. Rajagopalan

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Flavio Martinelli , Giorgia Dellaferrera , Pablo Mainar , Milos Cernak

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency resulting from sparse, event-driven computations. Many recent works have demonstrated effective backpropagation for deep Spiking Neural Networks (SNNs)…

Neural and Evolutionary Computing · Computer Science 2020-03-04 Jason M. Allred , Steven J. Spencer , Gopalakrishnan Srinivasan , Kaushik Roy

A residual network (or ResNet) is a standard deep neural net architecture, with state-of-the-art performance across numerous applications. The main premise of ResNets is that they allow the training of each layer to focus on fitting just…

Machine Learning · Computer Science 2018-09-28 Ohad Shamir

Spiking and Quantized Neural Networks (NNs) are becoming exceedingly important for hyper-efficient implementations of Deep Learning (DL) algorithms. However, these networks face challenges when trained using error backpropagation, due to…

Machine Learning · Computer Science 2022-02-16 Jason K. Eshraghian , Corey Lammie , Mostafa Rahimi Azghadi , Wei D. Lu

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

Spiking Neural Networks (SNNs) are efficient computation models to perform spatio-temporal pattern recognition on {resource}- and {power}-constrained platforms. SNNs executed on neuromorphic hardware can further reduce energy consumption of…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Adarsha Balaji , Anup Das

Residual Network (ResNet) is undoubtedly a milestone in deep learning. ResNet is equipped with shortcut connections between layers, and exhibits efficient training using simple first order algorithms. Despite of the great empirical success,…

Machine Learning · Computer Science 2019-11-05 Tianyi Liu , Minshuo Chen , Mo Zhou , Simon S. Du , Enlu Zhou , Tuo Zhao