English
Related papers

Related papers: Surrogate gradients for analog neuromorphic comput…

200 papers

The training of Binary Neural Networks (BNNs) is fundamentally based on gradient approximation for non-differentiable binarization operations (e.g., sign function). However, prevailing methods including the Straight-Through Estimator (STE)…

Machine Learning · Computer Science 2026-05-26 Haoyu Huang , Boyu Liu , Linlin Yang , Yanjing Li , Yuguang Yang , Xuhui Liu , Canyu Chen , Zhongqian Fu , Baochang Zhang

The increasing rise in machine learning and deep learning applications is requiring ever more computational resources to successfully meet the growing demands of an always-connected, automated world. Neuromorphic technologies based on…

Neural and Evolutionary Computing · Computer Science 2020-07-14 Philippe Reiter , Geet Rose Jose , Spyridon Bizmpikis , Ionela-Ancuţa Cîrjilă

Real-time simulation of a large-scale biologically representative spiking neural network is presented, through the use of a heterogeneous parallelisation scheme and SpiNNaker neuromorphic hardware. A published cortical microcircuit model is…

Emerging Technologies · Computer Science 2021-04-28 Oliver Rhodes , Luca Peres , Andrew G. D. Rowley , Andrew Gait , Luis A. Plana , Christian Brenninkmeijer , Steve B. Furber

Thanks to their parallel and sparse activity features, recurrent neural networks (RNNs) are well-suited for hardware implementation in low-power neuromorphic hardware. However, mapping rate-based RNNs to hardware-compatible spiking neural…

Neural and Evolutionary Computing · Computer Science 2024-07-19 Gauthier Boeshertz , Giacomo Indiveri , Manu Nair , Alpha Renner

Recent work suggests that synaptic plasticity dynamics in biological models of neurons and neuromorphic hardware are compatible with gradient-based learning (Neftci et al., 2019). Gradient-based learning requires iterating several times…

Neural and Evolutionary Computing · Computer Science 2019-11-06 Kenneth Stewart , Garrick Orchard , Sumit Bam Shrestha , Emre Neftci

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Direct training of SNNs typically relies on surrogate gradient (SG) learning to estimate…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Jiaqiang Jiang , Wenfeng Xu , Jing Fan , Rui Yan

Ensuring energy-efficient design in neuromorphic computing systems necessitates a tailored architecture combined with algorithmic approaches. This manuscript focuses on enhancing brain-inspired perceptual computing machines through a novel…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Ali Shiri Sichani , Sai Kankatala

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

Hardware Architecture · Computer Science 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

Machine learning has emerged as the dominant tool for implementing complex cognitive tasks that require supervised, unsupervised, and reinforcement learning. While the resulting machines have demonstrated in some cases even super-human…

Emerging Technologies · Computer Science 2019-08-06 Bipin Rajendran , Abu Sebastian , Michael Schmuker , Narayan Srinivasa , Evangelos Eleftheriou

Cryogenic neuromorphic systems, inspired by the brains unparalleled efficiency, present a promising paradigm for next generation computing architectures.This work introduces a fully integrated neuromorphic framework that combines…

Emerging Technologies · Computer Science 2025-01-15 Md Mazharul Islam , Julia Steed , Karan Patel , Catherine Schuman , Ahmedullah Aziz

Ultra-low power local signal processing is a crucial aspect for edge applications on always-on devices. Neuromorphic processors emulating spiking neural networks show great computational power while fulfilling the limited power budget as…

Machine Learning · Computer Science 2021-11-03 Philipp Weidel , Sadique Sheik

This paper introduces a novel "all-spike" low-power solution for remote wireless inference that is based on neuromorphic sensing, Impulse Radio (IR), and Spiking Neural Networks (SNNs). In the proposed system, event-driven neuromorphic…

Neural and Evolutionary Computing · Computer Science 2020-09-04 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

The rising demand for energy-efficient edge AI systems (e.g., mobile agents/robots) has increased the interest in neuromorphic computing, since it offers ultra-low power/energy AI computation through spiking neural network (SNN) algorithms…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Rachmad Vidya Wicaksana Putra , Pasindu Wickramasinghe , Muhammad Shafique

Neuromorphic hardware platforms implement biological neurons and synapses to execute spiking neural networks (SNNs) in an energy-efficient manner. We present SpiNeMap, a design methodology to map SNNs to crossbar-based neuromorphic…

The practical applications based on recurrent spiking neurons are limited due to their non-trivial learning algorithms. The temporal nature of spiking neurons is more favorable for hardware implementation where signals can be represented in…

Neural and Evolutionary Computing · Computer Science 2008-07-16 Arfan Ghani , Martin McGinnity , Liam Maguire , Jim Harkin

This paper presents ASPEN, a novel energy-aware technique for neuromorphic systems that could unleash the future of intelligent, always-on, ultra-low-power, and low-burden wearables. Our main research objectives are to explore the…

Neural and Evolutionary Computing · Computer Science 2025-08-19 Eduardo Calle-Ortiz , Hui Guan , Deepak Ganesan , Phuc Nguyen

We present the BrainScaleS-2 mobile system as a compact analog inference engine based on the BrainScaleS-2 ASIC and demonstrate its capabilities at classifying a medical electrocardiogram dataset. The analog network core of the ASIC is…

One of the most exciting advancements in AI over the last decade is the wide adoption of ANNs, such as DNN and CNN, in many real-world applications. However, the underlying massive amounts of computation and storage requirement greatly…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Tao Liu , Lei Jiang , Yier Jin , Gang Quan , Wujie Wen

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li