English
Related papers

Related papers: Sharpness-Aware Surrogate Training for On-Sensor S…

200 papers

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Direct training of SNNs typically relies on surrogate gradient (SG) learning to estimate…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Jiaqiang Jiang , Wenfeng Xu , Jing Fan , Rui Yan

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Neuromorphic vision systems based on spiking neural networks (SNNs) offer ultra-low-power perception for event-based and frame-based cameras, yet catastrophic forgetting remains a critical barrier to deployment in continually evolving…

Neural and Evolutionary Computing · Computer Science 2026-03-11 Anika Tabassum Meem , Muntasir Hossain Nadid , Md Zesun Ahmed Mia

Modern deep neural networks (DNNs) have achieved state-of-the-art performances but are typically over-parameterized. The over-parameterization may result in undesirably large generalization error in the absence of other customized training…

Machine Learning · Computer Science 2023-03-03 Jiawei Du , Daquan Zhou , Jiashi Feng , Vincent Y. F. Tan , Joey Tianyi Zhou

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Stability arguments are often used to prevent learning algorithms from having ever increasing activity and weights that hinder generalization. However, stability conditions can clash with the sparsity required to augment the energy…

Neural and Evolutionary Computing · Computer Science 2024-01-08 Luca Herranz-Celotti , Jean Rouat

Compared with artificial neural networks (ANNs), spiking neural networks (SNNs) are promising to explore the brain-like behaviors since the spikes could encode more spatio-temporal information. Although pre-training from ANN or direct…

Neural and Evolutionary Computing · Computer Science 2018-09-18 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

Memristor-based Spiking Neural Networks (SNNs) with temporal spike encoding enable ultra-low-energy computation, making them ideal for battery-powered intelligent devices. This paper presents a circuit-level memristive spiking neural…

Emerging Technologies · Computer Science 2025-07-29 Santlal Prajapati , Susmita Sur-Kolay , Soumyadeep Dutta

Large language models exhibit strong reasoning capabilities, yet often rely on shortcuts such as surface pattern matching and answer memorization rather than genuine logical inference. We propose Shortcut-Aware Reasoning Training (SART), a…

Computation and Language · Computer Science 2026-03-24 Hongyu Cao , Kunpeng Liu , Dongjie Wang , Yanjie Fu

Spiking neural networks (SNNs) are different from the classical networks used in deep learning: the neurons communicate using electrical impulses called spikes, just like biological neurons. SNNs are appealing for AI technology, because…

Neural and Evolutionary Computing · Computer Science 2022-01-10 Nandan Meda

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

Training spiking neural networks to approximate universal functions is essential for studying information processing in the brain and for neuromorphic computing. Yet the binary nature of spikes poses a challenge for direct gradient-based…

Neural and Evolutionary Computing · Computer Science 2024-11-19 Julia Gygax , Friedemann Zenke

Deep spiking neural networks (SNNs) are promising neural networks for their model capacity from deep neural network architecture and energy efficiency from SNNs' operations. To train deep SNNs, recently, spatio-temporal backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-08-02 Seongsik Park , Jeonghee Jo , Jongkil Park , Yeonjoo Jeong , Jaewook Kim , Suyoun Lee , Joon Young Kwak , Inho Kim , Jong-Keuk Park , Kyeong Seok Lee , Gye Weon Hwang , Hyun Jae Jang

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

Machine Learning · Computer Science 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

The surrogate gradient (SG) method has shown significant promise in enhancing the performance of deep spiking neural networks (SNNs), but it also introduces vulnerabilities to adversarial attacks. Although spike coding strategies and neural…

Machine Learning · Computer Science 2025-11-19 Runhao Jiang , Chengzhi Jiang , Rui Yan , Huajin Tang

Spiking neural networks (SNNs) receive widespread attention because of their low-power hardware characteristic and brain-like signal response mechanism, but currently, the performance of SNNs is still behind Artificial Neural Networks…

Neural and Evolutionary Computing · Computer Science 2021-05-07 Xingyu Yang , Mingyuan Meng , Shanlin Xiao , Zhiyi Yu

The human brain utilizes spikes for information transmission and dynamically reorganizes its network structure to boost energy efficiency and cognitive capabilities throughout its lifespan. Drawing inspiration from this spike-based…

Human-Computer Interaction · Computer Science 2025-02-20 Jiangrong Shen , Qi Xu , Gang Pan , Badong Chen

Stochastic Petri Nets (SPNs) are an increasingly popular tool of choice for modeling discrete-event dynamics in areas such as epidemiology and systems biology, yet their parameter estimation remains challenging in general and in particular…

Machine Learning · Computer Science 2025-12-09 Bright Kwaku Manu , Trevor Reckell , Beckett Sterner , Petar Jevtic