English
Related papers

Related papers: Dynamic Activation with Knowledge Distillation for…

200 papers

Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs). Despite this, bridging the performance gap with ANNs in practical scenarios remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziqing Wang , Yuetong Fang , Jiahang Cao , Renjing Xu

Spiking neural networks (SNNs) have emerged as a promising alternative to artificial neural networks (ANNs), offering improved energy efficiency by leveraging sparse and event-driven computation. However, existing hardware implementations…

Hardware Architecture · Computer Science 2025-09-19 Yuehai Chen , Farhad Merchant

Aspect Term Extraction (ATE) identifies aspect terms in review sentences, a key subtask of sentiment analysis. While most existing approaches use energy-intensive deep neural networks (DNNs) for ATE as sequence labeling, this paper proposes…

Computation and Language · Computer Science 2026-01-13 Abhishek Kumar Mishra , Arya Somasundaram , Anup Das , Nagarajan Kandasamy

The spiking neural network (SNN) computes and communicates information through discrete binary events. It is considered more biologically plausible and more energy-efficient than artificial neural networks (ANN) in emerging neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Yang Li , Yi Zeng , Dongcheng Zhao

The main computational task of Scientific Machine Learning (SciML) is function regression, required both for inputs as well as outputs of a simulation. Physics-Informed Neural Networks (PINNs) and neural operators (such as DeepONet) have…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Adar Kahana , Qian Zhang , Leonard Gleyzer , George Em Karniadakis

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

Spiking Neural Networks (SNNs) offer a promising alternative to Artificial Neural Networks (ANNs) for deep learning applications, particularly in resource-constrained systems. This is largely due to their inherent sparsity, influenced by…

Hardware Architecture · Computer Science 2023-10-27 Ilkin Aliyev. Kama Svoboda , Tosiron Adegbija

Spiking neural network (SNN) is studied in multidisciplinary domains to (i) enable order-of-magnitudes energy-efficient AI inference and (ii) computationally simulate neuro-scientific mechanisms. The lack of discrete theory obstructs the…

Neural and Evolutionary Computing · Computer Science 2024-07-03 Hyunseok Oh , Youngki Lee

Spiking neural networks (SNNs) have tremendous potential for energy-efficient neuromorphic chips due to their binary and event-driven architecture. SNNs have been primarily used in classification tasks, but limited exploration on image…

Neural and Evolutionary Computing · Computer Science 2023-09-25 Mingxuan Liu , Jie Gan , Rui Wen , Tao Li , Yongli Chen , Hong Chen

Spiking Neural Networks (SNNs) compute in an event-based matter to achieve a more efficient computation than standard Neural Networks. In SNNs, neuronal outputs (i.e. activations) are not encoded with real-valued activations but with…

Hardware Architecture · Computer Science 2023-08-08 Jan Sommer , M. Akif Özkan , Oliver Keszocze , Jürgen Teich

Deep neural networks (DNNs) provide high image classification accuracy, but experience significant performance degradation when perturbation from various sources are present in the input. The lack of resilience to input perturbations makes…

Machine Learning · Computer Science 2019-09-13 Xueyuan She , Yun Long , Daehyun Kim , Saibal Mukhopadhyay

Spiking Neural Networks (SNNs) offer a promising energy-efficient alternative to Artificial Neural Networks (ANNs) by utilizing sparse and asynchronous processing through discrete spike-based computation. However, the performance of deep…

Neural and Evolutionary Computing · Computer Science 2025-10-10 Eric Jahns , Davi Moreno , Michel A. Kinsy

Spiking Neural Networks (SNNs) compute using sparse communication and are attracting increased attention as a more energy-efficient alternative to traditional Artificial Neural Networks~(ANNs). While standard ANNs are stateless, spiking…

Neural and Evolutionary Computing · Computer Science 2025-06-27 Balázs Mészáros , James C. Knight , Thomas Nowotny

Spiking Neural Networks (SNN) are a class of bio-inspired neural networks that promise to bring low-power and low-latency inference to edge devices through asynchronous and sparse processing. However, being temporal models, SNNs depend…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Asude Aydin , Mathias Gehrig , Daniel Gehrig , Davide Scaramuzza

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Embedded AI systems are expected to incur low power/energy consumption for solving machine learning tasks, as these systems are usually power constrained (e.g., object recognition task in autonomous mobile agents with portable batteries).…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Spiking neural networks (SNNs) have garnered significant attention for their low power consumption and high biological interpretability. Their rich spatio-temporal information processing capability and event-driven nature make them ideally…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Xian Zhong , Shengwang Hu , Wenxuan Liu , Wenxin Huang , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Artificial Neural Network (ANN)-based inference on battery-powered devices can be made more energy-efficient by restricting the synaptic weights to be binary, hence eliminating the need to perform multiplications. An alternative, emerging,…

Machine Learning · Computer Science 2020-12-16 Hyeryung Jang , Nicolas Skatchkovsky , Osvaldo Simeone

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng