English
Related papers

Related papers: Dynamic Activation with Knowledge Distillation for…

200 papers

Spiking Neural Network (SNN) is a promising energy-efficient AI model when implemented on neuromorphic hardware. However, it is a challenge to efficiently train SNNs due to their non-differentiability. Most existing methods either suffer…

Neural and Evolutionary Computing · Computer Science 2023-03-31 Qingyan Meng , Mingqing Xiao , Shen Yan , Yisen Wang , Zhouchen Lin , Zhi-Quan Luo

The convergence of artificial intelligence and edge computing has spurred growing interest in enabling intelligent services directly on resource-constrained devices. While traditional deep learning models require significant computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-21 Shuiguang Deng , Di Yu , Changze Lv , Xin Du , Linshan Jiang , Xiaofan Zhao , Wentao Tong , Xiaoqing Zheng , Weijia Fang , Peng Zhao , Gang Pan , Schahram Dustdar , Albert Y. Zomaya

Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In…

Neural and Evolutionary Computing · Computer Science 2024-10-31 Anagha Nimbekar , Prabodh Katti , Chen Li , Bashir M. Al-Hashimi , Amit Acharyya , Bipin Rajendran

Spiking Neural Networks (SNNs), with their brain-inspired spatiotemporal dynamics and spike-driven computation, have emerged as promising energy-efficient alternatives to Artificial Neural Networks (ANNs). However, existing SNNs typically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fan Luo , Zeyu Gao , Xinhao Luo , Kai Zhao , Yanfeng Lu

Neural networks can learn spurious correlations in the data, often leading to performance degradation for underrepresented subgroups. Studies have demonstrated that the disparity is amplified when knowledge is distilled from a complex…

Machine Learning · Computer Science 2025-11-11 Patrik Kenfack , Ulrich Aïvodji , Samira Ebrahimi Kahou

Spiking Neural Networks (SNNs) offer a biologically inspired alternative to conventional artificial neural networks, with potential advantages in power efficiency due to their event-driven computation. Despite their promise, SNNs have yet…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Wangdan Liao , Weidong Wang

Regarded as the third generation of neural networks, Spiking Neural Networks (SNNs) have garnered significant traction due to their biological plausibility and energy efficiency. Recent advancements in large models necessitate spiking…

Neural and Evolutionary Computing · Computer Science 2026-04-15 Chenlin Zhou , Sihang Guo , Jiaqi Wang , Dongyang Ma , Jin Cheng , Qingyan Meng , Zhengyu Ma , Yonghong Tian

Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments. However, the scenario becomes particularly challenging when data samples are insufficient,…

Machine Learning · Computer Science 2026-05-12 Huijing Zhang , Muyang Cao , Linshan Jiang , Xin Du , Di Yu , Changze Lv , Shuiguang Deng

Brain-inspired Spiking Neural Networks (SNNs) have the characteristics of event-driven and high energy-efficient, which are different from traditional Artificial Neural Networks (ANNs) when deployed on edge devices such as neuromorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jue Chen , Huan Yuan , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

In this era of AI revolution, massive investments in large-scale data-driven AI systems demand high-performance computing, consuming tremendous energy and resources. This trend raises new challenges in optimizing sustainability without…

Machine Learning · Computer Science 2025-02-26 Tokey Tahmid , Mark Gates , Piotr Luszczek , Catherine D. Schuman

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

Spiking Neural Networks (SNNs) have attracted the attention of the deep learning community for use in low-latency, low-power neuromorphic hardware, as well as models for understanding neuroscience. In this paper, we introduce Spiking Phasor…

Neural and Evolutionary Computing · Computer Science 2022-04-04 Connor Bybee , E. Paxon Frady , Friedrich T. Sommer

Spiking Neural Networks (SNNs) draw inspiration from biological neurons to enable brain-like computation, demonstrating effectiveness in processing temporal information with energy efficiency and biological realism. Most existing SNNs are…

Neural and Evolutionary Computing · Computer Science 2026-03-03 Chengjie Ge , Yufeng Peng , Zihao Li , Qiyu Kang , Xueyang Fu , Xuhao Li , Qixin Zhang , Junhao Ren , Zheng-Jun Zha

Edge AI applications increasingly require ultra-low-power, low-latency inference. Neuromorphic computing based on event-driven spiking neural networks (SNNs) offers an attractive path, but practical deployment on resource-constrained…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz , Duygu Erisken , Rana Irem Turhan

SNNs promise energy-efficient and low-latency inference, but their performance still trails that of ANNs. ANN-to-SNN knowledge distillation helps narrow this gap, yet the original training data are often unavailable in practical deployment…

Neural and Evolutionary Computing · Computer Science 2026-05-28 Shuhan Ye , Yi Yu , Qixin Zhang , Hui Lu , Jiaming He , Qinggang Zhang , Li Shen , Xudong Jiang

Deep learning has revolutionized artificial intelligence (AI), achieving remarkable progress in fields such as computer vision, speech recognition, and natural language processing. Moreover, the recent success of large language models…

Machine Learning · Computer Science 2024-09-05 Yangfan Hu , Qian Zheng , Guoqi Li , Huajin Tang , Gang Pan

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Deep neural networks have been proven to be highly effective tools in various domains, yet their computational and memory costs restrict them from being widely deployed on portable devices. The recent rapid increase of edge computing…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Ayan Shymyrbay , Mohammed E. Fouda , Ahmed Eltawil

Spiking neural network (SNN) is interesting both theoretically and practically because of its strong bio-inspiration nature and potentially outstanding energy efficiency. Unfortunately, its development has fallen far behind the conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Shibo Zhou , Xiaohua LI , Ying Chen , Sanjeev T. Chandrasekaran , Arindam Sanyal

Deep learning's success comes with growing energy demands, raising concerns about the long-term sustainability of the field. Spiking neural networks, inspired by biological neurons, offer a promising alternative with potential computational…

Neural and Evolutionary Computing · Computer Science 2025-03-05 Adalbert Fono , Manjot Singh , Ernesto Araya , Philipp C. Petersen , Holger Boche , Gitta Kutyniok