English
Related papers

Related papers: Cross Knowledge Distillation between Artificial an…

200 papers

Spiking neural networks (SNNs), which mimic biological neural system to convey information via discrete spikes, are well known as brain-inspired models with excellent computing efficiency. By utilizing the surrogate gradient estimation for…

Neural and Evolutionary Computing · Computer Science 2024-08-21 Zekai Xu , Kang You , Qinghai Guo , Xiang Wang , Zhezhi He

Spiking Neural Networks (SNNs) become popular due to excellent energy efficiency, yet facing challenges for effective model training. Recent works improve this by introducing knowledge distillation (KD) techniques, with the pre-trained…

Machine Learning · Computer Science 2025-11-17 Xu Liu , Na Xia , Jinxing Zhou , Jingyuan Xu , Dan Guo

Spiking Neural Networks (SNN) are energy-efficient computing architectures that exchange spikes for processing information, unlike classical Artificial Neural Networks (ANN). Due to this, SNNs are better suited for real-life deployments.…

Neural and Evolutionary Computing · Computer Science 2020-05-04 Ravi Kumar Kushawaha , Saurabh Kumar , Biplab Banerjee , Rajbabu Velmurugan

Spiking neural networks (SNNs) are well known as the brain-inspired models with high computing efficiency, due to a key component that they utilize spikes as information units, close to the biological neural systems. Although spiking based…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Qi Xu , Yaxin Li , Jiangrong Shen , Jian K Liu , Huajin Tang , Gang Pan

Spiking neural networks (SNNs) have garnered significant attention for their low power consumption and high biological interpretability. Their rich spatio-temporal information processing capability and event-driven nature make them ideally…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Xian Zhong , Shengwang Hu , Wenxuan Liu , Wenxin Huang , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) have been gaining interest as energy-efficient alternatives of conventional artificial neural networks (ANNs) due to their event-driven computation. Considering the future deployment of SNN models to…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Dongjin Lee , Seongsik Park , Jongwan Kim , Wuhyeong Doh , Sungroh Yoon

Spiking neural networks (SNNs), which are brain-inspired and spike-driven, achieve high energy efficiency. However, a performance gap between SNNs and artificial neural networks (ANNs) still remains. Knowledge distillation (KD) is commonly…

Machine Learning · Computer Science 2026-05-15 Kai Sun , Peibo Duan , Yongsheng Huang , Guowei Zhang , Benjamin Smith , Nanxu Gong , Levin Kuhlmann

Interest in spiking neural networks (SNNs) has been growing steadily, promising an energy-efficient alternative to formal neural networks (FNNs), commonly known as artificial neural networks (ANNs). Despite increasing interest, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Thomas Louis , Benoit Miramond , Alain Pegatoquet , Adrien Girard

Spiking Neural Networks (SNNs) are emerging as a brain-inspired alternative to traditional Artificial Neural Networks (ANNs), prized for their potential energy efficiency on neuromorphic hardware. Despite this, SNNs often suffer from…

Machine Learning · Computer Science 2025-05-29 Chengting Yu , Xiaochen Zhao , Lei Liu , Shu Yang , Gaoang Wang , Erping Li , Aili Wang

Brain-inspired spiking neural networks (SNNs) promise to be a low-power alternative to computationally intensive artificial neural networks (ANNs), although performance gaps persist. Recent studies have improved the performance of SNNs…

Machine Learning · Computer Science 2025-10-10 Yongqi Ding , Lin Zuo , Mengmeng Jing , Kunshan Yang , Pei He , Tonglan Xie

Spiking Neural Networks (SNNs) have garnered considerable attention as a potential alternative to Artificial Neural Networks (ANNs). Recent studies have highlighted SNNs' potential on large-scale datasets. For SNN training, two main…

Machine Learning · Computer Science 2025-03-24 Shu Yang , Chengting Yu , Lei Liu , Hanzhi Ma , Aili Wang , Erping Li

Cross-modal Knowledge Distillation has demonstrated promising performance on paired modalities with strong semantic connections, referred to as Symmetric Cross-modal Knowledge Distillation (SCKD). However, implementing SCKD becomes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Riling Wei , Kelu Yao , Chuanguang Yang , Jin Wang , Zhuoyan Gao , Chao Li

Spiking Neural Networks (SNNs), inspired by the human brain, offer significant computational efficiency through discrete spike-based information transfer. Despite their potential to reduce inference energy consumption, a performance gap…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Kairong Yu , Chengting Yu , Tianqing Zhang , Xiaochen Zhao , Shu Yang , Hongwei Wang , Qiang Zhang , Qi Xu

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

With the continued innovations of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention owing to their low power consumption.However, for continuous data values,…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Naoya Muramatsu , Hai-Tao Yu

In recent years, multimodal Graph Convolutional Networks (GCNs) have achieved remarkable performance in skeleton-based action recognition. The reliance on high-energy-consuming continuous floating-point operations inherent in GCN-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Naichuan Zheng , Hailun Xia , Zeyu Liang , Yuchen Du

Spiking Neural Networks (SNNs) are biologically realistic and practically promising in low-power computation because of their event-driven mechanism. Usually, the training of SNNs suffers accuracy loss on various tasks, yielding an inferior…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Di Hong , Jiangrong Shen , Yu Qi , Yueming Wang

Spiking neural networks (SNNs) are biology-inspired artificial neural networks (ANNs) that comprise of spiking neurons to process asynchronous discrete signals. While more efficient in power consumption and inference speed on the…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Shikuang Deng , Shi Gu

Spiking Neural Networks (SNNs) offer a promising and energy-efficient alternative to conventional neural networks, thanks to their sparse binary activation. However, they face challenges regarding memory and computation overhead due to…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Donghyun Lee , Abhishek Moitra , Youngeun Kim , Ruokai Yin , Priyadarshini Panda

Audio classification is an active research area with a wide range of applications. Over the past decade, convolutional neural networks (CNNs) have been the de-facto standard building block for end-to-end audio classification models.…

Sound · Computer Science 2022-03-15 Yuan Gong , Sameer Khurana , Andrew Rouditchenko , James Glass
‹ Prev 1 2 3 10 Next ›