中文
相关论文

相关论文: On Reducing Activity with Distillation and Regular…

200 篇论文

Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train spiking neural networks with backpropagation, leading to…

神经与进化计算 · 计算机科学 2023-05-24 Dongcheng Zhao , Guobin Shen , Yiting Dong , Yang Li , Yi Zeng

Knowledge distillation (KD) is a very popular method for model size reduction. Recently, the technique is exploited for quantized deep neural networks (QDNNs) training as a way to restore the performance sacrificed by word-length reduction.…

机器学习 · 计算机科学 2019-10-24 Sungho Shin , Yoonho Boo , Wonyong Sung

The intrinsic dynamics and event-driven nature of spiking neural networks (SNNs) make them excel in processing temporal information by naturally utilizing embedded time sequences as time steps. Recent studies adopting this approach have…

机器学习 · 计算机科学 2024-12-18 Jiaqi Wang , Liutao Yu , Liwei Huang , Chenlin Zhou , Han Zhang , Zhenxi Song , Min Zhang , Zhengyu Ma , Zhiguo Zhang

Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In…

神经与进化计算 · 计算机科学 2024-10-31 Anagha Nimbekar , Prabodh Katti , Chen Li , Bashir M. Al-Hashimi , Amit Acharyya , Bipin Rajendran

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

信号处理 · 电气工程与系统科学 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen

Deep neural networks (DNNs) have improved NLP tasks significantly, but training and maintaining such networks could be costly. Model compression techniques, such as, knowledge distillation (KD), have been proposed to address the issue;…

计算与语言 · 计算机科学 2023-11-08 Manas Mohanty , Tanya Roosta , Peyman Passban

Spiking Neural Networks (SNNs) have gained popularity due to their high energy efficiency. Prior works have proposed various methods for training SNNs, including backpropagation-based methods. Training SNNs is computationally expensive…

信号处理 · 电气工程与系统科学 2024-11-18 Sai Sanjeet , Bibhu Datta Sahoo , Keshab K. Parhi

Spiking Neural Networks (SNNs) are distinguished from Artificial Neural Networks (ANNs) for their complex neuronal dynamics and sparse binary activations (spikes) inspired by the biological neural system. Traditional neuron models use…

神经与进化计算 · 计算机科学 2025-10-31 Peng Xue , Wei Fang , Zhengyu Ma , Zihan Huang , Zhaokun Zhou , Yonghong Tian , Timothée Masquelier , Huihui Zhou

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Recent advancements have focused on directly training high-performance SNNs by estimating the…

神经与进化计算 · 计算机科学 2025-05-20 Jiaqiang Jiang , Lei Wang , Runhao Jiang , Jing Fan , Rui Yan

Neural network pruning reduces the computational cost of an over-parameterized network to improve its efficiency. Popular methods vary from $\ell_1$-norm sparsification to Neural Architecture Search (NAS). In this work, we propose a novel…

机器学习 · 计算机科学 2020-06-05 Yonathan Aflalo , Asaf Noy , Ming Lin , Itamar Friedman , Lihi Zelnik

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

计算机视觉与模式识别 · 计算机科学 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

As well known, the huge memory and compute costs of both artificial neural networks (ANNs) and spiking neural networks (SNNs) greatly hinder their deployment on edge devices with high efficiency. Model compression has been proposed as a…

神经与进化计算 · 计算机科学 2020-08-21 Lei Deng , Yujie Wu , Yifan Hu , Ling Liang , Guoqi Li , Xing Hu , Yufei Ding , Peng Li , Yuan Xie

Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial…

神经与进化计算 · 计算机科学 2023-02-02 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

神经与进化计算 · 计算机科学 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Spiking neural networks (SNNs) can utilize spatio-temporal information and have a nature of energy efficiency which is a good alternative to deep neural networks(DNNs). The event-driven information processing makes SNNs can reduce the…

神经与进化计算 · 计算机科学 2021-12-15 Changqing Xu , Yi Liu , Yintang Yang

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

神经与进化计算 · 计算机科学 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Brain inspired spiking neural networks (SNNs) have been successfully applied to many pattern recognition domains. The SNNs based deep structure have achieved considerable results in perceptual tasks, such as image classification, target…

神经与进化计算 · 计算机科学 2022-06-09 Yinqian Sun , Yi Zeng , Yang Li

Spiking neural networks (SNNs) that mimic information transmission in the brain can energy-efficiently process spatio-temporal information through discrete and sparse spikes, thereby receiving considerable attention. To improve accuracy and…

神经与进化计算 · 计算机科学 2022-06-14 Byunggook Na , Jisoo Mok , Seongsik Park , Dongjin Lee , Hyeokjun Choe , Sungroh Yoon