English
Related papers

Related papers: Dynamic Activation with Knowledge Distillation for…

200 papers

ISAC enables pervasive monitoring, but modern sensing algorithms are often too complex for energy-constrained edge devices. This motivates the development of learning techniques that balance accuracy performance and energy efficiency.…

Neural and Evolutionary Computing · Computer Science 2026-02-09 Eleonora Cicciarella , Riccardo Mazzieri , Jacopo Pegoraro , Michele Rossi

Recent advancements in neuroscience research have propelled the development of Spiking Neural Networks (SNNs), which not only have the potential to further advance neuroscience research but also serve as an energy-efficient alternative to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yimeng Shan , Malu Zhang , Rui-jie Zhu , Xuerui Qiu , Jason K. Eshraghian , Haicheng Qu

Edge-cloud co-inference enables efficient deep neural network (DNN) deployment by splitting the architecture between an edge device and cloud server, crucial for resource-constraint edge devices. This approach requires balancing on-device…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Maruf Hassan , Steven Davy

Inspired by the human brain's ability to adapt to new tasks without erasing prior knowledge, we develop spiking neural networks (SNNs) with dynamic structures for Class Incremental Learning (CIL). Our comparative experiments reveal that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Wenyao Ni , Jiangrong Shen , Qi Xu , Huajin Tang

Spiking Neural Networks (SNNs), as a biologically plausible alternative to Artificial Neural Networks (ANNs), have demonstrated advantages in terms of energy efficiency, temporal processing, and biological plausibility. However, SNNs are…

Machine Learning · Computer Science 2025-09-22 Xinyu Luo , Kecheng Chen , Pao-Sheng Vincent Sun , Chris Xing Tian , Arindam Basu , Haoliang Li

Over the past decade, deep neural networks (DNNs) have demonstrated remarkable performance in a variety of applications. As we try to solve more advanced problems, increasing demands for computing and power resources has become inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Seijoon Kim , Seongsik Park , Byunggook Na , Sungroh Yoon

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Shahriar Rezghi Shirsavar , Abdol-Hossein Vahabie , Mohammad-Reza A. Dehaqani

Spiking neural networks (SNNs) have shown advantages in computation and energy efficiency over traditional artificial neural networks (ANNs) thanks to their event-driven representations. SNNs also replace weight multiplications in ANNs with…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Yangfan Hu , Qian Zheng , Xudong Jiang , Gang Pan

This paper presents a novel cloud-edge framework for addressing computational and energy constraints in complex control systems. Our approach centers around a learning-based controller using Spiking Neural Networks (SNN) on physical plants.…

Systems and Control · Electrical Eng. & Systems 2024-05-07 Reza Ahmadvand , Sarah Safura Sharif , Yaser Mike Banad

By exploiting discrete signal processing and simulating brain neuron communication, Spiking Neural Networks (SNNs) offer a low-energy alternative to Artificial Neural Networks (ANNs). However, existing SNN models, still face high…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Wenxuan Pan , Feifei Zhao , Bing Han , Haibo Tong , Yi Zeng

Deep Spiking Neural Networks (SNNs) present optimization difficulties for gradient-based approaches due to discrete binary activation and complex spatial-temporal dynamics. Considering the huge success of ResNet in deep learning, it would…

Neural and Evolutionary Computing · Computer Science 2022-01-25 Wei Fang , Zhaofei Yu , Yanqi Chen , Tiejun Huang , Timothée Masquelier , Yonghong Tian

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Henrique Branquinho , Nuno Lourenço , Ernesto Costa

Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Tianqing Zhang , Kairong Yu , Xian Zhong , Hongwei Wang , Qi Xu , Qiang Zhang

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

Hardware Architecture · Computer Science 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze

Biologically-inspired Spiking Neural Networks (SNNs), processing information using discrete-time events known as spikes rather than continuous values, have garnered significant attention due to their hardware-friendly and energy-efficient…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Bin Lei , Sheng Lin , Pei-Hung Lin , Chunhua Liao , Caiwen Ding

Spiking Neural Networks (SNNs) offer promising energy-efficient alternatives to large language models (LLMs) due to their event-driven nature and ultra-low power consumption. However, to preserve capacity, most existing spiking LLMs still…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Sihang Guo , Chenlin Zhou , Jiaqi Wang , Kehai Chen , Qingyan Meng , Zhengyu Ma

Deep Neural Networks (DNNs) are the current state-of-the-art models in many speech related tasks. There is a growing interest, though, for more biologically realistic, hardware friendly and energy efficient models, named Spiking Neural…

Machine Learning · Computer Science 2020-11-16 Thomas Pellegrini , Romain Zimmer , Timothée Masquelier

Spiking Neural Networks (SNNs) are distinguished from Artificial Neural Networks (ANNs) for their complex neuronal dynamics and sparse binary activations (spikes) inspired by the biological neural system. Traditional neuron models use…

Neural and Evolutionary Computing · Computer Science 2025-10-31 Peng Xue , Wei Fang , Zhengyu Ma , Zihan Huang , Zhaokun Zhou , Yonghong Tian , Timothée Masquelier , Huihui Zhou