English
Related papers

Related papers: Trimming Down Large Spiking Vision Transformers vi…

200 papers

Recent trends have shown that autonomous agents, such as Autonomous Ground Vehicles (AGVs), Unmanned Aerial Vehicles (UAVs), and mobile robots, effectively improve human productivity in solving diverse tasks. However, since these agents are…

Robotics · Computer Science 2024-06-19 Rachmad Vidya Wicaksana Putra , Alberto Marchisio , Muhammad Shafique

As well known, the huge memory and compute costs of both artificial neural networks (ANNs) and spiking neural networks (SNNs) greatly hinder their deployment on edge devices with high efficiency. Model compression has been proposed as a…

Neural and Evolutionary Computing · Computer Science 2020-08-21 Lei Deng , Yujie Wu , Yifan Hu , Ling Liang , Guoqi Li , Xing Hu , Yufei Ding , Peng Li , Yuan Xie

Spiking Neural Networks (SNNs), known for their biologically plausible architecture, face the challenge of limited performance. The self-attention mechanism, which is the cornerstone of the high-performance Transformer and also a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Zhaokun Zhou , Kaiwei Che , Wei Fang , Keyu Tian , Yuesheng Zhu , Shuicheng Yan , Yonghong Tian , Li Yuan

Spike-based neuromorphic hardware promises to reduce the energy consumption of image classification and other deep learning applications, particularly on mobile phones or other edge devices. However, direct training of deep spiking neural…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Christoph Stöckl , Wolfgang Maass

In recent years Deep Neural Networks (DNNs) have been rapidly developed in various applications, together with increasingly complex architectures. The performance gain of these DNNs generally comes with high computational costs and large…

Machine Learning · Computer Science 2017-12-05 Yiren Zhou , Seyed-Mohsen Moosavi-Dezfooli , Ngai-Man Cheung , Pascal Frossard

Spiking neural networks (SNNs) are becoming a promising alternative to conventional artificial neural networks (ANNs) due to their rich neural dynamics and the implementation of energy-efficient neuromorphic chips. However, the…

Artificial Intelligence · Computer Science 2024-08-27 Jiahao Su , Kang You , Zekai Xu , Weizhi Xu , Zhezhi He

Instantaneous and on demand accuracy-efficiency trade-off has been recently explored in the context of neural networks slimming. In this paper, we propose a flexible quantization strategy, termed Switchable Precision neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Luis Guerra , Bohan Zhuang , Ian Reid , Tom Drummond

The surge in interest in Artificial Intelligence (AI) over the past decade has been driven almost exclusively by advances in Artificial Neural Networks (ANNs). While ANNs set state-of-the-art performance for many previously intractable…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Peter G. Stratton , Andrew Wabnitz , Chip Essam , Allen Cheung , Tara J. Hamilton

As the size of large language models continue to scale, so does the computational resources required to run it. Spiking Neural Networks (SNNs) have emerged as an energy-efficient approach to deep learning that leverage sparse and…

Computation and Language · Computer Science 2024-07-12 Rui-Jie Zhu , Qihang Zhao , Guoqi Li , Jason K. Eshraghian

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

Spiking neural networks (SNNs) provide an energy-efficient alternative to a variety of artificial neural network (ANN) based AI applications. As the progress in neuromorphic computing with SNNs expands their use in applications, the problem…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Ozan Özdenizci , Robert Legenstein

Deep learning has revolutionized artificial intelligence (AI), achieving remarkable progress in fields such as computer vision, speech recognition, and natural language processing. Moreover, the recent success of large language models…

Machine Learning · Computer Science 2024-09-05 Yangfan Hu , Qian Zheng , Guoqi Li , Huajin Tang , Gang Pan

Edge detection with Artificial Neural Networks (ANNs) has achieved remarkable prog\-ress but faces two major challenges. First, it requires pre-training on large-scale extra data and complex designs for prior knowledge, leading to high…

Neural and Evolutionary Computing · Computer Science 2025-11-19 Yimeng Fan , Changsong Liu , Mingyang Li , Yuzhou Dai , Yanyan Liu , Wei Zhang

Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent…

Neural and Evolutionary Computing · Computer Science 2020-02-25 Changqing Xu , Wenrui Zhang , Yu Liu , Peng Li

Recently, spiking neural networks (SNNs) have demonstrated substantial potential in computer vision tasks. In this paper, we present an Efficient Spiking Deraining Network, called ESDNet. Our work is motivated by the observation that rain…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Tianyu Song , Guiyue Jin , Pengpeng Li , Kui Jiang , Xiang Chen , Jiyu Jin

Spiking Neural Networks (SNNs) have gained significant attention as a potentially energy-efficient alternative for standard neural networks with their sparse binary activation. However, SNNs suffer from memory and computation overhead due…

Neural and Evolutionary Computing · Computer Science 2026-03-09 Donghyun Lee , Ruokai Yin , Youngeun Kim , Abhishek Moitra , Yuhang Li , Priyadarshini Panda

Recently, brain-inspired spiking neural networks (SNNs) have demonstrated promising capabilities in solving pattern recognition tasks. However, these SNNs are grounded on homogeneous neurons that utilize a uniform neural coding for…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Xinyi Chen , Qu Yang , Jibin Wu , Haizhou Li , Kay Chen Tan

Spiking Neural Networks (SNNs), providing more realistic neuronal dynamics, have been shown to achieve performance comparable to Artificial Neural Networks (ANNs) in several machine learning tasks. Information is processed as spikes within…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Jiaqi Lin , Sen Lu , Malyaban Bal , Abhronil Sengupta

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct…

Neural and Evolutionary Computing · Computer Science 2024-07-12 Chenlin Zhou , Han Zhang , Liutao Yu , Yumin Ye , Zhaokun Zhou , Liwei Huang , Zhengyu Ma , Xiaopeng Fan , Huihui Zhou , Yonghong Tian