中文
相关论文

相关论文: Otters: An Energy-Efficient SpikingTransformer via…

200 篇论文

Spiking Neural Networks (SNNs) offer an attractive and energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their sparse binary activation. When SNN meets Transformer, it shows great potential in 2D image…

机器学习 · 计算机科学 2025-02-27 Peixi Wu , Bosong Chai , Hebei Li , Menghua Zheng , Yansong Peng , Zeyu Wang , Xuan Nie , Yueyi Zhang , Xiaoyan Sun

Spiking neural networks (SNNs) are well suited for resource-constrained applications as they do not need expensive multipliers. In a typical rate-encoded SNN, a series of binary spikes within a globally fixed time window is used to fire the…

神经与进化计算 · 计算机科学 2022-11-16 Zhanglu Yan , Jun Zhou , Weng-Fai Wong

In the training and inference of spiking neural networks (SNNs), direct training and lightweight computation methods have been orthogonally developed, aimed at reducing power consumption. However, only a limited number of approaches have…

人工智能 · 计算机科学 2024-08-23 Donghwa Kang , Youngmoon Lee , Eun-Kyu Lee , Brent Kang , Jinkyu Lee , Hyeongboo Baek

Spiking neural networks (SNNs), which are inspired by the human brain, have recently gained popularity due to their relatively simple and low-power hardware for transmitting binary spikes and highly sparse activation maps. However, because…

硬件体系结构 · 计算机科学 2022-05-03 Hong-Han Lien , Tian-Sheuan Chang

The demand for edge artificial intelligence to process event-based, complex data calls for hardware beyond conventional digital, von-Neumann architectures. Neuromorphic computing, using spiking neural networks (SNNs) with emerging…

应用物理 · 物理学 2025-09-08 Zhu Wang , Song Wang , Zhiyuan Du , Ruibin Mao , Yu Xiao , Hayden Kwok-Hay So , Peng Lin , Can Li

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

硬件体系结构 · 计算机科学 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

This paper introduces an analog spiking neuron that utilizes time-domain information, i.e., a time interval of two signal transitions and a pulse width, to construct a spiking neural network (SNN) for a hardware-friendly physical reservoir…

神经与进化计算 · 计算机科学 2025-06-06 Nanako Kimura , Ckristian Duran , Zolboo Byambadorj , Ryosho Nakane , Tetsuya Iizuka

In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researchers have proposed…

神经与进化计算 · 计算机科学 2024-07-01 Ryuji Saiin , Tomoya Shirakawa , Sota Yoshihara , Yoshihide Sawada , Hiroyuki Kusumoto

While the exponential growth of the space sector and new operative concepts ask for higher spacecraft autonomy, the development of AI-assisted space systems was so far hindered by the low availability of power and energy typical of space…

神经与进化计算 · 计算机科学 2025-12-15 Paolo Lunghi , Stefano Silvestrini , Dominik Dold , Gabriele Meoni , Alexander Hadjiivanov , Dario Izzo

The spiking neural networks (SNNs) that efficiently encode temporal sequences have shown great potential in extracting audio-visual joint feature representations. However, coupling SNNs (binary spike sequences) with transformers…

多媒体 · 计算机科学 2024-07-12 Wenrui Li , Penghong Wang , Ruiqin Xiong , Xiaopeng Fan

Spiking Neural Network (SNN) is the third generation of Neural Network (NN) mimicking the natural behavior of the brain. By processing based on binary input/output, SNNs offer lower complexity, higher density and lower power consumption.…

神经与进化计算 · 计算机科学 2020-03-24 Khanh N. Dang , Abderazek Ben Abdallah

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

机器学习 · 计算机科学 2025-09-01 Vishal Pandey , Debasmita Biswas

Spiking Neural Networks are a type of neural networks where neurons communicate using only spikes. They are often presented as a low-power alternative to classical neural networks, but few works have proven these claims to be true. In this…

硬件体系结构 · 计算机科学 2023-04-17 Edgar Lemaire , Loic Cordone , Andrea Castagnetti , Pierre-Emmanuel Novac , Jonathan Courtois , Benoit Miramond

Spiking Neural Networks (SNNs) exhibit significant potential due to their low energy consumption. Converting Artificial Neural Networks (ANNs) to SNNs is an efficient way to achieve high-performance SNNs. However, many conversion methods…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Zihan Huang , Wei Fang , Tong Bu , Peng Xue , Zecheng Hao , Wenxuan Liu , Yuanhong Tang , Zhaofei Yu , Tiejun Huang

Recently, large models, such as Vision Transformer and BERT, have garnered significant attention due to their exceptional performance. However, their extensive computational requirements lead to considerable power and hardware resource…

硬件体系结构 · 计算机科学 2025-01-15 Zhengke Li , Wendong Mao , Siyu Zhang , Qiwei Dong , Zhongfeng Wang

There is an increasing demand to process streams of temporal data in energy-limited scenarios such as embedded devices, driven by the advancement and expansion of Internet of Things (IoT) and Cyber-Physical Systems (CPS). Spiking neural…

神经与进化计算 · 计算机科学 2020-07-08 Haowen Fang , Amar Shrestha , Qinru Qiu

Multi-timestep simulation of brain-inspired Spiking Neural Networks (SNNs) boost memory requirements during training and increase inference energy cost. Current training methods cannot simultaneously solve both training and inference…

神经与进化计算 · 计算机科学 2024-05-28 JiaKui Hu , Man Yao , Xuerui Qiu , Yuhong Chou , Yuxuan Cai , Ning Qiao , Yonghong Tian , Bo XU , Guoqi Li

Spiking Neural Networks (SNNs) have shown great potential in solving deep learning problems in an energy-efficient manner. However, they are still limited to simple classification tasks. In this paper, we propose Spiking-GAN, the first…

神经与进化计算 · 计算机科学 2021-06-30 Vineet Kotariya , Udayan Ganguly

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

机器学习 · 计算机科学 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng

Spiking Neural Networks (SNNs) have a low-power advantage but perform poorly in image segmentation tasks. The reason is that directly converting neural networks with complex architectural designs for segmentation tasks into spiking versions…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Zhenxin Lei , Man Yao , Jiakui Hu , Xinhao Luo , Yanye Lu , Bo Xu , Guoqi Li