中文
相关论文

相关论文: Traces Propagation: Memory-Efficient and Scalable …

200 篇论文

Spiking Neural Network (SNN) is acknowledged as the next generation of Artificial Neural Network (ANN) and hold great promise in effectively processing spatial-temporal information. However, the choice of timestep becomes crucial as it…

神经与进化计算 · 计算机科学 2024-05-03 Dengyu Wu , Yi Qi , Kaiwen Cai , Gaojie Jin , Xinping Yi , Xiaowei Huang

Spiking Neural Networks (SNNs) are distinguished from Artificial Neural Networks (ANNs) for their complex neuronal dynamics and sparse binary activations (spikes) inspired by the biological neural system. Traditional neuron models use…

神经与进化计算 · 计算机科学 2025-10-31 Peng Xue , Wei Fang , Zhengyu Ma , Zihan Huang , Zhaokun Zhou , Yonghong Tian , Timothée Masquelier , Huihui Zhou

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

神经与进化计算 · 计算机科学 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Spiking neural networks (SNNs) provide an energy-efficient solution by utilizing the spike-based and sparse nature of biological systems. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on long…

神经与进化计算 · 计算机科学 2024-10-24 Yan Zhong , Ruoyu Zhao , Chao Wang , Qinghai Guo , Jianguo Zhang , Zhichao Lu , Luziwei Leng

Recurrent neural networks (RNNs) have recently demonstrated strong performance and faster inference than Transformers at comparable parameter budgets. However, the recursive gradient computation with the backpropagation through time (or…

机器学习 · 计算机科学 2025-04-01 Paul Caillon , Erwan Fagnou , Alexandre Allauzen

As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing…

神经与进化计算 · 计算机科学 2024-08-26 Sai Deepesh Pokala , Marie Bernert , Takuya Nanami , Takashi Kohno , Timothée Lévi , Blaise Yvert

There has been an increasing interest in spiking neural networks in recent years. SNNs are seen as hypothetical solutions for the bottlenecks of ANNs in pattern recognition, such as energy efficiency. But current methods such as ANN-to-SNN…

计算机视觉与模式识别 · 计算机科学 2021-07-06 El-Assal Mireille , Tirilly Pierre , Bilasco Ioan Marius

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning focused applications…

神经与进化计算 · 计算机科学 2022-05-30 Samuel Schmidgall , Julia Ashkanazy , Wallace Lawson , Joe Hays

Spiking Neural Networks (SNNs) are biologically-inspired deep neural networks that efficiently extract temporal information while offering promising gains in terms of energy efficiency and latency when deployed on neuromorphic devices. SNN…

机器学习 · 计算机科学 2026-02-19 Sanja Karilanova , Maxime Fabre , Emre Neftci , Ayça Özçelikkale

Spiking neural networks (SNN) are able to learn spatiotemporal features while using less energy, especially on neuromorphic hardware. The most widely used spiking neuron in deep learning is the Leaky Integrate and Fire (LIF) neuron. LIF…

神经与进化计算 · 计算机科学 2023-08-08 Sidi Yaya Arnaud Yarga , Sean U. N. Wood

Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural networks, back-propagation through time (BPTT), requires credit…

机器学习 · 计算机科学 2018-09-12 Nan Rosemary Ke , Anirudh Goyal , Olexa Bilaniuk , Jonathan Binas , Michael C. Mozer , Chris Pal , Yoshua Bengio

A long-standing proposition is that by emulating the operation of the brain's neocortex, a spiking neural network (SNN) can achieve similar desirable features: flexible learning, speed, and efficiency. Temporal neural networks (TNNs) are…

神经与进化计算 · 计算机科学 2021-02-24 James E. Smith

Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic…

神经与进化计算 · 计算机科学 2021-09-07 Wachirawit Ponghiran , Kaushik Roy

Spiking Neural Networks (SNNs) promise energy-efficient, sparse, biologically inspired computation. Training them with Backpropagation Through Time (BPTT) and surrogate gradients achieves strong performance but remains biologically…

新兴技术 · 计算机科学 2025-11-17 Jiaqi Lin , Yi Jiang , Abhronil Sengupta

In recent years, spiking neural networks (SNNs) have attracted substantial interest due to their potential to replicate the energy-efficient and event-driven processing of biological neurons. Despite this, the application of SNNs in graph…

人工智能 · 计算机科学 2024-07-31 Mingkun Xu , Huifeng Yin , Yujie Wu , Guoqi Li , Faqiang Liu , Jing Pei , Shuai Zhong , Lei Deng

Spiking neural networks (SNNs) communicate via discrete spikes in time rather than continuous activations. Their event-driven nature offers advantages for temporal processing and energy efficiency on resource-constrained hardware, but…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Karol C. Jurzec , Tomasz Szydlo , Maciej Wielgosz

Spiking Neural Networks (SNNs) are gaining significant traction in machine learning tasks where energy-efficiency is of utmost importance. Training such networks using the state-of-the-art back-propagation through time (BPTT) is, however,…

神经与进化计算 · 计算机科学 2022-05-23 Felix Christian Bauer , Gregor Lenz , Saeid Haghighatshoar , Sadique Sheik

Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Tianqing Zhang , Kairong Yu , Xian Zhong , Hongwei Wang , Qi Xu , Qiang Zhang

Spiking neural networks (SNNs) compute with discrete spikes and exploit temporal structure, yet most adversarial attacks change intensities or event counts instead of timing. We study a timing-only adversary that retimes existing spikes…

密码学与安全 · 计算机科学 2026-02-10 Yi Yu , Qixin Zhang , Shuhan Ye , Xun Lin , Qianshan Wei , Kun Wang , Wenhan Yang , Dacheng Tao , Xudong Jiang

Memristor-based Spiking Neural Networks (SNNs) with temporal spike encoding enable ultra-low-energy computation, making them ideal for battery-powered intelligent devices. This paper presents a circuit-level memristive spiking neural…

新兴技术 · 计算机科学 2025-07-29 Santlal Prajapati , Susmita Sur-Kolay , Soumyadeep Dutta