English
Related papers

Related papers: Scaling Spike-driven Transformer with Efficient Sp…

200 papers

Deep 'Analog Artificial Neural Networks' (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The…

Emerging Technologies · Computer Science 2018-04-17 Parami Wijesinghe , Aayush Ankit , Abhronil Sengupta , Kaushik Roy

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

Spiking neural networks (SNNs) are posited as a computationally efficient and biologically plausible alternative to conventional neural architectures, with their core computational framework primarily using the leaky integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2025-03-18 Malyaban Bal , Abhronil Sengupta

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

The proliferation of Artificial Neural Networks (ANNs) has led to increased energy consumption, raising concerns about their sustainability. Spiking Neural Networks (SNNs), which are inspired by biological neural systems and operate using…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Lucas Deckers , Benjamin Vandersmissen , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré

In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researchers have proposed…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Ryuji Saiin , Tomoya Shirakawa , Sota Yoshihara , Yoshihide Sawada , Hiroyuki Kusumoto

Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low…

Neural and Evolutionary Computing · Computer Science 2020-02-05 Mihaela Dimovska , Travis Johnston , Catherine D. Schuman , J. Parker Mitchell , Thomas E. Potok

In order to port the performance of trained artificial neural networks (ANNs) to spiking neural networks (SNNs), which can be implemented in neuromorphic hardware with a drastically reduced energy consumption, an efficient ANN to SNN…

Neural and Evolutionary Computing · Computer Science 2020-01-22 Christoph Stöckl , Wolfgang Maass

Spiking Transformers have gained considerable attention because they achieve both the energy efficiency of Spiking Neural Networks (SNNs) and the high capacity of Transformers. However, the existing Spiking Transformer architectures,…

Neural and Evolutionary Computing · Computer Science 2023-12-15 Ziqing Wang , Qidong Zhao , Jinku Cui , Xu Liu , Dongkuan Xu

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dynamics of biological neural networks. While SNNs show…

Artificial Intelligence · Computer Science 2024-08-02 Yanchen Li , Jiachun Li , Kebin Sun , Luziwei Leng , Ran Cheng

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

Spiking Neural Networks (SNNs) have gained attention for their energy-efficient machine learning capabilities, utilizing bio-inspired activation functions and sparse binary spike-data representations. While recent SNN algorithmic advances…

Neural and Evolutionary Computing · Computer Science 2023-09-08 Abhiroop Bhattacharjee , Ruokai Yin , Abhishek Moitra , Priyadarshini Panda

Spiking neural networks (SNNs) offer both compelling potential advantages, including energy efficiency and low latencies and challenges including the non-differentiable nature of event spikes. Much of the initial research in this area has…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Somayeh Hussaini , Michael Milford , Tobias Fischer

As deep learning models scale, they become increasingly competitive from domains spanning from computer vision to natural language processing; however, this happens at the expense of efficiency since they require increasingly more memory…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Fabrizio Ottati , Chang Gao , Qinyu Chen , Giovanni Brignone , Mario R. Casu , Jason K. Eshraghian , Luciano Lavagno

Spiking neural networks (SNNs) have been widely used due to their strong biological interpretability and high energy efficiency. With the introduction of the backpropagation algorithm and surrogate gradient, the structure of spiking neural…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Jindong Li , Guobin Shen , Dongcheng Zhao , Qian Zhang , Yi Zeng

Speech Emotion Recognition (SER) is widely deployed in Human-Computer Interaction, yet the high computational cost of conventional models hinders their implementation on resource-constrained edge devices. Spiking Neural Networks (SNNs)…

Artificial Intelligence · Computer Science 2026-02-10 Xun Su , Huamin Wang , Qi Zhang

Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments. However, the scenario becomes particularly challenging when data samples are insufficient,…

Machine Learning · Computer Science 2026-05-12 Huijing Zhang , Muyang Cao , Linshan Jiang , Xin Du , Di Yu , Changze Lv , Shuiguang Deng

Spiking Neural Network (SNN), originating from the neural behavior in biology, has been recognized as one of the next-generation neural networks. Conventionally, SNNs can be obtained by converting from pre-trained Artificial Neural Networks…

Neural and Evolutionary Computing · Computer Science 2022-05-23 Yuhang Li , Shikuang Deng , Xin Dong , Shi Gu
‹ Prev 1 8 9 10 Next ›