English
Related papers

Related papers: Deep activity propagation via weight initializatio…

200 papers

Brain-inspired spiking neural networks (SNNs) have recently drawn more and more attention due to their event-driven and energy-efficient characteristics. The integration of storage and computation paradigm on neuromorphic hardwares makes…

Neural and Evolutionary Computing · Computer Science 2022-10-14 Yufei Guo , Liwen Zhang , Yuanpei Chen , Xinyi Tong , Xiaode Liu , YingLei Wang , Xuhui Huang , Zhe Ma

The proliferation of Artificial Neural Networks (ANNs) has led to increased energy consumption, raising concerns about their sustainability. Spiking Neural Networks (SNNs), which are inspired by biological neural systems and operate using…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Lucas Deckers , Benjamin Vandersmissen , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré

The deep learning literature is continuously updated with new architectures and training techniques. However, weight initialization is overlooked by most recent research, despite some intriguing findings regarding random weights. On the…

Neural and Evolutionary Computing · Computer Science 2022-07-19 Leonardo Scabini , Bernard De Baets , Odemir M. Bruno

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

Emerging Technologies · Computer Science 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Spiking neural networks (SNNs) represent the most prominent biologically inspired computing model for neuromorphic computing (NC) architectures. However, due to the non-differentiable nature of spiking neuronal functions, the standard error…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jibin Wu , Yansong Chua , Malu Zhang , Guoqi Li , Haizhou Li , Kay Chen Tan

Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct…

Neural and Evolutionary Computing · Computer Science 2024-07-12 Chenlin Zhou , Han Zhang , Liutao Yu , Yumin Ye , Zhaokun Zhou , Liwei Huang , Zhengyu Ma , Xiaopeng Fan , Huihui Zhou , Yonghong Tian

Spiking Neural Networks (SNNs) emerged as a promising solution in the field of Artificial Neural Networks (ANNs), attracting the attention of researchers due to their ability to mimic the human brain and process complex information with…

Neural and Evolutionary Computing · Computer Science 2023-09-12 Pavithra Koralalage , Ireoluwa Fakeye , Pedro Machado , Jason Smith , Isibor Kennedy Ihianle , Salisu Wada Yahaya , Andreas Oikonomou , Ahmad Lotfi

Spiking neural networks (SNNs) are a viable alternative to conventional artificial neural networks when resource efficiency and computational complexity are of importance. A major advantage of SNNs is their binary information transfer…

Neural and Evolutionary Computing · Computer Science 2023-10-18 Daniel Gerlinghoff , Tao Luo , Rick Siow Mong Goh , Weng-Fai Wong

Spiking Neural Networks (SNNs), providing more realistic neuronal dynamics, have been shown to achieve performance comparable to Artificial Neural Networks (ANNs) in several machine learning tasks. Information is processed as spikes within…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Jiaqi Lin , Sen Lu , Malyaban Bal , Abhronil Sengupta

Bio-inspired Spiking Neural Networks (SNN) are now demonstrating comparable accuracy to intricate convolutional neural networks (CNN), all while delivering remarkable energy and latency efficiency when deployed on neuromorphic hardware. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gourav Datta , Zeyu Liu , James Diffenderfer , Bhavya Kailkhura , Peter A. Beerel

Deep 'Analog Artificial Neural Networks' (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The…

Emerging Technologies · Computer Science 2018-04-17 Parami Wijesinghe , Aayush Ankit , Abhronil Sengupta , Kaushik Roy

Reducing energy consumption is a critical point for neural network models running on edge devices. In this regard, reducing the number of multiply-accumulate (MAC) operations of Deep Neural Networks (DNNs) running on edge hardware…

Neural and Evolutionary Computing · Computer Science 2022-04-05 Simon Narduzzi , Siavash A. Bigdeli , Shih-Chii Liu , L. Andrea Dunbar

Deep neural networks (DNNs) form the backbone of almost every state-of-the-art technique in the fields such as computer vision, speech processing, and text analysis. The recent advances in computational technology have made the use of DNNs…

Machine Learning · Computer Science 2018-03-20 Saiprasad Koturwar , Shabbir Merchant

Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. Moreover, compared to classic artificial neural networks, they could serve as an energy-efficient deployment of AI…

Neural and Evolutionary Computing · Computer Science 2021-09-24 Justus F. Hübotter , Pablo Lanillos , Jakub M. Tomczak

Bio-inspired spiking neural networks (SNNs), operating with asynchronous binary signals (or spikes) distributed over time, can potentially lead to greater computational efficiency on event-driven hardware. The state-of-the-art SNNs suffer…

Neural and Evolutionary Computing · Computer Science 2020-12-03 Nitin Rathi , Kaushik Roy

Deep spiking neural networks (SNNs) support asynchronous event-driven computation, massive parallelism and demonstrate great potential to improve the energy efficiency of its synchronous analog counterpart. However, insufficient attention…

Neural and Evolutionary Computing · Computer Science 2019-02-18 Jibin Wu , Yansong Chua , Malu Zhang , Qu Yang , Guoqi Li , Haizhou Li

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency benefits due to sparse, event-driven computation. Non-spiking artificial neural networks are typically trained with stochastic gradient descent using…

Neural and Evolutionary Computing · Computer Science 2021-11-19 Jason Allred , Kaushik Roy

Spiking Neural Networks (SNNs) are highly energy-efficient during inference, making them particularly suitable for deployment on neuromorphic hardware. Their ability to process event-driven inputs, such as data from dynamic vision sensors…

Machine Learning · Computer Science 2025-04-10 Sirine Arfa , Bernhard Vogginger , Chen Liu , Johannes Partzsch , Mark Schone , Christian Mayr

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

Neural fields are an emerging paradigm that represent data as continuous functions parameterized by neural networks. Despite many advantages, neural fields often have a high training cost, which prevents a broader adoption. In this paper,…

Machine Learning · Computer Science 2026-02-04 Taesun Yeom , Sangyoon Lee , Jaeho Lee