English
Related papers

Related papers: Efficient Implementation of a Multi-Layer Gradient…

200 papers

As the third-generation neural network, the Spiking Neural Network (SNN) has the advantages of low power consumption and high energy efficiency, making it suitable for implementation on edge devices. More recently, the most advanced SNN,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yue Liu , Shanlin Xiao , Bo Li , Zhiyi Yu

We propose a Spiking Neural Network (SNN)-based explicit numerical scheme for long time integration of time-dependent Ordinary and Partial Differential Equations (ODEs, PDEs). The core element of the method is a SNN, trained to use…

Numerical Analysis · Mathematics 2022-11-21 Qian Zhang , Adar Kahana , George Em Karniadakis , Panos Stinis

Edge computing scenarios necessitate the development of hardware-efficient online continual learning algorithms to be adaptive to dynamic environment. However, existing algorithms always suffer from high memory overhead and bias towards…

Neural and Evolutionary Computing · Computer Science 2025-10-17 Erliang Lin , Wenbin Luo , Wei Jia , Yu Chen , Shaofu Yang

Spiking neural networks (SNNs) have made great progress on both performance and efficiency over the last few years,but their unique working pattern makes it hard to train a high-performance low-latency SNN.Thus the development of SNNs still…

Neural and Evolutionary Computing · Computer Science 2022-11-22 Yudong Li , Yunlin Lei , Xu Yang

Energy efficiency remains a critical challenge in deploying physics-informed operator learning models for computational mechanics and scientific computing, particularly in power-constrained settings such as edge and embedded devices, where…

Computational Physics · Physics 2026-03-24 Shailesh Garg , Luis Mandl , Somdatta Goswami , Souvik Chakraborty

On-chip edge intelligence has necessitated the exploration of algorithmic techniques to reduce the compute requirements of current machine learning frameworks. This work aims to bridge the recent algorithmic progress in training Binary…

Machine Learning · Computer Science 2020-10-28 Sen Lu , Abhronil Sengupta

Although widely used in machine learning, backpropagation cannot directly be applied to SNN training and is not feasible on a neuromorphic processor that emulates biological neuron and synapses. This work presents a spike-based…

Neural and Evolutionary Computing · Computer Science 2021-05-11 Amar Shrestha , Haowen Fang , Daniel Patrick Rider , Zaidao Mei , Qinru Qiu

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by the goal of…

Neural and Evolutionary Computing · Computer Science 2022-11-02 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

Spiking neural network (SNN) is studied in multidisciplinary domains to (i) enable order-of-magnitudes energy-efficient AI inference and (ii) computationally simulate neuro-scientific mechanisms. The lack of discrete theory obstructs the…

Neural and Evolutionary Computing · Computer Science 2024-07-03 Hyunseok Oh , Youngki Lee

Advancements in adapting deep convolution architectures for Spiking Neural Networks (SNNs) have significantly enhanced image classification performance and reduced computational burdens. However, the inability of Multiplication-Free…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Boyan Li , Luziwei Leng , Shuaijie Shen , Kaixuan Zhang , Jianguo Zhang , Jianxing Liao , Ran Cheng

Neuromorphic engineers aim to develop event-based spiking neural networks (SNNs) in hardware. These SNNs closer resemble dynamics of biological neurons than todays' artificial neural networks and achieve higher efficiency thanks to the…

Neurons and Cognition · Quantitative Biology 2019-06-25 Hajar Asgari , BabakMazloom-Nezhad Maybodi , Raphaela Kreiser , Yulia Sandamirskaya

Spiking neural networks (SNNs) are known as a typical kind of brain-inspired models with their unique features of rich neuronal dynamics, diverse coding schemes and low power consumption properties. How to obtain a high-accuracy model has…

Neural and Evolutionary Computing · Computer Science 2022-03-07 Yihan Lin , Yifan Hu , Shijie Ma , Guoqi Li , Dongjie Yu

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

Physics-informed neural networks and operator networks have shown promise for effectively solving equations modeling physical systems. However, these networks can be difficult or impossible to train accurately for some systems of equations.…

Machine Learning · Computer Science 2023-11-22 Amanda A Howard , Sarah H Murphy , Shady E Ahmed , Panos Stinis

Operational Neural Networks (ONNs) have recently been proposed to address the well-known limitations and drawbacks of conventional Convolutional Neural Networks (CNNs) such as network homogeneity with the sole linear neuron model. ONNs are…

Machine Learning · Computer Science 2020-04-27 Serkan Kiranyaz , Junaid Malik , Habib Ben Abdallah , Turker Ince , Alexandros Iosifidis , Moncef Gabbouj

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Event cameras are considered to have great potential for computer vision and robotics applications because of their high temporal resolution and low power consumption characteristics. However, the event stream output from event cameras has…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Xiaoshan Wu , Weihua He , Man Yao , Ziyang Zhang , Yaoyuan Wang , Guoqi Li

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to…

Neurons and Cognition · Quantitative Biology 2022-12-02 Melani Sanchez-Garcia , Tushar Chauhan , Benoit R. Cottereau , Michael Beyeler

Gradient-based optimization has been a cornerstone of machine learning that enabled the vast advances of Artificial Intelligence (AI) development over the past decades. However, this type of optimization requires differentiation, and with…