English
Related papers

Related papers: Quantized Artificial Neural Networks Implemented w…

200 papers

Spiking neural networks (SNNs) represent the most prominent biologically inspired computing model for neuromorphic computing (NC) architectures. However, due to the non-differentiable nature of spiking neuronal functions, the standard error…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jibin Wu , Yansong Chua , Malu Zhang , Guoqi Li , Haizhou Li , Kay Chen Tan

In the training and inference of spiking neural networks (SNNs), direct training and lightweight computation methods have been orthogonally developed, aimed at reducing power consumption. However, only a limited number of approaches have…

Artificial Intelligence · Computer Science 2024-08-23 Donghwa Kang , Youngmoon Lee , Eun-Kyu Lee , Brent Kang , Jinkyu Lee , Hyeongboo Baek

Primary motivation for this work was the need to implement hardware accelerators for a newly proposed ANN structure called Auto Resonance Network (ARN) for robotic motion planning. ARN is an approximating feed-forward hierarchical and…

Neural and Evolutionary Computing · Computer Science 2024-02-02 Shilpa Mayannavar , Uday Wali

Spintronic nano-neurons offer a promising route towards energy-efficient, high-performance hardware neural networks thanks to their inherent low-input nonlinear dynamics. However, training such networks remains a major bottleneck as it…

Spiking Neural Networks (SNN) represent a biologically inspired computation model capable of emulating neural computation in human brain and brain-like structures. The main promise is very low energy consumption. Unfortunately, classic Von…

Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event-driven computation mechanism and replacement of energy-consuming weight multiplications with…

Neural and Evolutionary Computing · Computer Science 2023-11-03 Zhehui Wang , Xiaozhe Gu , Rick Goh , Joey Tianyi Zhou , Tao Luo

The highly irregular spiking activity of cortical neurons and behavioral variability suggest that the brain could operate in a fundamentally probabilistic way. Mimicking how the brain implements and learns probabilistic computation could be…

Neural and Evolutionary Computing · Computer Science 2024-04-23 Yang Qi , Zhichao Zhu , Yiming Wei , Lu Cao , Zhigang Wang , Jie Zhang , Wenlian Lu , Jianfeng Feng

The surge in interest in Artificial Intelligence (AI) over the past decade has been driven almost exclusively by advances in Artificial Neural Networks (ANNs). While ANNs set state-of-the-art performance for many previously intractable…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Peter G. Stratton , Andrew Wabnitz , Chip Essam , Allen Cheung , Tara J. Hamilton

As a result of the increasing demand for deep neural network (DNN)-based services, efforts to develop dedicated hardware accelerators for DNNs are growing rapidly. However,while accelerators with high performance and efficiency on…

Neural and Evolutionary Computing · Computer Science 2018-03-26 Sung Kim , Patrick Howe , Thierry Moreau , Armin Alaghi , Luis Ceze , Visvesh Sathe

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

Machine Learning · Computer Science 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Hardware reliability is adversely affected by the downscaling of semiconductor devices and the scale-out of systems necessitated by modern applications. Apart from crashes, this unreliability often manifests as silent data corruptions…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-30 Vassilis Vassiliadis , Konstantinos Parasyris , Christos D. Antonopoulos , Spyros Lalis , Nikolaos Bellas

Spiking Neural Networks (SNNs) have recently gained significant interest in on-chip learning in embedded devices and emerged as an energy-efficient alternative to conventional Artificial Neural Networks (ANNs). However, to extend SNNs to a…

Machine Learning · Computer Science 2024-09-20 Manh V. Nguyen , Liang Zhao , Bobin Deng , William Severa , Honghui Xu , Shaoen Wu

Utilizing quantum computers to deploy artificial neural networks (ANNs) will bring the potential of significant advancements in both speed and scale. In this paper, we propose a kind of quantum spike neural networks (SNNs) as well as…

Quantum Physics · Physics 2020-12-03 Yanhu Chen , Hongxiang Guo , Cen Wang , Xiong Gao , Jian Wu

Spiking Neural Networks (SNN) are energy-efficient computing architectures that exchange spikes for processing information, unlike classical Artificial Neural Networks (ANN). Due to this, SNNs are better suited for real-life deployments.…

Neural and Evolutionary Computing · Computer Science 2020-05-04 Ravi Kumar Kushawaha , Saurabh Kumar , Biplab Banerjee , Rajbabu Velmurugan

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

Machine Learning · Computer Science 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

Brain-inspired Spiking Neural Networks (SNNs) leverage sparse spikes to represent information and process them in an asynchronous event-driven manner, offering an energy-efficient paradigm for the next generation of machine intelligence.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Wenjie Wei , Yu Liang , Ammar Belatreche , Yichen Xiao , Honglin Cao , Zhenbang Ren , Guoqing Wang , Malu Zhang , Yang Yang

Magnetic tunnel junction (MTJ)-based magnetic random-access memory (MRAM) is a promising platform for neuromorphic and in-memory computing owing to its non-volatility, high endurance, fast switching dynamics and CMOS compatibility. However,…

As well known, the huge memory and compute costs of both artificial neural networks (ANNs) and spiking neural networks (SNNs) greatly hinder their deployment on edge devices with high efficiency. Model compression has been proposed as a…

Neural and Evolutionary Computing · Computer Science 2020-08-21 Lei Deng , Yujie Wu , Yifan Hu , Ling Liang , Guoqi Li , Xing Hu , Yufei Ding , Peng Li , Yuan Xie

Spiking Neural Networks (SNNs) have emerged as an attractive alternative to traditional deep learning frameworks, since they provide higher computational efficiency in event driven neuromorphic hardware. However, the state-of-the-art (SOTA)…

Neural and Evolutionary Computing · Computer Science 2021-09-05 Gourav Datta , Souvik Kundu , Peter A. Beerel

In a multi-speaker "cocktail party" scenario, a listener can selectively attend to a speaker of interest. Studies into the human auditory attention network demonstrate cortical entrainment to speech envelopes resulting in highly correlated…

Signal Processing · Electrical Eng. & Systems 2023-07-18 Richard Gall , Deniz Kocanaogullari , Murat Akcakaya , Deniz Erdogmus , Rajkumar Kubendran