English
Related papers

Related papers: Energy-Efficient Hybrid Stochastic-Binary Neural N…

200 papers

Efficient communication is central to both biological and artificial intelligence (AI) systems. In biological brains, the challenge of long-range communication across regions is addressed through sparse, spike-based signaling, minimizing…

Hardware Architecture · Computer Science 2025-04-15 Joshua Nardone , Ruijie Zhu , Joseph Callenes , Mohammed E. Elbtity , Ramtin Zand , Jason Eshraghian

Stochastic neurons are extremely efficient hardware for solving a large class of problems and usually come in two varieties -- "binary" where the neuronal statevaries randomly between two values of -1, +1 and "analog" where the neuronal…

Mesoscale and Nanoscale Physics · Physics 2025-02-03 Rahnuma Rahman , Supriyo Bandyopadhyay

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

Spiking Neural Networks (SNNs), characterized by discrete binary activations, offer high computational efficiency and low energy consumption, making them well-suited for computation-intensive tasks such as stereo image restoration. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ronghua Xu , Jin Xie , Jing Nie , Jiale Cao , Yanwei Pang

Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant increases in computation complexity. Largescale deep learning…

Neural and Evolutionary Computing · Computer Science 2018-05-14 Zhe Li , Ji Li , Ao Ren , Caiwen Ding , Jeffrey Draper , Qinru Qiu , Bo Yuan , Yanzhi Wang

Convolutional neural network (CNN) has been widely used for vision-based tasks. Due to the high computational complexity and memory storage requirement, it is hard to directly deploy a full-precision CNN on embedded devices. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yixing Li , Fengbo Ren

Binarization is a powerful compression technique for neural networks, significantly reducing FLOPs, but often results in a significant drop in model performance. To address this issue, partial binarization techniques have been developed,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Udbhav Bamba , Neeraj Anand , Saksham Aggarwal , Dilip K. Prasad , Deepak K. Gupta

In computation-intensive domains such as digital signal processing, encryption, and neural networks, the performance of arithmetic units, including adders and multipliers, is pivotal. Conventional numerical systems often fall short of…

Hardware Architecture · Computer Science 2024-08-13 Soudabeh Mousavi , Dara Rahmati , Saeid Gorgin , Jeong-A Lee

Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on neuromorphic hardware. However, the majority of existing…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Yi Jiang , Sen Lu , Abhronil Sengupta

Spiking Neural Networks (SNNs) offer an energy-efficient paradigm for machine intelligence, but their continued scaling poses challenges for resource-limited deployment. Despite recent advances in binary SNNs, the storage and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Wenjie Wei , Malu Zhang , Jieyuan Zhang , Ammar Belatreche , Shuai Wang , Yimeng Shan , Hanwen Liu , Honglin Cao , Guoqing Wang , Yang Yang , Haizhou Li

In this paper, we propose a low-power hardware for efficient deployment of binarized neural networks (BNNs) that have been trained for physiological datasets. BNNs constrain weights and feature-map to 1 bit, can pack in as many 1-bit…

Signal Processing · Electrical Eng. & Systems 2019-03-28 Morteza Hosseini , Hirenkumar Paneliya , Uttej Kallakuri , Mohit Khatwani , Tinoosh Mohsenin

Spiking Neural Networks (SNN) are a class of bio-inspired neural networks that promise to bring low-power and low-latency inference to edge devices through asynchronous and sparse processing. However, being temporal models, SNNs depend…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Asude Aydin , Mathias Gehrig , Daniel Gehrig , Davide Scaramuzza

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Artificial Neural Networks (ANNs) are bio-inspired models of neural computation that have proven highly effective. Still, ANNs lack a natural notion of time, and neural units in ANNs exchange analog values in a frame-based manner, a…

Neural and Evolutionary Computing · Computer Science 2017-10-16 Davide Zambrano , Roeland Nusselder , H. Steven Scholte , Sander Bohte

Recently, Deep Convolutional Neural Networks (DCNNs) have made unprecedented progress, achieving the accuracy close to, or even better than human-level perception in various tasks. There is a timely need to map the latest software DCNNs to…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Ji Li , Zihao Yuan , Zhe Li , Caiwen Ding , Ao Ren , Qinru Qiu , Jeffrey Draper , Yanzhi Wang

Spiking Neural Networks (SNNs) are inspired by the sparse and event-driven nature of biological neural processing, and offer the potential for ultra-low-power artificial intelligence. However, realizing their efficiency benefits requires…

Hardware Architecture · Computer Science 2024-08-27 Ilkin Aliyev , Kama Svoboda , Tosiron Adegbija , Jean-Marc Fellous

Convolutional neural networks have recently achieved significant breakthroughs in various image classification tasks. However, they are computationally expensive,which can make their feasible mplementation on embedded and low-power devices…

Machine Learning · Computer Science 2018-08-02 Mir Khan , Heikki Huttunen , Jani Boutellier

Many modern applications of the artificial neural networks ensue large number of layers making traditional digital implementations increasingly complex. Optical neural networks offer parallel processing at high bandwidth, but have the…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Egor Manuylovich , Diego Argüello Ron , Morteza Kamalian-Kopae , Sergei Turitsyn

Uncertainty in biological neural systems appears to be computationally beneficial rather than detrimental. However, in neuromorphic computing systems, device variability often limits performance, including accuracy and efficiency. In this…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Huannan Zheng , Jingli Liu , Kezhou Yang

With the continued innovations of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention owing to their low power consumption.However, for continuous data values,…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Naoya Muramatsu , Hai-Tao Yu