English
Related papers

Related papers: Low Error-Rate Approximate Multiplier Design for D…

200 papers

The majority of the research on the quantization of Deep Neural Networks (DNNs) is focused on reducing the precision of tensors visible by high-level frameworks (e.g., weights, activations, and gradients). However, current hardware still…

Machine Learning · Computer Science 2024-01-26 Yaniv Blumenfeld , Itay Hubara , Daniel Soudry

Edge training of Deep Neural Networks (DNNs) is a desirable goal for continuous learning; however, it is hindered by the enormous computational power required by training. Hardware approximate multipliers have shown their effectiveness for…

Hardware Architecture · Computer Science 2022-09-26 Jing Gong , Hassaan Saadat , Hasindu Gamaarachchi , Haris Javaid , Xiaobo Sharon Hu , Sri Parameswaran

Applications in the AI and HPC fields require much memory capacity, and the amount of energy consumed by main memory of server machines is ever increasing. Energy consumption of main memory can be greatly reduced by applying approximate…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-04 Shinsuke Hamada , Soramichi Akiyama , Mitaro Namiki

The design of approximate adders has been widely researched to advance energy-efficient hardware for computation-intensive multimedia applications, such as image, audio, or video processing. The design of approximate adders has been widely…

Hardware Architecture · Computer Science 2025-10-24 Hasnain A. Ziad , Ashiq A. Sakib

Conventional multiply-accumulate (MAC) operations have long dominated computation time for deep neural networks (DNNs), espcially convolutional neural networks (CNNs). Recently, product quantization (PQ) has been applied to these workloads,…

Hardware Architecture · Computer Science 2024-04-01 Ahmed F. AbouElhamayed , Angela Cui , Javier Fernandez-Marques , Nicholas D. Lane , Mohamed S. Abdelfattah

Deep neural networks are widely deployed in many fields. Due to the in-situ computation (known as processing in memory) capacity of the Resistive Random Access Memory (ReRAM) crossbar, ReRAM-based accelerator shows potential in accelerating…

Hardware Architecture · Computer Science 2024-03-11 Chenguang Zhang , Zhihang Yuan , Xingchen Li , Guangyu Sun

Mixed-signal hardware accelerators for deep learning achieve orders of magnitude better power efficiency than their digital counterparts. In the ultra-low power consumption regime, limited signal precision inherent to analog computation…

Emerging Technologies · Computer Science 2019-04-04 Michael Klachko , Mohammad Reza Mahmoodi , Dmitri B. Strukov

The deployment of Quantized Neural Networks (QNN) on advanced microcontrollers requires optimized software to exploit digital signal processing (DSP) extensions of modern instruction set architectures (ISA). As such, recent research…

Hardware Architecture · Computer Science 2020-07-16 Nazareno Bruschi , Angelo Garofalo , Francesco Conti , Giuseppe Tagliavini , Davide Rossi

As Deep Neural Networks (DNNs) continue to drive advancements in artificial intelligence, the design of hardware accelerators faces growing concerns over embodied carbon footprint due to complex fabrication processes. 3D integration…

The state-of-art DNN structures involve intensive computation and high memory storage. To mitigate the challenges, the memristor crossbar array has emerged as an intrinsically suitable matrix computation and low-power acceleration framework…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Xiaolong Ma , Geng Yuan , Sheng Lin , Caiwen Ding , Fuxun Yu , Tao Liu , Wujie Wen , Xiang Chen , Yanzhi Wang

We present a pipelined multiplier with reduced activities and minimized interconnect based on online digit-serial arithmetic. The working precision has been truncated such that $p<n$ bits are used to compute $n$ bits product, resulting in…

Hardware Architecture · Computer Science 2022-04-21 Muhammad Usman , Jeong-A Lee , Milos D. Ercegovac

Deep neural network (DNN) accelerators received considerable attention in recent years due to the potential to save energy compared to mainstream hardware. Low-voltage operation of DNN accelerators allows to further reduce energy…

Machine Learning · Computer Science 2022-06-09 David Stutz , Nandhini Chandramoorthy , Matthias Hein , Bernt Schiele

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

Optimization and Control · Mathematics 2015-02-12 Li Shen , Shaohua Pan

This paper aims at integrating three powerful techniques namely Deep Learning, Approximate Computing, and Low Power Design into a strategy to optimize logic at the synthesis level. We utilize advances in deep learning to guide an…

Hardware Architecture · Computer Science 2020-07-06 Ghasem Pasandi , Mackenzie Peterson , Moises Herrera , Shahin Nazarian , Massoud Pedram

Deep neural network (DNN) accelerators received considerable attention in past years due to saved energy compared to mainstream hardware. Low-voltage operation of DNN accelerators allows to further reduce energy consumption significantly,…

Machine Learning · Computer Science 2021-04-12 David Stutz , Nandhini Chandramoorthy , Matthias Hein , Bernt Schiele

Recent advances in algorithm-hardware co-design for deep neural networks (DNNs) have demonstrated their potential in automatically designing neural architectures and hardware designs. Nevertheless, it is still a challenging optimization…

Machine Learning · Computer Science 2021-11-29 Hongxiang Fan , Martin Ferianc , Zhiqiang Que , He Li , Shuanglong Liu , Xinyu Niu , Wayne Luk

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

Approximate circuit design has gained significance in recent years targeting error tolerant applications. In this paper, we first demonstrate that the commonly used assumption that the inputs to the adder are uniformly distributed results…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Celia Dharmaraj , Vinita Vasudevan , Nitin Chandrachoodan

It remains a challenge to run Deep Learning in devices with stringent power budget in the Internet-of-Things. This paper presents a low-power accelerator for processing Deep Neural Networks in the embedded devices. The power reduction is…

Hardware Architecture · Computer Science 2017-05-24 Yuxiang Huan , Yifan Qin , Yantian You , Lirong Zheng , Zhuo Zou

Deep neural networks are a promising solution for applications that solve problems based on learning data sets. DNN accelerators solve the processing bottleneck as a domain-specific processor. Like other hardware solutions, there must be…

Hardware Architecture · Computer Science 2022-11-08 Midia Reshadi , David Gregg