English
Related papers

Related papers: Control Variate Approximation for DNN Accelerators

200 papers

In error-tolerant applications, approximate adders have been exploited extensively to achieve energy efficient system designs. Mean error distance is one of the important error metrics used as a performance measure of approximate adders. In…

Other Computer Science · Computer Science 2018-03-22 Avishek Sinha Roy , Anindya Sundar Dhar

Recently, deep reinforcement learning (RL) has achieved remarkable empirical success by integrating deep neural networks into RL frameworks. However, these algorithms often require a large number of training samples and admit little…

Machine Learning · Computer Science 2021-10-12 Junhong Shen , Lin F. Yang

It is well known that Monte Carlo integration with variance reduction by means of control variates can be implemented by the ordinary least squares estimator for the intercept in a multiple linear regression model. A central limit theorem…

Statistics Theory · Mathematics 2019-10-10 François Portier , Johan Segers

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Neural Networks (DNN), as they are able to better reduce spectral variation in the input signal. This has also been confirmed experimentally, with CNNs showing…

We propose an optimization method for the automatic design of approximate multipliers, which minimizes the average error according to the operand distributions. Our multiplier achieves up to 50.24% higher accuracy than the best reproduced…

Hardware Architecture · Computer Science 2023-10-26 Su Zheng , Zhen Li , Yao Lu , Jingbo Gao , Jide Zhang , Lingli Wang

A non-parametric extension of control variates is presented. These leverage gradient information on the sampling density to achieve substantial variance reduction. It is not required that the sampling density be normalised. The novel…

Methodology · Statistics 2016-04-05 Chris J. Oates , Mark Girolami , Nicolas Chopin

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

Machine Learning · Computer Science 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Computing-in-Memory architectures based on non-volatile emerging memories have demonstrated great potential for deep neural network (DNN) acceleration thanks to their high energy efficiency. However, these emerging devices can suffer from…

Machine Learning · Computer Science 2022-10-10 Zheyu Yan , Xiaobo Sharon Hu , Yiyu Shi

In recent years, deep learning techniques have been introduced into the field of trajectory optimization to improve convergence and speed. Training such models requires large trajectory datasets. However, the convergence of low thrust (LT)…

Optimization and Control · Mathematics 2022-02-11 Ruida Xie , Andrew G. Dempster

Nowadays, the extensive exploitation of Deep Neural Networks (DNNs) in safety-critical applications raises new reliability concerns. In practice, methods for fault injection by emulation in hardware are efficient and widely used to study…

Machine Learning · Computer Science 2023-06-01 Mahdi Taheri , Mohammad Hasan Ahmadilivani , Maksim Jenihhin , Masoud Daneshtalab , Jaan Raik

Adaptive Cruise Control (ACC) is a widely used driver assistance technology for maintaining the desired speed and safe distance to the leading vehicle. This paper evaluates the security of the deep neural network (DNN) based ACC systems…

Cryptography and Security · Computer Science 2025-01-06 Xugui Zhou , Anqi Chen , Maxfield Kouzel , Haotian Ren , Morgan McCarty , Cristina Nita-Rotaru , Homa Alemzadeh

Exploiting sparsity in deep neural networks (DNNs) has been a promising area for meeting the growing computation requirements. To minimize the overhead of sparse acceleration, hardware designers have proposed structured sparsity support,…

Machine Learning · Computer Science 2025-05-27 Geonhwa Jeong , Po-An Tsai , Abhimanyu R. Bambhaniya , Stephen W. Keckler , Tushar Krishna

Robotic perception models, such as Deep Neural Networks (DNNs), are becoming more computationally intensive and there are several models being trained with accuracy and latency trade-offs. However, modern latency accuracy trade-offs largely…

Robotics · Computer Science 2022-07-14 Bineet Ghosh , Masaad Khan , Adithya Ashok , Sandeep Chinchali , Parasara Sridhar Duggirala

Deep neural networks (DNN) have been widely used and play a major role in the field of computer vision and autonomous navigation. However, these DNNs are computationally complex and their deployment over resource-constrained platforms is…

Machine Learning · Computer Science 2022-08-01 Mee Seong Im , Venkat R. Dasari

The widespread use of Deep Neural Networks (DNNs) has recently resulted in their application to challenging scientific visualization tasks. While advanced DNNs demonstrate impressive generalization abilities, understanding factors like…

Graphics · Computer Science 2024-08-13 Atul Kumar , Siddharth Garg , Soumya Dutta

This paper addresses the challenges of embedding common droop control characteristics in ac-dc power system steady-state simulation and optimization problems. We propose a smooth approximation methodology to construct differentiable…

Optimization and Control · Mathematics 2024-09-30 Ghulam Mohy-ud-din , Rahmat Heidari , Frederik Geth , Hakan Ergun , S M Muslem Uddin

An efficient adaptive direct numerical integration (DNI) algorithm is developed for computing high quantiles and conditional Value at Risk (CVaR) of compound distributions using characteristic functions. A key innovation of the numerical…

Computational Finance · Quantitative Finance 2010-02-04 Xiaolin Luo , Pavel V. Shevchenko

In recent years, deep neural networks (DNNs) trained with transformed data have been applied to various applications such as privacy-preserving learning, access control, and adversarial defenses. However, the use of transformed data…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Teru Nagamori , Sayaka Shiota , Hitoshi Kiya

In this article, we investigate the impact of architectural parameters of array-based DNN accelerators on accelerator's energy consumption and performance in a wide variety of network topologies. For this purpose, we have developed a tool…

Hardware Architecture · Computer Science 2022-06-28 Mohammad Ali Maleki , Mehdi Kamal , Ali Afzali-Kusha

In this paper, the existing Scheduling Dimension Reduction (SDR) methods for Linear Parameter-Varying (LPV) models are reviewed and a Deep Neural Network (DNN) approach is developed that achieves higher model accuracy under scheduling…

Systems and Control · Electrical Eng. & Systems 2020-12-10 P. J. W. Koelewijn , R. Tóth