English
Related papers

Related papers: Precise neural network computation with imprecise …

200 papers

The compression of deep neural networks (DNNs) to reduce inference cost becomes increasingly important to meet realistic deployment requirements of various applications. There have been a significant amount of work regarding network…

Machine Learning · Computer Science 2020-11-12 Tianyi Chen , Bo Ji , Yixin Shi , Tianyu Ding , Biyi Fang , Sheng Yi , Xiao Tu

In this paper, we propose a deep learning based performance testing framework to minimize the number of required test modules while guaranteeing the accuracy requirement, where a test module corresponds to a combination of one circuit and…

Systems and Control · Electrical Eng. & Systems 2024-10-16 Jiawei Cao , Chongtao Guo , Hao Li , Zhigang Wang , Houjun Wang , Geoffrey Ye Li

Mixed-signal artificial neural networks (ANNs) that employ analog matrix-multiplication accelerators can achieve higher speed and improved power efficiency. Though analog computing is known to be susceptible to noise and device…

Signal Processing · Electrical Eng. & Systems 2021-07-01 Joseph Ulseth , Zheyuan Zhu , Guifang Li , Shuo Pang

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging…

Machine Learning · Computer Science 2020-12-02 Changliu Liu , Tomer Arnon , Christopher Lazarus , Christopher Strong , Clark Barrett , Mykel J. Kochenderfer

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Zhaowen Wang , Ding Liu , Jianchao Yang , Wei Han , Thomas Huang

Machine learning algorithms, and more in particular neural networks, arguably experience a revolution in terms of performance. Currently, the best systems we have for speech recognition, computer vision and similar problems are based on…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Michiel Hermans , Michaël Burm , Joni Dambre , Peter Bienstman

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

Deep convolutional neural networks have proven to be well suited for image classification applications. However, if there is distortion in the image, the classification accuracy can be significantly degraded, even with state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Minho Ha , Younghoon Byeon , Youngjoo Lee , Sunggu Lee

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Artificial Neural Networks are computational network models inspired by signal processing in the brain. These models have dramatically improved the performance of many learning tasks, including speech and object recognition. However,…

In this paper, we propose a framework to enhance the robustness of the neural models by mitigating the effects of process-induced and aging-related variations of analog computing components on the accuracy of the analog neural networks. We…

Machine Learning · Computer Science 2024-09-30 Seyedarmin Azizi , Mohammad Erfan Sadeghi , Mehdi Kamal , Massoud Pedram

The proliferation of complex deep learning (DL) models has revolutionized various applications, including computer vision-based solutions, prompting their integration into real-time systems. However, the resource-intensive nature of these…

Hardware Architecture · Computer Science 2024-06-26 Tushar Prasanna Swaminathan , Christopher Silver , Thangarajah Akilan

Efficient deep neural network (DNN) models equipped with compact operators (e.g., depthwise convolutions) have shown great potential in reducing DNNs' theoretical complexity (e.g., the total number of weights/operations) while maintaining a…

Machine Learning · Computer Science 2025-01-07 Yonggan Fu , Haichuan Yang , Jiayi Yuan , Meng Li , Cheng Wan , Raghuraman Krishnamoorthi , Vikas Chandra , Yingyan Celine Lin

Deep Neural Networks (DNNs) have made significant improvements to reach the desired accuracy to be employed in a wide variety of Machine Learning (ML) applications. Recently the Google Brain's team demonstrated the ability of Capsule…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Andrea Massa , Vojtech Mrazek , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique

Within the past years, hardware vendors have started designing low precision special function units in response to the demand of the Machine Learning community and their demand for high compute power in low precision formats. Also the…

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

In-memory computing is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. Crossbar arrays of resistive memory devices can be used to encode the network weights and perform efficient analog…

Deep neural networks have been demonstrated impressive results in various cognitive tasks such as object detection and image classification. In order to execute large networks, Von Neumann computers store the large number of weight…

Neural and Evolutionary Computing · Computer Science 2015-08-06 Jaeyong Chung , Taehwan Shin , Yongshin Kang

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose…

Machine Learning · Statistics 2020-07-16 Zhirui Hu , Zheng Tracy Ke , Jun S Liu