English
Related papers

Related papers: Winograd Convolution: A Perspective from Fault Tol…

200 papers

Window decoding, first proposed to reduce decoding complexity for real-time decoding, is an essential component to realize scalable, universal-fault tolerant computation. Prior work has focused on improving throughput through…

Quantum Physics · Physics 2026-05-05 Tina Oberoi , Joshua Viszlai , Frederic T. Chong

Deep Neural Networks (DNNs) enable a wide series of technological advancements, ranging from clinical imaging, to predictive industrial maintenance and autonomous driving. However, recent findings indicate that transient hardware faults may…

Machine Learning · Computer Science 2022-05-31 Niccolò Cavagnero , Fernando Dos Santos , Marco Ciccone , Giuseppe Averta , Tatiana Tommasi , Paolo Rech

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

Private convolutional neural network (CNN) inference based on secure two-party computation (2PC) suffers from high communication and latency overhead, especially from convolution layers. In this paper, we propose EQO, a quantized 2PC…

Cryptography and Security · Computer Science 2024-04-16 Wenxuan Zeng , Tianshi Xu , Meng Li , Runsheng Wang

Using fault-tolerant constructions, computations performed with unreliable components can simulate their noiseless counterparts though the introduction of a modest amount of redundancy. Given the modest overhead required to achieve…

Computational Engineering, Finance, and Science · Computer Science 2023-11-07 Andrew K. Tan , Isaac L. Chuang

Neuromorphic computing, inspired by the brain, promises extreme efficiency for certain classes of learning tasks, such as classification and pattern recognition. The performance and power consumption of neuromorphic computing depends…

Emerging Technologies · Computer Science 2018-06-14 Baibhab Chatterjee , Priyadarshini Panda , Shovan Maity , Ayan Biswas , Kaushik Roy , Shreyas Sen

Neural Networks (NNs) have been widely adopted due to their outstanding efficacy and adaptability across computer vision and deep learning applications. The optimization of NNs is necessary to enable their deployment on energy constrained…

Hardware Architecture · Computer Science 2026-05-12 Pragun Jaswal , L. Hemanth Krishna , B. Srinivasu

Convolutional neural networks (CNN) have been widely used for boosting the performance of many machine intelligence tasks. However, the CNN models are usually computationally intensive and energy consuming, since they are often designed…

Machine Learning · Computer Science 2021-02-04 Yunhe Wang , Mingqiang Huang , Kai Han , Hanting Chen , Wei Zhang , Chunjing Xu , Dacheng Tao

In computer vision, convolutional networks (CNNs) often adopts pooling to enlarge receptive field which has the advantage of low computational complexity. However, pooling can cause information loss and thus is detrimental to further…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Pengju Liu , Hongzhi Zhang , Wei Lian , Wangmeng Zuo

Scaling up quantum computers to attain substantial speedups over classical computing requires fault tolerance. Conventionally, protocols for fault-tolerant quantum computation demand excessive space overheads by using many physical qubits…

Quantum Physics · Physics 2025-01-29 Hayata Yamasaki , Masato Koashi

The success of CNNs in various applications is accompanied by a significant increase in the computation and parameter storage costs. Recent efforts toward reducing these overheads involve pruning and compressing the weights of various…

Computer Vision and Pattern Recognition · Computer Science 2017-03-13 Hao Li , Asim Kadav , Igor Durdanovic , Hanan Samet , Hans Peter Graf

Convolution is the most expensive operation among neural network operations, thus its performance is critical to the overall performance of neural networks. Commonly used convolution approaches, including general matrix multiplication…

Neural and Evolutionary Computing · Computer Science 2023-06-27 Shuai Lu , Jun Chu , Xu T. Liu

As traditional neural network consumes a significant amount of computing resources during back propagation, \citet{Sun2017mePropSB} propose a simple yet effective technique to alleviate this problem. In this technique, only a small subset…

Machine Learning · Computer Science 2017-09-27 Bingzhen Wei , Xu Sun , Xuancheng Ren , Jingjing Xu

Convolutional neural networks (CNNs) demand huge DRAM bandwidth for computational imaging tasks, and block-based processing has recently been applied to greatly reduce the bandwidth. However, the induced additional computation for feature…

Machine Learning · Computer Science 2020-01-31 Chao-Tsung Huang

Neural Networks (NN) have recently emerged as backbone of several sensitive applications like automobile, medical image, security, etc. NNs inherently offer Partial Fault Tolerance (PFT) in their architecture; however, the biased PFT of NNs…

Machine Learning · Computer Science 2019-02-14 Manaar Alam , Arnab Bag , Debapriya Basu Roy , Dirmanto Jap , Jakub Breier , Shivam Bhasin , Debdeep Mukhopadhyay

Deep neural networks (DNNs) are state-of-the-art algorithms for multiple applications, spanning from image classification to speech recognition. While providing excellent accuracy, they often have enormous compute and memory requirements.…

Machine Learning · Computer Science 2020-11-12 Ussama Zahid , Giulio Gambardella , Nicholas J. Fraser , Michaela Blott , Kees Vissers

Neural networks (NNs) are increasingly employed in safety-critical domains and in environments prone to unreliability (e.g., soft errors), such as on spacecraft. Therefore, it is critical to impart fault tolerance to NN inference.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-08 Jack Kosaian , K. V. Rashmi

Deep learning time-series processing often relies on convolutional neural networks with overlapping windows. This overlap allows the network to produce an output faster than the window length. However, it introduces additional computations.…

Machine Learning · Computer Science 2024-08-07 Christodoulos Kechris , Jonathan Dan , Jose Miranda , David Atienza

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…