English
Related papers

Related papers: Double Strike: Breaking Approximation-Based Side-C…

200 papers

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Deep neural networks (DNNs) are utilized in numerous image processing, object detection, and video analysis tasks and need to be implemented using hardware accelerators to achieve practical speed. Logic locking is one of the most popular…

Cryptography and Security · Computer Science 2022-10-10 Jingbo Zhou , Xinmiao Zhang

Pruning is a compression method which aims to improve the efficiency of neural networks by reducing their number of parameters while maintaining a good performance, thus enhancing the performance-to-cost ratio in nontrivial ways. Of…

Neural and Evolutionary Computing · Computer Science 2023-09-25 Hugo Tessier , Ghouti Boukli Hacene , Vincent Gripon

Deep neural networks (DNNs) have been widely and successfully applied to various applications, but they require large amounts of memory and computational power. This severely restricts their deployment on resource-limited devices. To…

Machine Learning · Computer Science 2021-10-25 Xiang Deng , Zhongfei Zhang

The state-of-the-art approaches employ approximate computing to reduce the energy consumption of DNN hardware. Approximate DNNs then require extensive retraining afterwards to recover from the accuracy loss caused by the use of approximate…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Vojtech Mrazek , Zdenek Vasicek , Lukas Sekanina , Muhammad Abdullah Hanif , Muhammad Shafique

Deep Neural Network (DNN) has gained unprecedented performance due to its automated feature extraction capability. This high order performance leads to significant incorporation of DNN models in different Internet of Things (IoT)…

Machine Learning · Computer Science 2020-10-09 Rahul Mishra , Hari Prabhat Gupta , Tanima Dutta

Deep neural networks (DNNs) have demonstrated remarkable performance across various tasks, including image and speech recognition. However, maximizing the effectiveness of DNNs requires meticulous optimization of numerous hyperparameters…

Cryptography and Security · Computer Science 2024-06-14 Gorka Abad , Oguzhan Ersoy , Stjepan Picek , Aitor Urbieta

Deep neural networks (DNNs) play an increasingly important role in various computer systems. In order to create these networks, engineers typically specify a desired topology, and then use an automated training algorithm to select the…

Machine Learning · Computer Science 2021-08-13 Ori Lahav , Guy Katz

Fully connected deep neural networks (DNN) often include redundant weights leading to overfitting and high memory requirements. Additionally, the performance of DNN is often challenged by traditional machine learning models in tabular data…

Machine Learning · Computer Science 2022-05-18 Manar Samad , Sakib Abrar

The prosperous development of cloud computing and machine learning as a service has led to the widespread use of media software to process confidential media data. This paper explores an adversary's ability to launch side channel analyses…

Cryptography and Security · Computer Science 2021-12-13 Yuanyuan Yuan , Qi Pang , Shuai Wang

We present a filter pruning approach for deep model compression, using a multitask network. Our approach is based on learning a a pruner network to prune a pre-trained target network. The pruner is essentially a multitask deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Vinay Kumar Verma , Pravendra Singh , Vinay P. Namboodiri , Piyush Rai

Pruning is a popular technique for reducing the model size and computational cost of convolutional neural networks (CNNs). However, a slow retraining or fine-tuning procedure is often required to recover the accuracy loss caused by pruning.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yaohui Cai , Weizhe Hua , Hongzheng Chen , G. Edward Suh , Christopher De Sa , Zhiru Zhang

Deep neural networks (DNNs) frequently contain far more weights, represented at a higher precision, than are required for the specific task which they are trained to perform. Consequently, they can often be compressed using techniques such…

Machine Learning · Computer Science 2020-12-03 Vinu Joseph , Saurav Muralidharan , Animesh Garg , Michael Garland , Ganesh Gopalakrishnan

Pruning is an efficient model compression technique to remove redundancy in the connectivity of deep neural networks (DNNs). Computations using sparse matrices obtained by pruning parameters, however, exhibit vastly different parallelism…

Machine Learning · Computer Science 2019-05-15 Dongsoo Lee , Se Jung Kwon , Byeongwook Kim , Parichay Kapoor , Gu-Yeon Wei

Network compression is crucial to making the deep networks to be more efficient, faster, and generalizable to low-end hardware. Current network compression methods have two open problems: first, there lacks a theoretical framework to…

Machine Learning · Computer Science 2022-06-09 Ziqi Zhou , Li Lian , Yilong Yin , Ze Wang

Deep neural networks (DNNs) have been expanded into medical fields and triggered the revolution of some medical applications by extracting complex features and achieving high accuracy and performance, etc. On the contrast, the large-scale…

Image and Video Processing · Electrical Eng. & Systems 2019-11-07 Hongjia Li , Sheng Lin , Ning Liu , Caiwen Ding , Yanzhi Wang

Deep neural networks are becoming popular and important assets of many AI companies. However, recent studies indicate that they are also vulnerable to adversarial attacks. Adversarial attacks can be either white-box or black-box. The…

Cryptography and Security · Computer Science 2019-07-25 Yun Xiang , Zhuangzhi Chen , Zuohui Chen , Zebin Fang , Haiyang Hao , Jinyin Chen , Yi Liu , Zhefu Wu , Qi Xuan , Xiaoniu Yang

Determining the optimal size of a neural network is critical, as it directly impacts runtime performance and memory usage. Pruning is a well-established model compression technique that reduces the size of neural networks while…

Machine Learning · Computer Science 2024-09-04 Seungbeom Hu , ChanJun Park , Andrew Ferraiuolo , Sang-Ki Ko , Jinwoo Kim , Haein Song , Jieung Kim

The remarkable performance of modern deep neural networks (DNNs) is largely driven by their massive scale, often comprising tens to hundreds of millions-or even billions-of parameters. However, such a scale incurs substantial storage and…

Machine Learning · Computer Science 2026-05-01 Mingyuan Wang , Yangzi Guo , Sida Liu , Yuhang Liu

Deep neural network (DNN) pruning has become a de facto component for deploying on resource-constrained devices since it can reduce memory requirements and computation costs during inference. In particular, channel pruning gained more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jung Im Choi , Qing Tian