English
Related papers

Related papers: MACPruning: Dynamic Operation Pruning to Mitigate …

200 papers

Deep neural networks have dramatically achieved great success on a variety of challenging tasks. However, most successful DNNs have an extremely complex structure, leading to extensive research on model compression.As a significant area of…

Machine Learning · Computer Science 2020-04-13 Haipeng Jia , Xueshuang Xiang , Da Fan , Meiyu Huang , Changhao Sun , Yang He

Despite their unprecedented performance in various domains, utilization of Deep Neural Networks (DNNs) in safety-critical environments is severely limited in the presence of even small adversarial perturbations. The present work develops a…

Machine Learning · Computer Science 2020-10-19 Fatemeh Sheikholeslami , Swayambhoo Jain , Georgios B. Giannakis

Recently published attacks against deep neural networks (DNNs) have stressed the importance of methodologies and tools to assess the security risks of using this technology in critical systems. Efficient techniques for detecting adversarial…

Cryptography and Security · Computer Science 2021-09-01 Doha Al Bared , Mohamed Nassar

Compression techniques for deep neural network models are becoming very important for the efficient execution of high-performance deep learning systems on edge-computing devices. The concept of model compression is also important for…

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

Machine Learning · Computer Science 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

Deep neural networks (DNNs) have become the essential components for various commercialized machine learning services, such as Machine Learning as a Service (MLaaS). Recent studies show that machine learning services face severe privacy…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Xiaoyong Yuan , Leah Ding , Lan Zhang , Xiaolin Li , Dapeng Wu

We propose a simple but effective data-driven channel pruning algorithm, which compresses deep neural networks in a differentiable way by exploiting the characteristics of operations. The proposed approach makes a joint consideration of…

Machine Learning · Computer Science 2020-07-23 Minsoo Kang , Bohyung Han

Edge machine learning (ML) enables localized processing of data on devices and is underpinned by deep neural networks (DNNs). However, DNNs cannot be easily run on devices due to their substantial computing, memory and energy requirements…

Machine Learning · Computer Science 2025-04-09 Bailey J. Eccles , Leon Wong , Blesson Varghese

Model compression plays a vital role in the practical deployment of deep neural networks (DNNs), and evolutionary multi-objective (EMO) pruning is an essential tool in balancing the compression rate and performance of the DNNs. However, due…

Machine Learning · Computer Science 2024-01-02 Ronghua Shang , Songling Zhu , Yinan Wu , Weitong Zhang , Licheng Jiao , Songhua Xu

In this paper, we extend our previous work on the Expressive Neural Network (ENN), a multilayer perceptron with adaptive activation functions parametrized using the Discrete Cosine Transform (DCT). Building upon previous work that…

Machine Learning · Computer Science 2025-11-06 Marc Martinez-Gost , Sara Pepe , Ana Pérez-Neira , Miguel Ángel Lagunas

With the increasing extent of malware attacks in the present day along with the difficulty in detecting modern malware, it is necessary to evaluate the effectiveness and performance of Deep Neural Networks (DNNs) for malware classification.…

Cryptography and Security · Computer Science 2023-10-12 Akhil M R , Adithya Krishna V Sharma , Harivardhan Swamy , Pavan A , Ashray Shetty , Anirudh B Sathyanarayana

To facilitate efficient embedded and hardware implementations of deep neural networks (DNNs), two important categories of DNN model compression techniques: weight pruning and weight quantization are investigated. The former leverages the…

Machine Learning · Computer Science 2019-01-03 Ao Ren , Tianyun Zhang , Shaokai Ye , Jiayu Li , Wenyao Xu , Xuehai Qian , Xue Lin , Yanzhi Wang

In this paper, we propose a novel design, called MixNN, for protecting deep learning model structure and parameters. The layers in a deep learning model of MixNN are fully decentralized. It hides communication address, layer parameters and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-19 Chao Liu , Hao Chen , Yusen Wu , Rui Jin

Deep neural network (DNN) pruning has become a de facto component for deploying on resource-constrained devices since it can reduce memory requirements and computation costs during inference. In particular, channel pruning gained more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jung Im Choi , Qing Tian

Deep Neural Networks have proven to be highly accurate at a variety of tasks in recent years. The benefits of Deep Neural Networks have also been embraced in power grids to detect False Data Injection Attacks (FDIA) while conducting…

Cryptography and Security · Computer Science 2025-04-10 Farhin Farhad Riya , Shahinul Hoque , Yingyuan Yang , Jiangnan Li , Jinyuan Stella Sun , Hairong Qi

For many applications, utilizing DNNs (Deep Neural Networks) requires their implementation on a target architecture in an optimized manner concerning energy consumption, memory requirement, throughput, etc. DNN compression is used to reduce…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Muhammad Sabih , Frank Hannig , Juergen Teich

Channel pruning has been broadly recognized as an effective technique to reduce the computation and memory cost of deep convolutional neural networks. However, conventional pruning methods have limitations in that: they are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zejiang Hou , Minghai Qin , Fei Sun , Xiaolong Ma , Kun Yuan , Yi Xu , Yen-Kuang Chen , Rong Jin , Yuan Xie , Sun-Yuan Kung

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

The vulnerability of Deep Neural Networks (DNNs) to adversarial examples has been confirmed. Existing adversarial defenses primarily aim at preventing adversarial examples from attacking DNNs successfully, rather than preventing their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Jinwei Wang , Hao Wu , Haihua Wang , Jiawei Zhang , Xiangyang Luo , Bin Ma

Deep neural networks (DNNs) have achieved excellent performance on several tasks and have been widely applied in both academia and industry. However, DNNs are vulnerable to adversarial machine learning attacks, in which noise is added to…

Machine Learning · Computer Science 2020-01-01 Huy H. Nguyen , Minoru Kuribayashi , Junichi Yamagishi , Isao Echizen