English
Related papers

Related papers: Preventing Distillation-based Attacks on Neural Ne…

200 papers

The success of deep learning has brought forth a wave of interest in computer hardware design to better meet the high demands of neural network inference. In particular, analog computing hardware has been heavily motivated specifically for…

Machine Learning · Computer Science 2020-01-15 Chuteng Zhou , Prad Kadambi , Matthew Mattina , Paul N. Whatmough

With the increasing application value of machine learning, the intellectual property (IP) rights of deep neural networks (DNN) are getting more and more attention. With our analysis, most of the existing DNN watermarking methods can resist…

Cryptography and Security · Computer Science 2022-08-12 Tzu-Yun Chien , Chih-Ya Shen

Knowledge distillation is considered a compression mechanism when judged on the resulting student's accuracy and loss, yet its functional impact is poorly understood. We quantify the compression capacity of knowledge distillation and the…

Machine Learning · Computer Science 2026-03-17 Israel Mason-Williams , Gabryel Mason-Williams , Helen Yannakoudakis

State-of-the-art machine learning models are vulnerable to data poisoning attacks whose purpose is to undermine the integrity of the model. However, the current literature on data poisoning attacks is mainly focused on ad hoc techniques…

Machine Learning · Computer Science 2021-02-12 Pooya Tavallali , Vahid Behzadan , Peyman Tavallali , Mukesh Singhal

Transfer learning is devised to leverage knowledge from pre-trained models to solve new tasks with limited data and computational resources. Meanwhile, dataset distillation has emerged to synthesize a compact dataset that preserves critical…

Cryptography and Security · Computer Science 2026-03-06 Yuchen Shi , Huajie Chen , Heng Xu , Zhiquan Liu , Jialiang Shen , Chi Liu , Shuai Zhou , Tianqing Zhu , Wanlei Zhou

The trade-off between predictive accuracy and data availability makes it difficult to predict protein--protein binding affinity accurately. The lack of experimentally resolved protein structures limits the performance of structure-based…

Machine Learning · Computer Science 2026-01-08 Wajid Arshad Abbasi , Syed Ali Abbas , Maryum Bibi , Saiqa Andleeb , Muhammad Naveed Akhtar

A well-trained DNN model can be regarded as an intellectual property (IP) of the model owner. To date, many DNN IP protection methods have been proposed, but most of them are watermarking based verification methods where model owners can…

Cryptography and Security · Computer Science 2023-05-26 Mingfu Xue , Zhiyu Wu , Jian Wang , Yushu Zhang , Weiqiang Liu

Knowledge distillation, a technique recently gaining popularity for enhancing model generalization in Convolutional Neural Networks (CNNs), operates under the assumption that both teacher and student models are trained on identical data…

Machine Learning · Computer Science 2024-12-06 Can Wang , Zhe Wang , Defang Chen , Sheng Zhou , Yan Feng , Chun Chen

Graph Neural Networks (GNNs) have achieved remarkable performance through their message-passing mechanism. However, recent studies have highlighted the vulnerability of GNNs to backdoor attacks, which can lead the model to misclassify…

Machine Learning · Computer Science 2025-01-13 Jiale Zhang , Bosen Rao , Chengcheng Zhu , Xiaobing Sun , Qingming Li , Haibo Hu , Xiapu Luo , Qingqing Ye , Shouling Ji

Neural network pruning reduces the computational cost of an over-parameterized network to improve its efficiency. Popular methods vary from $\ell_1$-norm sparsification to Neural Architecture Search (NAS). In this work, we propose a novel…

Machine Learning · Computer Science 2020-06-05 Yonathan Aflalo , Asaf Noy , Ming Lin , Itamar Friedman , Lihi Zelnik

As spiking neural networks (SNNs) gain traction in deploying neuromorphic computing solutions, protecting their intellectual property (IP) has become crucial. Without adequate safeguards, proprietary SNN architectures are at risk of theft,…

Cryptography and Security · Computer Science 2025-01-31 Hamed Poursiami , Ihsen Alouani , Maryam Parsa

Dataset distillation, a training-aware data compression technique, has recently attracted increasing attention as an effective tool for mitigating costs of optimization and data storage. However, progress remains largely empirical.…

Machine Learning · Computer Science 2026-03-31 Yuri Kinoshita , Naoki Nishikawa , Taro Toyoizumi

Deep neural network-based image compression (NIC) has achieved excellent performance, but NIC method models have been shown to be susceptible to backdoor attacks. Adversarial training has been validated in image compression models as a…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Zhi Cao , Youneng Bao , Fanyang Meng , Chao Li , Wen Tan , Genhong Wang , Yongsheng Liang

The vulnerabilities of deep learning models towards adversarial attacks have attracted increasing attention, especially when models are deployed in security-critical domains. Numerous defense methods, including reactive and proactive ones,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Haibin Zheng , Jinyin Chen , Zhenguang Liu

DNN is presenting human-level performance for many complex intelligent tasks in real-world applications. However, it also introduces ever-increasing security concerns. For example, the emerging adversarial attacks indicate that even very…

Machine Learning · Computer Science 2018-03-21 Qi Liu , Tao Liu , Zihao Liu , Yanzhi Wang , Yier Jin , Wujie Wen

Brain-inspired spiking neural networks (SNNs) promise to be a low-power alternative to computationally intensive artificial neural networks (ANNs), although performance gaps persist. Recent studies have improved the performance of SNNs…

Machine Learning · Computer Science 2025-10-10 Yongqi Ding , Lin Zuo , Mengmeng Jing , Kunshan Yang , Pei He , Tonglan Xie

In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial…

Machine Learning · Computer Science 2025-02-25 Wenyuan Wu , Zheng Liu , Yong Chen , Chao Su , Dezhong Peng , Xu Wang

Spiking neural network (SNN), compared with depth neural network (DNN), has faster processing speed, lower energy consumption and more biological interpretability, which is expected to approach Strong AI. Reinforcement learning is similar…

Neural and Evolutionary Computing · Computer Science 2021-08-24 Ling Zhang , Jian Cao , Yuan Zhang , Bohan Zhou , Shuo Feng

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

Deep neural networks (DNNs), such as the widely-used GPT-3 with billions of parameters, are often kept secret due to high training costs and privacy concerns surrounding the data used to train them. Previous approaches to securing DNNs…

Cryptography and Security · Computer Science 2024-06-24 Ning Lin , Shaocong Wang , Yue Zhang , Yangu He , Kwunhang Wong , Arindam Basu , Dashan Shang , Xiaoming Chen , Zhongrui Wang