English
Related papers

Related papers: Preventing Distillation-based Attacks on Neural Ne…

200 papers

Dataset distillation methods have demonstrated remarkable performance for neural networks trained with very limited training data. However, a significant challenge arises in the form of \textit{architecture overfitting}: the distilled…

Machine Learning · Computer Science 2025-01-08 Xuyang Zhong , Chen Liu

Due to the increasing computational demand of Deep Neural Networks (DNNs), companies and organizations have begun to outsource the training process. However, the externally trained DNNs can potentially be backdoor attacked. It is crucial to…

Machine Learning · Computer Science 2023-07-04 Lu Pang , Tao Sun , Haibin Ling , Chao Chen

Deep neural networks are susceptible to poisoning attacks by purposely polluted training data with specific triggers. As existing episodes mainly focused on attack success rate with patch-based samples, defense algorithms can easily detect…

Cryptography and Security · Computer Science 2021-01-11 Jinyin Chen , Longyuan Zhang , Haibin Zheng , Xueke Wang , Zhaoyan Ming

In this paper, we present DSN (Deep Serial Number), a simple yet effective watermarking algorithm designed specifically for deep neural networks (DNNs). Unlike traditional methods that incorporate identification signals into DNNs, our…

Cryptography and Security · Computer Science 2023-07-28 Ruixiang Tang , Mengnan Du , Xia Hu

The radioactive nature of Large Language Model (LLM) watermarking enables the detection of watermarks inherited by student models when trained on the outputs of watermarked teacher models, making it a promising tool for preventing…

Computation and Language · Computer Science 2025-05-27 Leyi Pan , Aiwei Liu , Shiyu Huang , Yijian Lu , Xuming Hu , Lijie Wen , Irwin King , Philip S. Yu

Despite the broad application of Machine Learning models as a Service (MLaaS), they are vulnerable to model stealing attacks. These attacks can replicate the model functionality by using the black-box query process without any prior…

Cryptography and Security · Computer Science 2023-08-04 Jun Guo , Aishan Liu , Xingyu Zheng , Siyuan Liang , Yisong Xiao , Yichao Wu , Xianglong Liu

The study of physical adversarial patches is crucial for identifying vulnerabilities in AI-based recognition systems and developing more robust deep learning models. While recent research has focused on improving patch stealthiness for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wei Liu , Yonglin Wu , Chaoqun Li , Zhuodong Liu , Huanqian Yan

Deep Neural Networks have been widely used in many fields. However, studies have shown that DNNs are easily attacked by adversarial examples, which have tiny perturbations and greatly mislead the correct judgment of DNNs. Furthermore, even…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shaowei Zhu , Wanli Lyu , Bin Li , Zhaoxia Yin , Bin Luo

Reasoning distillation has emerged as a prevailing paradigm for transferring reasoning capabilities from large reasoning models to small language models. Yet, reasoning distillation risks data contamination: benchmark data may inadvertently…

Computation and Language · Computer Science 2026-05-11 Hengxiang Zhang , Hyeong Kyu Choi , Sharon Li , Hongxin Wei

We propose an algorithm that compresses the critical information of a large dataset into compact addressable memories. These memories can then be recalled to quickly re-train a neural network and recover the performance (instead of storing…

Machine Learning · Computer Science 2022-11-22 Zhiwei Deng , Olga Russakovsky

Deep neural networks have had enormous impact on various domains of computer science, considerably outperforming previous state of the art machine learning techniques. To achieve this performance, neural networks need large quantities of…

Cryptography and Security · Computer Science 2018-09-05 Dorjan Hitaj , Luigi V. Mancini

Data poisoning is a training-time attack that undermines the trustworthiness of learned models. In a targeted data poisoning attack, an adversary manipulates the training dataset to alter the classification of a targeted test point. Given…

Machine Learning · Computer Science 2025-11-18 Nakshatra Gupta , Sumanth Prabhu , Supratik Chakraborty , R Venkatesh

Graph neural networks (GNNs) have shown great success in detecting intellectual property (IP) piracy and hardware Trojans (HTs). However, the machine learning community has demonstrated that GNNs are susceptible to data poisoning attacks,…

Cryptography and Security · Computer Science 2023-03-27 Lilas Alrahis , Satwik Patnaik , Muhammad Abdullah Hanif , Muhammad Shafique , Ozgur Sinanoglu

Machine learning models have been widely adopted in several fields. However, most recent studies have shown several vulnerabilities from attacks with a potential to jeopardize the integrity of the model, presenting a new window of research…

Cryptography and Security · Computer Science 2022-02-23 Miguel A. Ramirez , Song-Kyoo Kim , Hussam Al Hamadi , Ernesto Damiani , Young-Ji Byon , Tae-Yeon Kim , Chung-Suk Cho , Chan Yeob Yeun

A number of online services nowadays rely upon machine learning to extract valuable information from data collected in the wild. This exposes learning algorithms to the threat of data poisoning, i.e., a coordinate attack in which a fraction…

The promise of LLM watermarking rests on a core assumption that a specific watermark proves authorship by a specific model. We demonstrate that this assumption is dangerously flawed. We introduce the threat of watermark spoofing, a…

Cryptography and Security · Computer Science 2026-02-24 Hyeseon An , Shinwoo Park , Suyeon Woo , Yo-Sub Han

Modern deep learning requires large volumes of data, which could contain sensitive or private information that cannot be leaked. Recent work has shown for homogeneous neural networks a large portion of this training data could be…

Machine Learning · Computer Science 2023-11-13 Noel Loo , Ramin Hasani , Mathias Lechner , Alexander Amini , Daniela Rus

Distributed deep neural networks (DNNs) have emerged as a key technique to reduce communication overhead without sacrificing performance in edge computing systems. Recently, entropy coding has been introduced to further reduce the…

Machine Learning · Computer Science 2024-07-12 Milin Zhang , Mohammad Abdi , Shahriar Rifat , Francesco Restuccia

Knowledge distillation in neural networks refers to compressing a large model or dataset into a smaller version of itself. We introduce Privacy Distillation, a framework that allows a text-to-image generative model to teach another model…

The large memory and computation consumption in convolutional neural networks (CNNs) has been one of the main barriers for deploying them on resource-limited systems. To this end, most cheap convolutions (e.g., group convolution, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Jiao Xie , Shaohui Lin , Yichen Zhang , Linkai Luo