English
Related papers

Related papers: PRADA: Protecting against DNN Model Stealing Attac…

200 papers

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

Machine Learning · Computer Science 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

Machine Learning · Computer Science 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Machine learning as a Service (MLaaS) allows users to query the machine learning model in an API manner, which provides an opportunity for users to enjoy the benefits brought by the high-performance model trained on valuable data. This…

Cryptography and Security · Computer Science 2024-04-02 Yiyong Liu , Rui Wen , Michael Backes , Yang Zhang

The widespread use of publicly available datasets for training machine learning models raises significant concerns about data misuse. Availability attacks have emerged as a means for data owners to safeguard their data by designing…

Machine Learning · Computer Science 2025-03-11 Yu Zhe , Jun Sakuma

Neural ranking models (NRMs) have shown remarkable success in recent years, especially with pre-trained language models. However, deep neural models are notorious for their vulnerability to adversarial examples. Adversarial attacks may…

Information Retrieval · Computer Science 2022-06-09 Chen Wu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

The large model size, high computational operations, and vulnerability against membership inference attack (MIA) have impeded deep learning or deep neural networks (DNNs) popularity, especially on mobile devices. To address the challenge,…

Machine Learning · Computer Science 2021-07-06 Yijue Wang , Chenghong Wang , Zigeng Wang , Shanglin Zhou , Hang Liu , Jinbo Bi , Caiwen Ding , Sanguthevar Rajasekaran

Diffusion models have been remarkably successful in data synthesis. However, when these models are applied to sensitive datasets, such as banking and human face data, they might bring up severe privacy concerns. This work systematically…

Cryptography and Security · Computer Science 2024-04-30 Hailong Hu , Jun Pang

Machine unlearning enables the removal of specific data from ML models to uphold the right to be forgotten. While approximate unlearning algorithms offer efficient alternatives to full retraining, this work reveals that they fail to…

Machine Learning · Computer Science 2025-07-29 Yaxin Xiao , Qingqing Ye , Li Hu , Huadi Zheng , Haibo Hu , Zi Liang , Haoyang Li , Yijie Jiao

Recent advancements of Deep Neural Networks (DNNs) have seen widespread deployment in multiple security-sensitive domains. The need of resource-intensive training and use of valuable domain-specific training data have made these models a…

Cryptography and Security · Computer Science 2021-11-09 Adnan Siraj Rakin , Md Hafizul Islam Chowdhuryy , Fan Yao , Deliang Fan

Machine learning models have been widely adopted in several fields. However, most recent studies have shown several vulnerabilities from attacks with a potential to jeopardize the integrity of the model, presenting a new window of research…

Cryptography and Security · Computer Science 2022-02-23 Miguel A. Ramirez , Song-Kyoo Kim , Hussam Al Hamadi , Ernesto Damiani , Young-Ji Byon , Tae-Yeon Kim , Chung-Suk Cho , Chan Yeob Yeun

The main premise of federated learning is that machine learning model updates are computed locally, in particular to preserve user data privacy, as those never leave the perimeter of their device. This mechanism supposes the general model,…

Machine Learning · Computer Science 2023-08-09 Simon Queyrut , Yérom-David Bromberg , Valerio Schiavoni

Machine Learning models, extensively used for various multimedia applications, are offered to users as a blackbox service on the Cloud on a pay-per-query basis. Such blackbox models are commercially valuable to adversaries, making them…

Cryptography and Security · Computer Science 2020-02-04 Vasisht Duddu , D. Vijay Rao

Given oracle access to a Neural Network (NN), it is possible to extract its underlying model. We here introduce a protection by adding parasitic layers which keep the underlying NN's predictions mostly unchanged while complexifying the task…

Machine Learning · Computer Science 2020-08-03 Hervé Chabanne , Vincent Despiegel , Linda Guiga

Federated learning has quickly gained popularity with its promises of increased user privacy and efficiency. Previous works have shown that federated gradient updates contain information that can be used to approximately recover user data…

Machine Learning · Computer Science 2022-03-21 Liam Fowl , Jonas Geiping , Wojtek Czaja , Micah Goldblum , Tom Goldstein

Model extraction attacks are one type of inference-time attacks that approximate the functionality and performance of a black-box victim model by launching a certain number of queries to the model and then leveraging the model's predictions…

Cryptography and Security · Computer Science 2025-01-03 Yixu Wang , Tianle Gu , Yan Teng , Yingchun Wang , Xingjun Ma

Increasing use of machine learning (ML) technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing…

Cryptography and Security · Computer Science 2022-01-25 Shagufta Mehnaz , Sayanton V. Dibbo , Ehsanul Kabir , Ninghui Li , Elisa Bertino

While Deep Neural Networks (DNNs) excel in many tasks, the huge training resources they require become an obstacle for practitioners to develop their own models. It has become common to collect data from the Internet or hire a third party…

Machine Learning · Computer Science 2022-03-15 Pengfei Xia , Hongjing Niu , Ziqiang Li , Bin Li

Large language models (LLMs) are inherently vulnerable to unintended privacy breaches. Consequently, systematic red-teaming research is essential for developing robust defense mechanisms. However, current data extraction methods suffer from…

Machine Learning · Computer Science 2025-05-13 Zhiqiang Wang , Ruoxi Cheng

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Machine Learning as a Service (MLaaS) platforms have gained popularity due to their accessibility, cost-efficiency, scalability, and rapid development capabilities. However, recent research has highlighted the vulnerability of cloud-based…

Cryptography and Security · Computer Science 2024-10-23 Hongwei Yao , Zheng Li , Haiqin Weng , Feng Xue , Zhan Qin , Kui Ren