English
Related papers

Related papers: Privacy Risk in Machine Learning: Analyzing the Co…

200 papers

Collaborative machine learning and related techniques such as federated learning allow multiple participants, each with his own training dataset, to build a joint model by training locally and periodically exchanging model updates. We…

Cryptography and Security · Computer Science 2018-11-02 Luca Melis , Congzheng Song , Emiliano De Cristofaro , Vitaly Shmatikov

Training machine learning models on privacy-sensitive data has become a popular practice, driving innovation in ever-expanding fields. This has opened the door to new attacks that can have serious privacy implications. One such attack, the…

Cryptography and Security · Computer Science 2023-06-16 Thomas Humphries , Simon Oya , Lindsey Tulloch , Matthew Rafuse , Ian Goldberg , Urs Hengartner , Florian Kerschbaum

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

Cryptography and Security · Computer Science 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang

Despite the large body of academic work on machine learning security, little is known about the occurrence of attacks on machine learning systems in the wild. In this paper, we report on a quantitative study with 139 industrial…

Machine Learning · Computer Science 2023-03-13 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Battista Biggio , Katharina Krombholz

With the rapid advancement of deep learning technology, pre-trained encoder models have demonstrated exceptional feature extraction capabilities, playing a pivotal role in the research and application of deep learning. However, their…

Cryptography and Security · Computer Science 2025-06-09 Ruining Sun , Hongsheng Hu , Wei Luo , Zhaoxi Zhang , Yanjun Zhang , Haizhuan Yuan , Leo Yu Zhang

The widespread deployment of Artificial Intelligence (AI) across government and private industries brings both advancements and heightened privacy and security concerns. Article 17 of the General Data Protection Regulation (GDPR) mandates…

Cryptography and Security · Computer Science 2025-04-15 Payel Sadhukhan , Tanujit Chakraborty

The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and…

Cryptography and Security · Computer Science 2024-02-28 Le Yang , Miao Tian , Duan Xin , Qishuo Cheng , Jiajian Zheng

Commercial companies that collect user data on a large scale have been the main beneficiaries of this trend since the success of deep learning techniques is directly proportional to the amount of data available for training. Massive data…

Cryptography and Security · Computer Science 2020-06-30 Saichethan Miriyala Reddy , Saisree Miriyala

Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive---new systems and models are being deployed in every…

Cryptography and Security · Computer Science 2016-11-14 Nicolas Papernot , Patrick McDaniel , Arunesh Sinha , Michael Wellman

Fine-tuning is a common and effective method for tailoring large language models (LLMs) to specialized tasks and applications. In this paper, we study the privacy implications of fine-tuning LLMs on user data. To this end, we consider a…

Cryptography and Security · Computer Science 2024-02-27 Nikhil Kandpal , Krishna Pillutla , Alina Oprea , Peter Kairouz , Christopher A. Choquette-Choo , Zheng Xu

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

Cryptography and Security · Computer Science 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

Recent years have witnessed the tremendous success of diffusion models in data synthesis. However, when diffusion models are applied to sensitive data, they also give rise to severe privacy concerns. In this paper, we systematically present…

Cryptography and Security · Computer Science 2023-01-25 Hailong Hu , Jun Pang

A number of recent works have demonstrated that API access to machine learning models leaks information about the dataset records used to train the models. Further, the work of \cite{somesh-overfit} shows that such membership inference…

Cryptography and Security · Computer Science 2019-10-15 Benjamin Zi Hao Zhao , Hassan Jameel Asghar , Raghav Bhaskar , Mohamed Ali Kaafar

Many current Internet services rely on inferences from models trained on user data. Commonly, both the training and inference tasks are carried out using cloud resources fed by personal data collected at scale from users. Holding and using…

Machine Learning · Computer Science 2018-04-04 Sandra Servia-Rodriguez , Liang Wang , Jianxin R. Zhao , Richard Mortier , Hamed Haddadi

Machine learning models can leak information regarding the dataset they have trained. In this paper, we present the first membership inference attack against black-boxed object detection models that determines whether the given data records…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Yeachan Park , Myungjoo Kang

Membership inference attacks allow a malicious entity to predict whether a sample is used during training of a victim model or not. State-of-the-art membership inference attacks have shown to achieve good accuracy which poses a great…

Machine Learning · Computer Science 2022-03-07 Shahbaz Rezaei , Xin Liu

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

Machine Learning · Computer Science 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Generative models are subject to overfitting and thus may potentially leak sensitive information from the training data. In this work. we investigate the privacy risks that can potentially arise from the use of generative adversarial…

Cryptography and Security · Computer Science 2024-04-02 Abdallah Alshantti , Adil Rasheed , Frank Westad

As machine learning expanding application, there are more and more unignorable privacy and safety issues. Especially inference attacks against Machine Learning models allow adversaries to infer sensitive information about the target model,…

Cryptography and Security · Computer Science 2022-12-22 Yang Yang