English
Related papers

Related papers: Shake to Leak: Fine-tuning Diffusion Models Can Am…

200 papers

The wide adoption and application of Masked language models~(MLMs) on sensitive data (from legal to medical) necessitates a thorough quantitative investigation into their privacy vulnerabilities -- to what extent do MLMs leak information…

Machine Learning · Computer Science 2022-11-07 Fatemehsadat Mireshghallah , Kartik Goyal , Archit Uniyal , Taylor Berg-Kirkpatrick , Reza Shokri

Large language models (LLMs) are increasingly deployed in enterprise settings where they interact with multiple users and are trained or fine-tuned on sensitive internal data. While fine-tuning enhances performance by internalizing domain…

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating…

Machine Learning · Computer Science 2024-06-19 Zhenlong Liu , Lei Feng , Huiping Zhuang , Xiaofeng Cao , Hongxin Wei

Large Language Models (LLMs) have recently demonstrated remarkable performance in generating high-quality tabular synthetic data. In practice, two primary approaches have emerged for adapting LLMs to tabular data generation: (i) fine-tuning…

Machine Learning · Computer Science 2026-05-12 Joshua Ward , Bochao Gu , Chi-Hua Wang , Guang Cheng

Membership inference attacks (MIAs) are widely used to assess the privacy risks associated with machine learning models. However, when these attacks are applied to pre-trained large language models (LLMs), they encounter significant…

Cryptography and Security · Computer Science 2026-05-26 Meng Tong , Yuntao Du , Kejiang Chen , Weiming Zhang , Ninghui Li

Recent Deep Learning (DL) advancements in solving complex real-world tasks have led to its widespread adoption in practical applications. However, this opportunity comes with significant underlying risks, as many of these models rely on…

Cryptography and Security · Computer Science 2024-02-20 Shubhi Shukla , Manaar Alam , Sarani Bhattacharya , Debdeep Mukhopadhyay , Pabitra Mitra

Most current approaches for protecting privacy in machine learning (ML) assume that models exist in a vacuum. Yet, in reality, these models are part of larger systems that include components for training data filtering, output monitoring,…

Federated learning synchronizes models through gradient transmission and aggregation. However, these gradients pose significant privacy risks, as sensitive training data is embedded within them. Existing gradient inversion attacks suffer…

Cryptography and Security · Computer Science 2025-11-18 Jiayang Meng , Tao Huang , Hong Chen , Chen Hou , Guolong Zheng

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

Machine Learning · Computer Science 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

The proliferation of Large Language Models (LLMs) has driven considerable interest in fine-tuning them with domain-specific data to create specialized language models. Nevertheless, such domain-specific fine-tuning data often contains…

Computation and Language · Computer Science 2024-10-29 Yijia Xiao , Yiqiao Jin , Yushi Bai , Yue Wu , Xianjun Yang , Xiao Luo , Wenchao Yu , Xujiang Zhao , Yanchi Liu , Quanquan Gu , Haifeng Chen , Wei Wang , Wei Cheng

Privacy concerns have become increasingly critical in modern AI and data science applications, where sensitive information is collected, analyzed, and shared across diverse domains such as healthcare, finance, and mobility. While prior…

Cryptography and Security · Computer Science 2025-10-30 Ziyao Cui , Minxing Zhang , Jian Pei

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

Machine Learning · Computer Science 2025-04-15 Lucas Beerens , Desmond J. Higham

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern.…

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

Large Language Models (LLMs) are susceptible to generating harmful content when prompted with carefully crafted inputs, a vulnerability known as LLM jailbreaking. As LLMs become more powerful, studying jailbreak methods is critical to…

Computation and Language · Computer Science 2025-01-07 Hao Wang , Hao Li , Junda Zhu , Xinyuan Wang , Chengwei Pan , MinLie Huang , Lei Sha

Domain fine-tuning is a common path to deploy small instruction-tuned language models as customer-support assistants, yet its effects on safety-aligned behavior and privacy are not well understood. In real deployments, such assistants…

Cryptography and Security · Computer Science 2026-03-03 Jayesh Choudhari , Piyush Kumar Singh

Gradient leakage attacks pose a significant threat to the privacy guarantees of federated learning. While distortion-based protection mechanisms are commonly employed to mitigate this issue, they often lead to notable performance…

Cryptography and Security · Computer Science 2024-12-19 Haoyang Li , Wei Chen , Xiaojin Zhang