English
Related papers

Related papers: Underestimated Privacy Risks for Minority Populati…

200 papers

Large Language Models (LLMs) increasingly leverage Federated Learning (FL) to utilize private, task-specific datasets for fine-tuning while preserving data privacy. However, while federated LLM frameworks effectively enable collaborative…

Machine Learning · Computer Science 2025-11-11 Fuyao Zhang , Xinyu Yan , Tiantong Wu , Wenjie Li , Tianxiang Chen , Yang Cao , Ran Yan , Longtao Huang , Wei Yang Bryan Lim , Qiang Yang

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

Machine Learning · Computer Science 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha

Large Language Models (LLMs) utilize large amounts of data for their training, some of which may come from copyrighted sources. Membership Inference Attacks (MIA) aim to detect those documents and whether they have been included in the…

Artificial Intelligence · Computer Science 2026-04-22 Juliusz Janicki , Savvas Chamezopoulos , Evangelos Kanoulas , Georgios Tsatsaronis

We study how to perform unlearning, i.e. forgetting undesirable misbehaviors, on large language models (LLMs). We show at least three scenarios of aligning LLMs with human preferences can benefit from unlearning: (1) removing harmful…

Computation and Language · Computer Science 2024-02-20 Yuanshun Yao , Xiaojun Xu , Yang Liu

Large Language Models (LLMs) are known to be vulnerable to jailbreak attacks. An important observation is that, while different types of jailbreak attacks can generate significantly different queries, they mostly result in similar responses…

Cryptography and Security · Computer Science 2025-05-21 Zhexin Zhang , Junxiao Yang , Yida Lu , Pei Ke , Shiyao Cui , Chujie Zheng , Hongning Wang , Minlie Huang

While Code Language Models (CLMs) have demonstrated superior performance in software engineering tasks such as code generation and summarization, recent empirical studies reveal a critical privacy vulnerability: these models exhibit…

Software Engineering · Computer Science 2025-09-18 Zhaoyang Chu , Yao Wan , Zhikun Zhang , Di Wang , Zhou Yang , Hongyu Zhang , Pan Zhou , Xuanhua Shi , Hai Jin , David Lo

Large Language Models (LLMs) are increasingly deployed in politically sensitive environments, where memorisation of personal data or confidential content raises regulatory concerns under frameworks such as the GDPR and its Right to be…

Artificial Intelligence · Computer Science 2026-04-15 Esen Kurt , Haithem Afli

Large Language Models (LLMs) are widely used in sensitive domains, including healthcare, finance, and legal services, raising concerns about potential private information leaks during inference. Privacy extraction attacks, such as…

Cryptography and Security · Computer Science 2025-06-25 Jinwen He , Yiyang Lu , Zijin Lin , Kai Chen , Yue Zhao

Large Reasoning Models (LRMs) generate structured chains of thought (CoTs) before producing final answers, making them especially vulnerable to knowledge leakage through intermediate reasoning steps. Yet, the memorization of sensitive…

Artificial Intelligence · Computer Science 2026-04-07 Tuan Le , Wei Qian , Mengdi Huai

Machine unlearning for large language models often faces a privacy dilemma in which strict constraints prohibit sharing either the server's parameters or the client's forget set. To address this dual non-disclosure constraint, we propose…

Machine Learning · Computer Science 2026-05-15 Tiantong Wang , Xinyu Yan , Tiantong Wu , Yurong Hao , Pengjun Xie , Wei Yang Bryan Lim

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

Large Vision-Language Models (LVLMs) can recognize individuals in images and disclose sensitive personal information about them, raising critical privacy concerns. Machine unlearning aims to remove such knowledge from the model. However,…

Machine Learning · Computer Science 2026-04-21 Minsung Kim , Nakyeong Yang , Kyomin Jung

Large language models (LLMs) exhibit powerful capabilities but risk memorizing sensitive personally identifiable information (PII) from their training data, posing significant privacy concerns. While machine unlearning techniques aim to…

Cryptography and Security · Computer Science 2026-01-23 Xinjie Zhou , Zhihui Yang , Lechao Cheng , Sai Wu , Gang Chen

Machine Unlearning (MUL) is crucial for privacy protection and content regulation, yet recent studies reveal that traces of forgotten information persist in unlearned models, enabling adversaries to resurface removed knowledge. Existing…

Machine Learning · Computer Science 2025-04-22 Hao Xuan , Xingyu Li

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong

The advent of Large Language Models (LLMs) has revolutionized natural language processing, enabling advanced understanding and reasoning capabilities across a variety of tasks. Fine-tuning these models for specific domains, particularly…

Artificial Intelligence · Computer Science 2025-04-21 Chenlu Ding , Jiancan Wu , Yancheng Yuan , Jinda Lu , Kai Zhang , Alex Su , Xiang Wang , Xiangnan He

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been…

Computation and Language · Computer Science 2024-02-26 Tianlin Li , Qian Liu , Tianyu Pang , Chao Du , Qing Guo , Yang Liu , Min Lin

This paper explores the risk that a large language model (LLM) trained for code generation on data mined from software repositories will generate content that discloses sensitive information included in its training data. We decompose this…

Cryptography and Security · Computer Science 2026-04-16 Rafiqul Rabin , Sean McGregor , Nick Judd

Membership inference attacks (MIAs) pose a significant threat to the privacy of machine learning models and are widely used as tools for privacy assessment, auditing, and machine unlearning. While prior MIA research has primarily focused on…

Machine Learning · Computer Science 2025-07-04 Zhiqi Wang , Chengyu Zhang , Yuetian Chen , Nathalie Baracaldo , Swanand Kadhe , Lei Yu

The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines. On the one hand, powerful language models, trained on…

Computation and Language · Computer Science 2024-10-01 Haoran Li , Yulin Chen , Jinglong Luo , Jiecong Wang , Hao Peng , Yan Kang , Xiaojin Zhang , Qi Hu , Chunkit Chan , Zenglin Xu , Bryan Hooi , Yangqiu Song