English
Related papers

Related papers: Differential Privacy in Natural Language Processin…

200 papers

The concept of differential privacy (DP) has gained substantial attention in recent years, most notably since the U.S. Census Bureau announced the adoption of the concept for its 2020 Decennial Census. However, despite its attractive…

Methodology · Statistics 2024-08-14 Jörg Drechsler , James Bailie

The combination of deep neural networks and Differential Privacy has been of increasing interest in recent years, as it offers important data protection guarantees to the individuals of the training datasets used. However, using…

Machine Learning · Computer Science 2021-06-03 Osvald Frisk , Friedrich Dörmann , Christian Marius Lillelund , Christian Fischer Pedersen

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

Advanced adversarial attacks such as membership inference and model memorization can make federated learning (FL) vulnerable and potentially leak sensitive private data. Local differentially private (LDP) approaches are gaining more…

Cryptography and Security · Computer Science 2022-08-04 M. A. P. Chamikara , Dongxi Liu , Seyit Camtepe , Surya Nepal , Marthie Grobler , Peter Bertok , Ibrahim Khalil

The generative Artificial Intelligence (AI) tools based on Large Language Models (LLMs) use billions of parameters to extensively analyse large datasets and extract critical private information such as, context, specific details,…

Cryptography and Security · Computer Science 2023-10-20 Imdad Ullah , Najm Hassan , Sukhpal Singh Gill , Basem Suleiman , Tariq Ahamed Ahanger , Zawar Shah , Junaid Qadir , Salil S. Kanhere

The authors discuss their experience applying differential privacy with a complex data set with the goal of enabling standard approaches to statistical data analysis. They highlight lessons learned and roadblocks encountered, distilling…

Cryptography and Security · Computer Science 2023-10-02 Joshua Snoke , Claire McKay Bowen , Aaron R. Williams , Andrés F. Barrientos

Federated learning (FL) as one of the novel branches of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, access to model updates (e.g. gradient updates…

Cryptography and Security · Computer Science 2024-01-08 Mahtab Talaei , Iman Izadi

This work investigates the effectiveness of different pseudonymization techniques, ranging from rule-based substitutions to using pre-trained Large Language Models (LLMs), on a variety of datasets and models used for two widely used NLP…

Computation and Language · Computer Science 2023-06-12 Oleksandr Yermilov , Vipul Raheja , Artem Chernodub

Data mining information about people is becoming increasingly important in the data-driven society of the 21st century. Unfortunately, sometimes there are real-world considerations that conflict with the goals of data mining; sometimes the…

Databases · Computer Science 2019-05-27 Sam Fletcher , Md Zahidul Islam

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

In-context learning (ICL) in Large Language Models (LLMs) has shown remarkable performance across various tasks without requiring fine-tuning. However, recent studies have highlighted the risk of private data leakage through the prompt in…

Artificial Intelligence · Computer Science 2025-09-16 Seongho Joo , Hyukhun Koh , Kyomin Jung

Large Language Models (LLMs) have transformed natural language processing (NLP) by enabling robust text generation and understanding. However, their deployment in sensitive domains like healthcare, finance, and legal services raises…

Artificial Intelligence · Computer Science 2024-12-09 Georgios Feretzakis , Vassilios S. Verykios

The study of Differential Privacy (DP) in Natural Language Processing often views the task of text privatization as a $\textit{rewriting}$ task, in which sensitive input texts are rewritten to hide explicit or implicit private information.…

Computation and Language · Computer Science 2024-06-03 Stephen Meisenbacher , Florian Matthes

Differential privacy (DP) is typically formulated as a worst-case privacy guarantee over all individuals in a database. More recently, extensions to individual subjects or their attributes, have been introduced. Under the…

Encoded text representations often capture sensitive attributes about individuals (e.g., race or gender), which raise privacy concerns and can make downstream models unfair to certain groups. In this work, we propose FEDERATE, an approach…

Computation and Language · Computer Science 2022-05-13 Gaurav Maheshwari , Pascal Denis , Mikaela Keller , Aurélien Bellet

Large language models specialized for code (CodeLLMs) have demonstrated remarkable capabilities in generating code snippets, documentation, and test cases. However, despite their promising capabilities, CodeLLMs can inadvertently memorize…

Software Engineering · Computer Science 2025-12-15 Melih Catal , Pooja Rani , Harald C. Gall

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

Cryptography and Security · Computer Science 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

Advances in Natural Language Processing (NLP) have the potential to transform HR processes, from recruitment to employee management. While recent breakthroughs in NLP have generated significant interest in its industrial applications, a…

Computation and Language · Computer Science 2025-03-26 Naoki Otani , Nikita Bhutani , Estevam Hruschka

The use of Natural Language Processing (NLP) in highstakes AI-based applications has increased significantly in recent years, especially since the emergence of Large Language Models (LLMs). However, despite their strong performance, LLMs…

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava