English
Related papers

Related papers: Towards Differentially Private Text Representation…

200 papers

Local Differential Privacy (LDP) protocols allow an aggregator to obtain population statistics about sensitive data of a userbase, while protecting the privacy of the individual users. To understand the tradeoff between aggregator utility…

Cryptography and Security · Computer Science 2019-10-18 Milan Lopuhaä-Zwakenberg , Boris Škorić , Ninghui Li

We study the problem of estimating high dimensional models with underlying sparse structures while preserving the privacy of each training example. We develop a differentially private high-dimensional sparse learning framework using the…

Machine Learning · Statistics 2019-09-16 Lingxiao Wang , Quanquan Gu

We investigate how to optimally design local differential privacy (LDP) mechanisms that reduce data unfairness and thereby improve fairness in downstream classification. We first derive a closed-form optimal mechanism for binary sensitive…

Machine Learning · Computer Science 2026-02-02 Hrad Ghoukasian , Shahab Asoodeh

The shuffle model of Differential Privacy (DP) is an enhanced privacy protocol which introduces an intermediate trusted server between local users and a central data curator. It significantly amplifies the central DP guarantee by…

Cryptography and Security · Computer Science 2024-07-26 Yixuan Liu , Yuhan Liu , Li Xiong , Yujie Gu , Hong Chen

Privacy concerns with sensitive data are receiving increasing attention. In this paper, we study local differential privacy (LDP) in interactive decentralized optimization. By constructing random local aggregators, we propose a framework to…

Optimization and Control · Mathematics 2019-06-04 Hanshen Xiao , Yu Ye , Srinivas Devadas

Prompt privacy is crucial, especially when using online large language models (LLMs), due to the sensitive information often contained within prompts. While LLMs can enhance prompt privacy through text rewriting, existing methods primarily…

Computation and Language · Computer Science 2025-11-18 Mingchen Li , Heng Fan , Song Fu , Junhua Ding , Yunhe Feng

Differential privacy (DP) is widely employed to provide privacy protection for individuals by limiting information leakage from the aggregated data. Two well-known models of DP are the central model and the local model. The former requires…

Cryptography and Security · Computer Science 2024-11-05 Yucheng Fu , Tianhao Wang

While federated learning (FL) eliminates the transmission of raw data over a network, it is still vulnerable to privacy breaches from the communicated model parameters. In this work, we propose Multi-Tier Federated Learning with Multi-Tier…

Machine Learning · Computer Science 2024-11-11 Evan Chen , Frank Po-Chen Lin , Dong-Jun Han , Christopher G. Brinton

Differential privacy (DP) has arisen as the state-of-the-art metric for quantifying individual privacy when sensitive data are analyzed, and it is starting to see practical deployment in organizations such as the US Census Bureau, Apple,…

Cryptography and Security · Computer Science 2020-04-21 Sameer Wagh , Xi He , Ashwin Machanavajjhala , Prateek Mittal

The field of privacy-preserving Natural Language Processing has risen in popularity, particularly at a time when concerns about privacy grow with the proliferation of Large Language Models. One solution consistently appearing in recent…

Computation and Language · Computer Science 2024-10-02 Stephen Meisenbacher , Florian Matthes

This paper proposes a new recommendation system preserving both privacy and utility. It relies on the local differential privacy (LDP) for the browsing user to transmit his noisy preference profile, as perturbed Bloom filters, to the…

Cryptography and Security · Computer Science 2021-09-24 Seryne Rahali , Maryline Laurent , Souha Masmoudi , Charles Roux , Brice Mazeau

We present an approach for generating differentially private synthetic text using large language models (LLMs), via private prediction. In the private prediction framework, we only require the output synthetic data to satisfy differential…

Machine Learning · Computer Science 2024-10-10 Kareem Amin , Alex Bie , Weiwei Kong , Alexey Kurakin , Natalia Ponomareva , Umar Syed , Andreas Terzis , Sergei Vassilvitskii

Machine learning (ML) algorithms rely primarily on the availability of training data, and, depending on the domain, these data may include sensitive information about the data providers, thus leading to significant privacy issues.…

Machine Learning · Computer Science 2024-05-24 Karima Makhlouf , Tamara Stefanovic , Heber H. Arcolezi , Catuscia Palamidessi

We study a setting of collecting and learning from private data distributed across end users. In the shuffled model of differential privacy, the end users partially protect their data locally before sharing it, and their data is also…

Machine Learning · Computer Science 2025-02-21 Tal Wagner

We initiate the study of distribution testing under \emph{user-level} local differential privacy, where each of $n$ users contributes $m$ samples from the unknown underlying distribution. This setting, albeit very natural, is significantly…

Data Structures and Algorithms · Computer Science 2025-10-22 Clément L. Canonne , Abigail Gentle , Vikrant Singhal

Federated Learning (FL) enables collaborative model training without direct data sharing, yet it remains vulnerable to privacy attacks such as model inversion and membership inference. Existing differential privacy (DP) solutions for FL…

Cryptography and Security · Computer Science 2026-01-06 Yunbo Li , Jiaping Gui , Fanchao Meng , Yue Wu

Iterative clustering algorithms help us to learn the insights behind the data. Unfortunately, this may allow adversaries to infer the privacy of individuals with some background knowledge. In the worst case, the adversaries know the…

Cryptography and Security · Computer Science 2022-04-05 Zhigang Lu , Hong Shen

Local differential privacy (LDP), a technique applying unbiased statistical estimations instead of real data, is often adopted in data collection. In particular, this technique is used with frequency oracles (FO) because it can protect each…

Cryptography and Security · Computer Science 2022-03-29 Dan Zhao , Suyun Zhao , Ruixuan Liu , Cuiping Li , Wenjuan Liang , Hong Chen

Deep learning models have been extensively adopted in various regions due to their ability to represent hierarchical features, which highly rely on the training set and procedures. Thus, protecting the training process and deep learning…

Cryptography and Security · Computer Science 2025-03-12 Haodi Wang , Tangyu Jiang , Yu Guo , Chengjun Cai , Cong Wang , Xiaohua Jia

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang