English
Related papers

Related papers: Deep Learning with Label Differential Privacy

200 papers

Federated learning (FL) with differential privacy (DP) provides a framework for collaborative machine learning, enabling clients to train a shared model while adhering to strict privacy constraints. The framework allows each client to have…

Machine Learning · Computer Science 2025-02-27 Shahrzad Kiani , Nupur Kulkarni , Adam Dziedzic , Stark Draper , Franziska Boenisch

Federated learning (FL) takes a first step towards privacy-preserving machine learning by training models while keeping client data local. Models trained using FL may still leak private client information through model updates during…

Machine Learning · Computer Science 2023-01-18 Nasser Aldaghri , Hessam Mahdavifar , Ahmad Beirami

In Semi-Supervised Semi-Private (SP) learning, the learner has access to both public unlabelled and private labelled data. We propose a computationally efficient algorithm that, under mild assumptions on the data, provably achieves…

Machine Learning · Computer Science 2023-06-08 Francesco Pinto , Yaxi Hu , Fanny Yang , Amartya Sanyal

We propose an adaptive (stochastic) gradient perturbation method for differentially private empirical risk minimization. At each iteration, the random noise added to the gradient is optimally adapted to the stepsize; we name this process…

Machine Learning · Computer Science 2021-10-26 Xiaoxia Wu , Lingxiao Wang , Irina Cristali , Quanquan Gu , Rebecca Willett

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

Protecting data privacy in deep learning (DL) is of crucial importance. Several celebrated privacy notions have been established and used for privacy-preserving DL. However, many existing mechanisms achieve privacy at the cost of…

Machine Learning · Computer Science 2024-08-13 Wenqi Tao , Huaming Ling , Zuoqiang Shi , Bao Wang

Protocols satisfying Local Differential Privacy (LDP) enable parties to collect aggregate information about a population while protecting each user's privacy, without relying on a trusted third party. LDP protocols (such as Google's RAPPOR)…

Cryptography and Security · Computer Science 2017-05-16 Tianhao Wang , Jeremiah Blocki , Ninghui Li , Somesh Jha

With growing concerns about user data collection, individualized privacy has emerged as a promising solution to balance protection and utility by accounting for diverse user privacy preferences. Instead of enforcing a uniform level of…

Machine Learning · Computer Science 2026-02-04 Lucas Lange , Ole Borchardt , Erhard Rahm

Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy…

Machine Learning · Computer Science 2026-02-04 Yinan Huang , Haoteng Yin , Eli Chien , Rongzhe Wei , Pan Li

We introduce a deep learning framework able to deal with strong privacy constraints. Based on collaborative learning, differential privacy and homomorphic encryption, the proposed approach advances state-of-the-art of private deep learning…

Cryptography and Security · Computer Science 2021-03-29 Arnaud Grivet Sébert , Rafael Pinot , Martin Zuber , Cédric Gouy-Pailler , Renaud Sirdey

Privacy-preserving machine learning algorithms are crucial for the increasingly common setting in which personal data, such as medical or financial records, are analyzed. We provide general techniques to produce privacy-preserving…

Machine Learning · Computer Science 2011-02-18 Kamalika Chaudhuri , Claire Monteleoni , Anand D. Sarwate

Although deep learning has revolutionized domains such as natural language processing and computer vision, its dependence on centralized datasets raises serious privacy concerns. Federated learning addresses this issue by enabling multiple…

Machine Learning · Computer Science 2025-11-19 Andreas Lutz , Gabriele Steidl , Karsten Müller , Wojciech Samek

This work examines a novel question: how much randomness is needed to achieve local differential privacy (LDP)? A motivating scenario is providing {\em multiple levels of privacy} to multiple analysts, either for distribution or for…

Cryptography and Security · Computer Science 2020-05-26 Antonious M. Girgis , Deepesh Data , Kamalika Chaudhuri , Christina Fragouli , Suhas Diggavi

This paper presents privileged multi-label learning (PrML) to explore and exploit the relationship between labels in multi-label learning problems. We suggest that for each individual label, it cannot only be implicitly connected with other…

Machine Learning · Statistics 2017-01-26 Shan You , Chang Xu , Yunhe Wang , Chao Xu , Dacheng Tao

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for discovery of hidden semantic architecture of text datasets, and plays a fundamental role in many machine learning applications. However, like many other machine…

Machine Learning · Computer Science 2019-07-02 Fangyuan Zhao , Xuebin Ren , Shusen Yang , Xinyu Yang

Deep learning-based linkage of records across different databases is becoming increasingly useful in data integration and mining applications to discover new insights from multiple sources of data. However, due to privacy and…

Cryptography and Security · Computer Science 2022-11-07 Thilina Ranbaduge , Dinusha Vatsalan , Ming Ding

Random forests are widely used in fields involving sensitive tabular data, but existing approaches to enforcing differential privacy (DP) typically degrade performance to the point of impracticality. In this paper, we introduce Lumberjack,…

Machine Learning · Computer Science 2026-05-22 Christian Janos Lebeda , David Erb , Tudor Cebere , Aurélien Bellet

Federated learning (FL) has gained significant attention recently as a privacy-enhancing tool to jointly train a machine learning model by multiple participants. The prior work on FL has mostly studied how to protect label privacy during…

Machine Learning · Computer Science 2022-12-09 Jiankai Sun , Xin Yang , Yuanshun Yao , Junyuan Xie , Di Wu , Chong Wang

The combination of deep neural networks and Differential Privacy has been of increasing interest in recent years, as it offers important data protection guarantees to the individuals of the training datasets used. However, using…

Machine Learning · Computer Science 2021-06-03 Osvald Frisk , Friedrich Dörmann , Christian Marius Lillelund , Christian Fischer Pedersen

Language modeling is a keystone task in natural language processing. When training a language model on sensitive information, differential privacy (DP) allows us to quantify the degree to which our private data is protected. However,…

Machine Learning · Computer Science 2020-10-27 Gavin Kerrigan , Dylan Slack , Jens Tuyls