English
Related papers

Related papers: Label Differential Privacy via Aggregation

200 papers

We study the privacy risks that are associated with training a neural network's weights with self-supervised learning algorithms. Through empirical evidence, we show that the fine-tuning stage, in which the network weights are updated with…

Machine Learning · Computer Science 2022-05-26 Yunhao Yang , Parham Gohari , Ufuk Topcu

This paper addresses the challenge of balancing learner data privacy with the use of data in learning analytics (LA) by proposing a novel framework by applying Differential Privacy (DP). The need for more robust privacy protection keeps…

Cryptography and Security · Computer Science 2025-01-06 Qinyi Liu , Ronas Shakya , Mohammad Khalil , Jelena Jovanovic

Federated Learning (FL) enables collaborative model training without direct data sharing, yet it remains vulnerable to privacy attacks such as model inversion and membership inference. Existing differential privacy (DP) solutions for FL…

Cryptography and Security · Computer Science 2026-01-06 Yunbo Li , Jiaping Gui , Fanchao Meng , Yue Wu

$\epsilon$-Differential privacy (DP) is a well-known privacy model that offers strong privacy guarantees. However, when applied to data releases, DP significantly deteriorates the analytical utility of the protected outcomes. To keep data…

Cryptography and Security · Computer Science 2023-12-22 Jordi Soria-Comas , David Sánchez , Josep Domingo-Ferrer , Sergio Martínez , Luis Del Vasto-Terrientes

We revisit the problem of secure aggregation of high-dimensional vectors in a two-server system such as Prio. These systems are typically used to aggregate vectors such as gradients in private federated learning, where the aggregate itself…

Cryptography and Security · Computer Science 2025-07-15 Hilal Asi , Vitaly Feldman , Hannah Keller , Guy N. Rothblum , Kunal Talwar

Federated Learning (FL) exhibits privacy vulnerabilities under gradient inversion attacks (GIAs), which can extract private information from individual gradients. To enhance privacy, FL incorporates Secure Aggregation (SA) to prevent the…

Cryptography and Security · Computer Science 2024-06-25 Zhibo Wang , Zhiwei Chang , Jiahui Hu , Xiaoyi Pang , Jiacheng Du , Yongle Chen , Kui Ren

Due to the rise of privacy concerns, in many practical applications the training data is aggregated before being shared with the learner, in order to protect privacy of users' sensitive responses. In an aggregate learning framework, the…

Machine Learning · Computer Science 2024-01-23 Adel Javanmard , Lin Chen , Vahab Mirrokni , Ashwinkumar Badanidiyuru , Gang Fu

This paper considers subject level privacy in the FL setting, where a subject is an individual whose private information is embodied by several data items either confined within a single federation user or distributed across multiple…

Machine Learning · Computer Science 2023-06-16 Virendra J. Marathe , Pallika Kanani , Daniel W. Peterson , Guy Steele

We consider the privacy-preserving machine learning (ML) setting where the trained model must satisfy differential privacy (DP) with respect to the labels of the training examples. We propose two novel approaches based on, respectively, the…

Machine Learning · Computer Science 2021-11-02 Mani Malek , Ilya Mironov , Karthik Prasad , Igor Shilov , Florian Tramèr

We design a class of additive noise mechanisms that satisfy \((\varepsilon, \delta)\)-differential privacy (DP) for scalar, real-valued query functions with known sensitivities, with a particular focus on moderate and low-privacy regimes.…

Cryptography and Security · Computer Science 2026-05-28 Huikang Liu , Aras Selvi , Wolfram Wiesemann

Differential privacy (DP) auditing is essential for evaluating privacy guarantees in machine learning systems. Existing auditing methods, however, pose a significant challenge for large-scale systems since they require modifying the…

Machine Learning · Computer Science 2026-01-21 Iden Kalemaj , Luca Melis , Maxime Boucher , Ilya Mironov , Saeed Mahloujifar

In recent years, Fine-Grained Visual Classification (FGVC) has achieved impressive recognition accuracy, despite minimal inter-class variations. However, existing methods heavily rely on instance-level labels, making them impractical in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jinyi Chang , Dongliang Chang , Lei Chen , Bingyao Yu , Zhanyu Ma

The Randomized Response (RR) algorithm is a classical technique to improve robustness in survey aggregation, and has been widely adopted in applications with differential privacy guarantees. We propose a novel algorithm, Randomized Response…

Machine Learning · Computer Science 2021-10-28 Badih Ghazi , Noah Golowich , Ravi Kumar , Pasin Manurangsi , Chiyuan Zhang

Learning from label proportions (LLP), i.e., a challenging weakly-supervised learning task, aims to train a classifier by using bags of instances and the proportions of classes within bags, rather than annotated labels for each instance.…

Artificial Intelligence · Computer Science 2025-03-26 Tianhao Ma , Han Chen , Juncheng Hu , Yungang Zhu , Ximing Li

Federated Learning (FL) is a distributed machine learning approach that safeguards privacy by creating an impartial global model while respecting the privacy of individual client data. However, the conventional FL method can introduce…

Machine Learning · Computer Science 2025-10-09 Muhammad Irfan Khan , Esa Alhoniemi , Elina Kontio , Suleiman A. Khan , Mojtaba Jafaritadi

Nowadays, the ubiquitous usage of mobile devices and networks have raised concerns about the loss of control over personal data and research advance towards the trade-off between privacy and utility in scenarios that combine exchange…

The ubiquity of camera-enabled devices has led to large amounts of unlabeled image data being produced at the edge. The integration of self-supervised learning (SSL) and federated learning (FL) into one coherent system can potentially offer…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Yasar Abbas Ur Rehman , Yan Gao , Pedro Porto Buarque de Gusmão , Mina Alibeigi , Jiajun Shen , Nicholas D. Lane

Differential Privacy (DP) is a key property to protect data and models from integrity attacks. In the Deep Learning (DL) field, it is commonly implemented through the Differentially Private Stochastic Gradient Descent (DP-SGD). However,…

Machine Learning · Computer Science 2023-11-21 Jiménez-López , Daniel , Rodríguez-Barroso , Nuria , Luzón , M. Victoria , Herrera , Francisco

Local differential privacy (LDP) is a strong privacy standard that has been adopted by popular software systems. The main idea is that each individual perturbs their own data locally, and only submits the resulting noisy version to a data…

Cryptography and Security · Computer Science 2024-04-04 Fei Wei , Ergute Bao , Xiaokui Xiao , Yin Yang , Bolin Ding

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert