English
Related papers

Related papers: Private Model Personalization Revisited

200 papers

This paper develops a networked federated learning algorithm to solve nonsmooth objective functions. To guarantee the confidentiality of the participants with respect to each other and potential eavesdroppers, we use the zero-concentrated…

Optimization and Control · Mathematics 2024-02-22 François Gauthier , Cristiano Gratton , Naveen K. D. Venkategowda , Stefan Werner

This work studies the distributed empirical risk minimization (ERM) problem under differential privacy (DP) constraint. Standard distributed algorithms achieve DP typically by perturbing all local subgradients with noise, leading to…

Optimization and Control · Mathematics 2023-07-04 Changxin Liu , Karl H. Johansson , Yang Shi

Many existing privacy-enhanced speech emotion recognition (SER) frameworks focus on perturbing the original speech data through adversarial training within a centralized machine learning setup. However, this privacy protection scheme can…

Cryptography and Security · Computer Science 2023-04-18 Tiantian Feng , Raghuveer Peri , Shrikanth Narayanan

In the era of big data, the need to expand the amount of data through data sharing to improve model performance has become increasingly compelling. As a result, effective collaborative learning models need to be developed with respect to…

Machine Learning · Computer Science 2020-11-17 Huiwen Wu , Cen Chen , Li Wang

User-level differential privacy (DP) provides certifiable privacy guarantees to the information that is specific to any user's data in federated learning. Existing methods that ensure user-level DP come at the cost of severe accuracy…

Machine Learning · Computer Science 2022-03-22 Anda Cheng , Peisong Wang , Xi Sheryl Zhang , Jian Cheng

Differential Privacy (DP) provides a rigorous framework for releasing statistics while protecting individual information present in a dataset. Although substantial progress has been made on differentially private linear regression, existing…

Statistics Theory · Mathematics 2026-01-16 Getoar Sopa , Marco Avella Medina , Cynthia Rush

Federated Learning allows distributed entities to train a common model collaboratively without sharing their own data. Although it prevents data collection and aggregation by exchanging only parameter updates, it remains vulnerable to…

Machine Learning · Computer Science 2020-11-12 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

Conventional federated learning directly averages model weights, which is only possible for collaboration between models with homogeneous architectures. Sharing prediction instead of weight removes this obstacle and eliminates the risk of…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Lingjuan Lyu

With the advent of the era of big data, deep learning has become a prevalent building block in a variety of machine learning or data mining tasks, such as signal processing, network modeling and traffic analysis, to name a few. The massive…

Cryptography and Security · Computer Science 2019-12-20 Zhiying Xu , Shuyu Shi , Alex X. Liu , Jun Zhao , Lin Chen

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

Machine Learning · Computer Science 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

In this paper, we propose a method for privacy-preserving federated learning that uses randomly selected model parameters to update global models. High-quality deep neural networks (DNN) models require a huge amount of training data in…

Cryptography and Security · Computer Science 2026-05-05 Hiroto Sawada , Shoko Imaizumi , Hitoshi Kiya

We propose a novel federated learning paradigm to model data variability among heterogeneous clients in multi-centric studies. Our method is expressed through a hierarchical Bayesian latent variable model, where client-specific parameters…

Machine Learning · Computer Science 2023-06-29 Irene Balelli , Santiago Silva , Marco Lorenzi

Federated learning (FL) enables organizations to collaboratively train models without sharing their datasets. Despite this advantage, recent studies show that both client updates and the global model can leak private information, limiting…

Cryptography and Security · Computer Science 2025-10-16 Rouzbeh Behnia , Jeremiah Birrell , Arman Riasi , Reza Ebrahimi , Kaushik Dutta , Thang Hoang

Label differential privacy (DP) is designed for learning problems involving private labels and public features. While various methods have been proposed for learning under label DP, the theoretical limits remain largely unexplored. In this…

Machine Learning · Computer Science 2025-03-04 Puning Zhao , Chuan Ma , Li Shen , Shaowei Wang , Rongfei Fan

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Federated learning is distributed model training across several clients without disclosing raw data. Despite advancements in data privacy, risks still remain. Differential Privacy (DP) is a technique to protect sensitive data by adding…

Machine Learning · Computer Science 2025-10-14 Tejash Varsani

We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise…

Machine Learning · Computer Science 2025-01-10 Jiaojiao Zhang , Linglingzhi Zhu , Mikael Johansson

Graph Neural Networks have achieved tremendous success in modeling complex graph data in a variety of applications. However, there are limited studies investigating privacy protection in GNNs. In this work, we propose a learning framework…

Machine Learning · Computer Science 2024-08-07 Karuna Bhaila , Wen Huang , Yongkai Wu , Xintao Wu

Most deep learning frameworks require users to pool their local data or model updates to a trusted server to train or maintain a global model. The assumption of a trusted server who has access to user information is ill-suited in many…

Machine Learning · Computer Science 2020-06-26 Lingjuan Lyu , Yitong Li , Xuanli He , Tong Xiao

We revisit the problem of linear regression under a differential privacy constraint. By consolidating existing pieces in the literature, we clarify the correct dependence of the feature, label and coefficient domains in the optimization…

Machine Learning · Statistics 2018-07-10 Yu-Xiang Wang