English
Related papers

Related papers: Improved Differential Privacy for SGD via Optimal …

200 papers

Federated learning (FL) aims to collaboratively train the global model in a distributed manner by sharing the model parameters from local clients to a central server, thereby potentially protecting users' private information. Nevertheless,…

Machine Learning · Computer Science 2023-02-17 Zhe Li , Honglong Chen , Zhichen Ni , Huajie Shao

Alternating Direction Method of Multipliers (ADMM) is a widely used tool for machine learning in distributed settings, where a machine learning model is trained over distributed data sources through an interactive process of local…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Rui Hu , Yuanxiong Guo , Eric Chan-Tin , Yanmin Gong

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

We introduce the technique of adaptive discretization to design an efficient model-based episodic reinforcement learning algorithm in large (potentially continuous) state-action spaces. Our algorithm is based on optimistic one-step value…

Machine Learning · Computer Science 2020-10-26 Sean R. Sinclair , Tianyu Wang , Gauri Jain , Siddhartha Banerjee , Christina Lee Yu

An open problem in differentially private deep learning is hyperparameter optimization (HPO). DP-SGD introduces new hyperparameters and complicates existing ones, forcing researchers to painstakingly tune hyperparameters with hundreds of…

Machine Learning · Computer Science 2024-05-07 Ashwinee Panda , Xinyu Tang , Saeed Mahloujifar , Vikash Sehwag , Prateek Mittal

In many applications, the labeled data at the learner's disposal is subject to privacy constraints and is relatively limited. To derive a more accurate predictor for the target domain, it is often beneficial to leverage publicly available…

Machine Learning · Computer Science 2024-02-06 Raef Bassily , Corinna Cortes , Anqi Mao , Mehryar Mohri

The Alternating Direction Method of Multipliers (ADMM) and its distributed version have been widely used in machine learning. In the iterations of ADMM, model updates using local private data and model exchanges among agents impose critical…

Machine Learning · Computer Science 2020-08-12 Jiahao Ding , Jingyi Wang , Guannan Liang , Jinbo Bi , Miao Pan

Existing approaches for training neural networks with user-level differential privacy (e.g., DP Federated Averaging) in federated learning (FL) settings involve bounding the contribution of each user's model update by clipping it to some…

Machine Learning · Computer Science 2022-05-11 Galen Andrew , Om Thakkar , H. Brendan McMahan , Swaroop Ramaswamy

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai

Local Differential Privacy (LDP) enables massive data collection and analysis while protecting end users' privacy against untrusted aggregators. It has been applied to various data types (e.g., categorical, numerical, and graph data) and…

Cryptography and Security · Computer Science 2025-05-05 Xinyu Li , Xuebin Ren , Shusen Yang , Liang Shi , Chia-Mu Yu

Differential privacy is a recently proposed notion of privacy that provides strong privacy guarantees without any assumptions on the adversary. The paper studies the problem of computing a differentially private solution to convex…

Optimization and Control · Mathematics 2014-03-26 Shuo Han , Ufuk Topcu , George J. Pappas

Federated learning (FL) allows clients to collaboratively train a global model without sharing their local data with a server. However, clients' contributions to the server can still leak sensitive information. Differential privacy (DP)…

Machine Learning · Computer Science 2025-02-18 Jie Xu , Karthikeyan Saravanan , Rogier van Dalen , Haaris Mehmood , David Tuckey , Mete Ozay

This paper proposes a locally differentially private federated learning algorithm for strongly convex but possibly nonsmooth problems that protects the gradients of each worker against an honest but curious server. The proposed algorithm…

Machine Learning · Computer Science 2023-08-03 Jiaojiao Zhang , Dominik Fay , Mikael Johansson

We present a framework for designing differentially private (DP) mechanisms for binary functions via a graph representation of datasets. Datasets are nodes in the graph and any two neighboring datasets are connected by an edge. The true…

Information Theory · Computer Science 2021-02-11 Rafael G. L. D'Oliveira , Muriel Medard , Parastoo Sadeghi

Machine learning methods allow us to make recommendations to users in applications across fields including entertainment, dating, and commerce, by exploiting similarities in users' interaction patterns. However, in domains that demand…

Information Retrieval · Computer Science 2020-03-03 Mónica Ribero , Jette Henderson , Sinead Williamson , Haris Vikalo

Privacy preserving machine learning algorithms are crucial for learning models over user data to protect sensitive information. Motivated by this, differentially private stochastic gradient descent (SGD) algorithms for training machine…

Machine Learning · Computer Science 2019-10-25 Venkatadheeraj Pichapati , Ananda Theertha Suresh , Felix X. Yu , Sashank J. Reddi , Sanjiv Kumar

This paper considers subject level privacy in the FL setting, where a subject is an individual whose private information is embodied by several data items either confined within a single federation user or distributed across multiple…

Machine Learning · Computer Science 2023-06-16 Virendra J. Marathe , Pallika Kanani , Daniel W. Peterson , Guy Steele

Machine learning practitioners frequently seek to leverage the most informative available data, without violating the data owner's privacy, when building predictive models. Differentially private data synthesis protects personal details…

Machine Learning · Computer Science 2020-11-12 Lucas Rosenblatt , Xiaoyan Liu , Samira Pouyanfar , Eduardo de Leon , Anuj Desai , Joshua Allen

We develop an iterative differentially private algorithm for client selection in federated settings. We consider a federated network wherein clients coordinate with a central server to complete a task; however, the clients decide whether to…

Cryptography and Security · Computer Science 2023-10-17 Syed Eqbal Alam , Dhirendra Shukla , Shrisha Rao

Federated Learning (FL) is a distributed machine learning technique that allows model training among multiple devices or organizations by sharing training parameters instead of raw data. However, adversaries can still infer individual…

Machine Learning · Computer Science 2024-05-27 Xinpeng Ling , Jie Fu , Kuncan Wang , Haitao Liu , Zhili Chen