English
Related papers

Related papers: Distributed, communication-efficient, and differen…

200 papers

Differential Privacy (DP) is an important privacy-enhancing technology for private machine learning systems. It allows to measure and bound the risk associated with an individual participation in a computation. However, it was recently…

Machine Learning · Computer Science 2022-09-09 Cuong Tran , My H. Dinh , Ferdinando Fioretto

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim of learning a single…

Machine Learning · Computer Science 2023-04-20 Mikko A. Heikkilä , Matthew Ashman , Siddharth Swaroop , Richard E. Turner , Antti Honkela

We design a scalable algorithm to privately generate location heatmaps over decentralized data from millions of user devices. It aims to ensure differential privacy before data becomes visible to a service provider while maintaining high…

Cryptography and Security · Computer Science 2022-06-28 Eugene Bagdasaryan , Peter Kairouz , Stefan Mellem , Adrià Gascón , Kallista Bonawitz , Deborah Estrin , Marco Gruteser

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

The change-point detection problem seeks to identify distributional changes in streams of data. Increasingly, tools for change-point detection are applied in settings where data may be highly sensitive and formal privacy guarantees are…

Statistics Theory · Mathematics 2020-10-21 Rachel Cummings , Sara Krehbiel , Yuliia Lut , Wanrong Zhang

Cooperative decentralized learning relies on direct information exchange between communicating agents, each with access to locally available datasets. The goal is to agree on model parameters that are optimal over all data. However, sharing…

Machine Learning · Computer Science 2024-10-28 Jasmine Bayrooti , Zhan Gao , Amanda Prorok

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

Machine Learning · Computer Science 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

In the traditional distributed machine learning scenario, the user's private data is transmitted between clients and a central server, which results in significant potential privacy risks. In order to balance the issues of data privacy and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zihao Zhao , Yuzhu Mao , Yang Liu , Linqi Song , Ye Ouyang , Xinlei Chen , Wenbo Ding

Differential privacy is a restriction on data processing algorithms that provides strong confidentiality guarantees for individual records in the data. However, research on proper statistical inference, that is, research on properly…

Cryptography and Security · Computer Science 2021-07-06 Joerg Drechsler , Ira Globus-Harris , Audra McMillan , Jayshree Sarathy , Adam Smith

The utilisation of large and diverse datasets for machine learning (ML) at scale is required to promote scientific insight into many meaningful problems. However, due to data governance regulations such as GDPR as well as ethical concerns,…

Machine Learning · Computer Science 2021-12-22 Dmitrii Usynin , Alexander Ziller , Daniel Rueckert , Jonathan Passerat-Palmbach , Georgios Kaissis

We study discrete distribution estimation under user-level local differential privacy (LDP). In user-level $\varepsilon$-LDP, each user has $m\ge1$ samples and the privacy of all $m$ samples must be preserved simultaneously. We resolve the…

Machine Learning · Computer Science 2022-11-08 Jayadev Acharya , Yuhan Liu , Ziteng Sun

This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yunhai Han , Sonia Martínez

Creation of a synthetic dataset that faithfully represents the data distribution and simultaneously preserves privacy is a major research challenge. Many space partitioning based approaches have emerged in recent years for answering…

Cryptography and Security · Computer Science 2023-06-26 Eleonora Kreačić , Navid Nouri , Vamsi K. Potluru , Tucker Balch , Manuela Veloso

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

Privacy and communication constraints are two major bottlenecks in federated learning (FL) and analytics (FA). We study the optimal accuracy of mean and frequency estimation (canonical models for FL and FA respectively) under joint…

Machine Learning · Statistics 2023-04-05 Wei-Ning Chen , Dan Song , Ayfer Ozgur , Peter Kairouz

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

Economics and social science research often require analyzing datasets of sensitive personal information at fine granularity, with models fit to small subsets of the data. Unfortunately, such fine-grained analysis can easily reveal…

Machine Learning · Computer Science 2020-07-13 Daniel Alabi , Audra McMillan , Jayshree Sarathy , Adam Smith , Salil Vadhan

We consider a distributed empirical risk minimization (ERM) optimization problem with communication efficiency and privacy requirements, motivated by the federated learning (FL) framework. Unique challenges to the traditional ERM problem in…

Machine Learning · Computer Science 2020-09-24 Antonious M. Girgis , Deepesh Data , Suhas Diggavi , Peter Kairouz , Ananda Theertha Suresh

The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversarial behaviors. Although privacy and robustness have been…

Machine Learning · Computer Science 2023-05-30 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman