English
Related papers

Related papers: Secure and Differentially Private Bayesian Learnin…

200 papers

This paper investigates the privacy-preserving distributed optimization problem, aiming to protect agents' private information from potential attackers during the optimization process. Gradient tracking, an advanced technique for improving…

Machine Learning · Computer Science 2025-09-24 Furan Xie , Bing Liu , Li Chai

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Distributed online learning has been proven extremely effective in solving large-scale machine learning problems over streaming data. However, information sharing between learners in distributed learning also raises concerns about the…

Machine Learning · Computer Science 2023-10-31 Ziqin Chen , Yongqiang Wang

Distributed learning systems have enabled training large-scale models over large amount of data in significantly shorter time. In this paper, we focus on decentralized distributed deep learning systems and aim to achieve differential…

Machine Learning · Computer Science 2018-11-28 Hsin-Pai Cheng , Patrick Yu , Haojing Hu , Feng Yan , Shiyu Li , Hai Li , Yiran Chen

The massive upsurge in computational and storage has driven the local data and machine learning applications to the cloud environment. The owners may not fully trust the cloud environment as it is managed by third parties. However,…

Cryptography and Security · Computer Science 2022-12-21 Rishabh Gupta , Ashutosh Kumar Singh

This paper proposes a data privacy protection framework based on federated learning, which aims to realize effective cross-domain data collaboration under the premise of ensuring data privacy through distributed learning. Federated learning…

Machine Learning · Computer Science 2025-04-02 Yiwei Zhang , Jie Liu , Jiawei Wang , Lu Dai , Fan Guo , Guohui Cai

We introduce the Poisson Binomial mechanism (PBM), a discrete differential privacy mechanism for distributed mean estimation (DME) with applications to federated learning and analytics. We provide a tight analysis of its privacy guarantees,…

Cryptography and Security · Computer Science 2022-07-21 Wei-Ning Chen , Ayfer Özgür , Peter Kairouz

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

We show that differentially private stochastic gradient descent (DP-SGD) can yield poorly calibrated, overconfident deep learning models. This represents a serious issue for safety-critical applications, e.g. in medical diagnosis. We…

In this paper, we apply machine learning to distributed private data owned by multiple data owners, entities with access to non-overlapping training datasets. We use noisy, differentially-private gradients to minimize the fitness cost of…

Cryptography and Security · Computer Science 2019-07-03 Nan Wu , Farhad Farokhi , David Smith , Mohamed Ali Kaafar

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

Machine Learning · Computer Science 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

Distributed online learning is gaining increased traction due to its unique ability to process large-scale datasets and streaming data. To address the growing public awareness and concern on privacy protection, plenty of algorithms have…

Machine Learning · Computer Science 2024-08-27 Ziqin Chen , Yongqiang Wang

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

While machine learning has achieved remarkable results in a wide variety of domains, the training of models often requires large datasets that may need to be collected from different individuals. As sensitive information may be contained in…

Machine Learning · Computer Science 2023-02-07 Richeng Jin , Xiaofan He , Huaiyu Dai

We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian inference on…

Artificial Intelligence · Computer Science 2015-12-23 Zuhe Zhang , Benjamin Rubinstein , Christos Dimitrakakis

Split learning is a distributed training framework that allows multiple parties to jointly train a machine learning model over vertically partitioned data (partitioned by attributes). The idea is that only intermediate computation results,…

Machine Learning · Computer Science 2022-03-07 Xin Yang , Jiankai Sun , Yuanshun Yao , Junyuan Xie , Chong Wang

Distributed machine learning is an approach allowing different parties to learn a model over all data sets without disclosing their own data. In this paper, we propose a weighted distributed differential privacy (WD-DP) empirical risk…

Machine Learning · Computer Science 2021-10-22 Yilin Kang , Yong Liu , Weiping Wang

With rise of machine learning (ML) and the proliferation of smart mobile devices, recent years have witnessed a surge of interest in performing ML in wireless edge networks. In this paper, we consider the problem of jointly improving data…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-31 Xin Zhang , Minghong Fang , Jia Liu , Zhengyuan Zhu

This paper introduces a privacy-aware Bayesian approach that combines ensembles of classifiers and clusterers to perform semi-supervised and transductive learning. We consider scenarios where instances and their classification/clustering…

Machine Learning · Computer Science 2012-04-23 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh

Large data collections required for the training of neural networks often contain sensitive information such as the medical histories of patients, and the privacy of the training data must be preserved. In this paper, we introduce a dropout…

Machine Learning · Statistics 2017-12-06 Beyza Ermis , Ali Taylan Cemgil