English
Related papers

Related papers: Differentially Private Distributed Online Learning

200 papers

Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors. Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make…

Machine Learning · Computer Science 2023-01-10 Zongshun Zhang , Andrea Pinto , Valeria Turina , Flavio Esposito , Ibrahim Matta

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

Due to statistical lower bounds on the learnability of many function classes under privacy constraints, there has been recent interest in leveraging public data to improve the performance of private learning algorithms. In this model,…

Machine Learning · Statistics 2024-02-16 Adam Block , Mark Bun , Rathin Desai , Abhishek Shetty , Steven Wu

With the rapid growth in multimedia services and the enormous offers of video contents in online social networks, users have difficulty in obtaining their interests. Therefore, various personalized recommendation systems have been proposed.…

Machine Learning · Computer Science 2016-02-02 Pan Zhou , Yingxue Zhou , Dapeng Wu , Hai Jin

We deal with a general distributed constrained online learning problem with privacy over time-varying networks, where a class of nondecomposable objectives are considered. Under this setting, each node only controls a part of the global…

Optimization and Control · Mathematics 2024-05-28 Huqiang Cheng , Xiaofeng Liao , Huaqing Li

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

Large amount of data is often required to train and deploy useful machine learning models in industry. Smaller enterprises do not have the luxury of accessing enough data for machine learning, For privacy sensitive fields such as banking,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-05 Felix Ongati , Eng. Lawrence Muchemi

Decentralized learning is an efficient emerging paradigm for boosting the computing capability of multiple bounded computing agents. In the big data era, performing inference within the distributed and federated learning (DL and FL)…

Multiagent Systems · Computer Science 2022-05-11 Mohamed Ridha Znaidi , Gaurav Gupta , Paul Bogdan

Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating…

Optimization and Control · Mathematics 2024-02-07 Yongqiang Wang , Angelia Nedic

We consider the critical problem of distributed learning over data while keeping it private from the computational servers. The state-of-the-art approaches to this problem rely on quantizing the data into a finite field, so that the…

Machine Learning · Computer Science 2020-07-20 Mahdi Soleymani , Hessam Mahdavifar , A. Salman Avestimehr

In this paper, we study a distributed privacy-preserving learning problem in social networks with general topology. The agents can communicate with each other over the network, which may result in privacy disclosure, since the…

Social and Information Networks · Computer Science 2023-01-30 Youming Tao , Shuzhen Chen , Feng Li , Dongxiao Yu , Jiguo Yu , Hao Sheng

Privacy-preserving distributed processing has recently attracted considerable attention. It aims to design solutions for conducting signal processing tasks over networks in a decentralized fashion without violating privacy. Many algorithms…

Cryptography and Security · Computer Science 2020-09-03 Qiongxiu Li , Jaron Skovsted Gundersen , Richard Heusdens , Mads Græsbøll Christensen

Decentralized Online Learning (online learning in decentralized networks) attracts more and more attention, since it is believed that Decentralized Online Learning can help the data providers cooperatively better solve their online problems…

Machine Learning · Computer Science 2019-05-30 Yawei Zhao , Chen Yu , Peilin Zhao , Hanlin Tang , Shuang Qiu , Ji Liu

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

With changes in privacy laws, there is often a hard requirement for client data to remain on the device rather than being sent to the server. Therefore, most processing happens on the device, and only an altered element is sent to the…

Cryptography and Security · Computer Science 2022-12-27 Ajinkya K Mulay

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

This paper proposes a locally differentially private federated learning algorithm for strongly convex but possibly nonsmooth problems that protects the gradients of each worker against an honest but curious server. The proposed algorithm…

Machine Learning · Computer Science 2023-08-03 Jiaojiao Zhang , Dominik Fay , Mikael Johansson

Privacy is crucial in many applications of machine learning. Legal, ethical and societal issues restrict the sharing of sensitive data making it difficult to learn from datasets that are partitioned between many parties. One important…

Machine Learning · Statistics 2018-09-21 Christina Heinze-Deml , Brian McWilliams , Nicolai Meinshausen

In distributed optimization and iterative consensus literature, a standard problem is for $N$ agents to minimize a function $f$ over a subset of Euclidean space, where the cost function is expressed as a sum $\sum f_i$. In this paper, we…

Cryptography and Security · Computer Science 2014-01-14 Zhenqi Huang , Sayan Mitra , Nitin Vaidya