English
Related papers

Related papers: Shuffle Private Stochastic Convex Optimization

200 papers

The shuffle model of differential privacy (DP) offers compelling privacy-utility trade-offs in decentralized settings (e.g., internet of things, mobile edge networks). Particularly, the multi-message shuffle model, where each user may…

Cryptography and Security · Computer Science 2024-12-31 Shaowei Wang , Hongqiao Chen , Sufen Zeng , Ruilin Yang , Hui Jiang , Peigen Ye , Kaiqi Yu , Rundong Mei , Shaozheng Huang , Wei Yang , Bangzhou Xin

The shuffle model of local differential privacy is an advanced method of privacy amplification designed to enhance privacy protection with high utility. It achieves this by randomly shuffling sensitive data, making linking individual data…

Cryptography and Security · Computer Science 2024-03-04 E Chen , Yang Cao , Yifei Ge

Recent work of Erlingsson, Feldman, Mironov, Raghunathan, Talwar, and Thakurta [EFMRTT19] demonstrates that random shuffling amplifies differential privacy guarantees of locally randomized data. Such amplification implies substantially…

Machine Learning · Computer Science 2021-09-09 Vitaly Feldman , Audra McMillan , Kunal Talwar

In this paper, we revisit the problem of private stochastic convex optimization. We propose an algorithm based on noisy mirror descent, which achieves optimal rates both in terms of statistical complexity and number of queries to a…

Machine Learning · Computer Science 2020-11-18 Raman Arora , Teodor V. Marinov , Enayat Ullah

The *shuffle model* is a powerful tool to amplify the privacy guarantees of the *local model* of differential privacy. In contrast to the fully decentralized manner of guaranteeing privacy in the local model, the shuffle model requires a…

Cryptography and Security · Computer Science 2022-06-22 Hao Wu , Olga Ohrimenko , Anthony Wirth

Differentially private mechanisms achieving worst-case optimal error bounds (e.g., the classical Laplace mechanism) are well-studied in the literature. However, when typical data are far from the worst case, \emph{instance-specific} error…

Cryptography and Security · Computer Science 2024-09-02 Wei Dong , Qiyao Luo , Giulia Fanti , Elaine Shi , Ke Yi

Privacy protection and nonconvexity are two challenging problems in decentralized optimization and learning involving sensitive data. Despite some recent advances addressing each of the two problems separately, no results have been reported…

Optimization and Control · Mathematics 2022-12-16 Yongqiang Wang , Tamer Basar

We study the setup where each of $n$ users holds an element from a discrete set, and the goal is to count the number of distinct elements across all users, under the constraint of $(\epsilon, \delta)$-differentially privacy: - In the…

Cryptography and Security · Computer Science 2020-09-22 Lijie Chen , Badih Ghazi , Ravi Kumar , Pasin Manurangsi

This paper explores distributed aggregative games in multi-agent systems. Current methods for finding distributed Nash equilibrium require players to send original messages to their neighbors, leading to communication burden and privacy…

Systems and Control · Electrical Eng. & Systems 2024-05-07 Wei Huo , Xiaomeng Chen , Kemi Ding , Subhrakanti Dey , Ling Shi

Decentralized stochastic optimization is the basic building block of modern collaborative machine learning, distributed estimation and control, and large-scale sensing. Since involved data usually contain sensitive information like user…

Machine Learning · Computer Science 2022-05-10 Yongqiang Wang , H. Vincent Poor

We study private stochastic convex optimization (SCO) under user-level differential privacy (DP) constraints. In this setting, there are $n$ users (e.g., cell phones), each possessing $m$ data items (e.g., text messages), and we need to…

Machine Learning · Computer Science 2024-10-25 Andrew Lowy , Daogao Liu , Hilal Asi

In data-driven applications, preserving user privacy while enabling valuable computations remains a critical challenge. Technologies like differential privacy have been pivotal in addressing these concerns. The shuffle model of DP requires…

Cryptography and Security · Computer Science 2025-04-15 Shaowei Wang , Changyu Dong , Xiangfu Song , Jin Li , Zhili Zhou , Di Wang , Han Wu

The shuffle model of DP (Differential Privacy) provides high utility by introducing a shuffler that randomly shuffles noisy data sent from users. However, recent studies show that existing shuffle protocols suffer from the following two…

Cryptography and Security · Computer Science 2025-04-11 Takao Murakami , Yuichi Sei , Reo Eriguchi

Network routing problems are common across many engineering applications. Computing optimal routing policies requires knowledge about network demand, i.e., the origin and destination (OD) of all requests in the network. However, privacy…

Systems and Control · Electrical Eng. & Systems 2022-10-27 Matthew Tsao , Karthik Gopalakrishnan , Kaidi Yang , Marco Pavone

Shuffle model of differential privacy is a novel distributed privacy model based on a combination of local privacy mechanisms and a secure shuffler. It has been shown that the additional randomisation provided by the shuffler improves…

Cryptography and Security · Computer Science 2022-02-02 Antti Koskela , Mikko A. Heikkilä , Antti Honkela

This paper considers distributed optimization (DO) where multiple agents cooperate to minimize a global objective function, expressed as a sum of local objectives, subject to some constraints. In DO, each agent iteratively solves a local…

Optimization and Control · Mathematics 2023-03-01 Minseok Ryu , Kibaek Kim

Differential privacy enables organizations to collect accurate aggregates over sensitive data with strong, rigorous guarantees on individuals' privacy. Previous work has found that under differential privacy, computing multiple correlated…

Databases · Computer Science 2016-05-18 Ganzhao Yuan , Yin Yang , Zhenjie Zhang , Zhifeng Hao

Local differential privacy (LDP) is a model where users send privatized data to an untrusted central server whose goal it to solve some data analysis task. In the non-interactive version of this model the protocol consists of a single round…

Machine Learning · Computer Science 2020-09-24 Yuval Dagan , Vitaly Feldman

Convex optimization with feedback is a framework where a learner relies on iterative queries and feedback to arrive at the minimizer of a convex function. It has gained considerable popularity thanks to its scalability in large-scale…

Machine Learning · Statistics 2021-10-26 Jiaming Xu , Kuang Xu , Dana Yang

We study differentially private (DP) algorithms for stochastic convex optimization: the problem of minimizing the population loss given i.i.d. samples from a distribution over convex loss functions. A recent work of Bassily et al. (2019)…

Machine Learning · Computer Science 2020-05-12 Vitaly Feldman , Tomer Koren , Kunal Talwar