English
Related papers

Related papers: Private and Robust Distributed Nonconvex Optimizat…

200 papers

As the modern world becomes increasingly digitized and interconnected, distributed signal processing has proven to be effective in processing its large volume of data. However, a main challenge limiting the broad use of distributed signal…

Signal Processing · Electrical Eng. & Systems 2020-10-23 Qiongxiu Li , Richard Heusdens , Mads Græsbøll Christensen

With decentralized optimization having increased applications in various domains ranging from machine learning, control, sensor networks, to robotics, its privacy is also receiving increased attention. Existing privacy-preserving approaches…

Optimization and Control · Mathematics 2022-07-13 Huan Gao , Yongqiang Wang , Angelia Nedić

We consider a resource allocation problem involving a large number of agents with individual constraints subject to privacy, and a central operator whose objective is to optimize a global, possibly nonconvex, cost while satisfying the…

Optimization and Control · Mathematics 2020-06-24 Olivier Beaude , Pascal Benchimol , Stéphane Gaubert , Paulin Jacquot , Nadia Oudjane

We consider the problem of differentially private stochastic convex optimization (DP-SCO) in a distributed setting with $M$ clients, where each of them has a local dataset of $N$ i.i.d. data samples from an underlying data distribution. The…

Machine Learning · Computer Science 2025-01-07 Sudeep Salgia , Nikola Pavlovic , Yuejie Chi , Qing Zhao

Many commonly used learning algorithms work by iteratively updating an intermediate solution using one or a few data points in each iteration. Analysis of differential privacy for such algorithms often involves ensuring privacy of each step…

Machine Learning · Computer Science 2018-12-12 Vitaly Feldman , Ilya Mironov , Kunal Talwar , Abhradeep Thakurta

Existing large-scale optimization schemes are challenged by both scalability and cyber-security. With the favorable scalability, adaptability, and flexibility, decentralized and distributed optimization paradigms are widely adopted in…

Optimization and Control · Mathematics 2020-12-23 Xiang Huo , Mingxi Liu

In distributed networks, calculating the maximum element is a fundamental task in data analysis, known as the distributed maximum consensus problem. However, the sensitive nature of the data involved makes privacy protection essential.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Wenrui Yu , Richard Heusdens , Jun Pang , Qiongxiu Li

Motivated by the pervasive lack of privacy protection in existing distributed nonconvex optimization methods, this paper proposes a decentralized proximal primal-dual algorithm enabling double protection of privacy ($\text{DPP}^2$) for…

Optimization and Control · Mathematics 2025-11-05 Zichong Ou , Dandan Wang , Zixuan Liu , Jie Lu

Real-time data-driven optimization and control problems over networks may require sensitive information of participating users to calculate solutions and decision variables, such as in traffic or energy systems. Adversaries with access to…

Optimization and Control · Mathematics 2020-05-25 Roel Dobbe , Ye Pu , Jingge Zhu , Kannan Ramchandran , Claire Tomlin

In this paper, we investigate the problem of differentially private distributed optimization. Recognizing that lower sensitivity leads to higher accuracy, we analyze the key factors influencing the sensitivity of differentially private…

Optimization and Control · Mathematics 2026-01-05 Furan Xie , Bing Liu , Li Chai

We introduce a new zeroth-order algorithm for private stochastic optimization on nonconvex and nonsmooth objectives. Given a dataset of size $M$, our algorithm ensures $(\alpha,\alpha\rho^2/2)$-R\'enyi differential privacy and finds a…

Optimization and Control · Mathematics 2024-07-01 Qinzi Zhang , Hoang Tran , Ashok Cutkosky

Privacy-preserving distributed processing has received considerable attention recently. The main purpose of these algorithms is to solve certain signal processing tasks over a network in a decentralised fashion without revealing…

Signal Processing · Electrical Eng. & Systems 2023-12-14 Sebastian O. Jordan , Qiongxiu Li , Richard Heusdens

Decentralized min-max optimization allows multi-agent systems to collaboratively solve global min-max optimization problems by facilitating the exchange of model updates among neighboring agents, eliminating the need for a central server.…

Machine Learning · Computer Science 2025-08-12 Yueyang Quan , Chang Wang , Shengjie Zhai , Minghong Fang , Zhuqing Liu

We consider a distributed optimal power flow formulated as an optimization problem that maximizes a nondifferentiable concave function. Solving such a problem by the existing distributed algorithms can lead to data privacy issues because…

Optimization and Control · Mathematics 2021-10-13 Minseok Ryu , Kibaek Kim

By enabling multiple agents to cooperatively solve a global optimization problem in the absence of a central coordinator, decentralized stochastic optimization is gaining increasing attention in areas as diverse as machine learning,…

Optimization and Control · Mathematics 2022-08-10 Yongqiang Wang , Tamer Basar

Privacy-preserving distributed processing has recently attracted considerable attention. It aims to design solutions for conducting signal processing tasks over networks in a decentralized fashion without violating privacy. Many algorithms…

Cryptography and Security · Computer Science 2020-09-03 Qiongxiu Li , Jaron Skovsted Gundersen , Richard Heusdens , Mads Græsbøll Christensen

Distributed stochastic optimization enables multi-agent collaboration in applications such as distributed learning and sensor networks, but also raises critical privacy concerns due to the involvement of sensitive data. While existing…

Systems and Control · Electrical Eng. & Systems 2026-04-24 Haoqiang Zhou , Chi Chen , Yongfeng Zhi , Huan Gao

Distributed optimization and learning has recently garnered great attention due to its wide applications in sensor networks, smart grids, machine learning, and so forth. Despite rapid development, existing distributed optimization and…

Machine Learning · Computer Science 2024-03-04 Ziqin Chen , Yongqiang Wang

Network routing problems are common across many engineering applications. Computing optimal routing policies requires knowledge about network demand, i.e., the origin and destination (OD) of all requests in the network. However, privacy…

Systems and Control · Electrical Eng. & Systems 2022-10-27 Matthew Tsao , Karthik Gopalakrishnan , Kaidi Yang , Marco Pavone

In this paper, we address the problem of secure distributed computation in scenarios where user data is not uniformly distributed, extending existing frameworks that assume uniformity, an assumption that is challenging to enforce in data…

Information Theory · Computer Science 2025-01-28 Saar Tarnopolsky , Zirui , Deng , Vinayak Ramkumar , Netanel Raviv , Alejandro Cohen