English
Related papers

Related papers: A Weighted Gradient Tracking Privacy-Preserving Me…

200 papers

Distributed online stochastic optimization has received extensive attention in large-scale distributed learning and other related fields due to its unique advantage in processing streaming data. However, information exchange through the…

Optimization and Control · Mathematics 2026-05-29 Zhiguo Zhang , Cheng Kui , Qian Ma , Dongrui Wu

We study the problem of differentially private optimization with linear constraints when the right-hand-side of the constraints depends on private data. This type of problem appears in many applications, especially resource allocation.…

Machine Learning · Computer Science 2020-11-05 Andrés Muñoz Medina , Umar Syed , Sergei Vassilvitskii , Ellen Vitercik

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

The blooming of social media and face recognition (FR) systems has increased people's concern about privacy and security. A new type of adversarial privacy cloak (class-universal) can be applied to all the images of regular users, to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Xuannan Liu , Yaoyao Zhong , Weihong Deng , Hongzhi Shi , Xingchen Cui , Yunfeng Yin , Dongchao Wen

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

This paper considers distributed optimization (DO) where multiple agents cooperate to minimize a global objective function, expressed as a sum of local objectives, subject to some constraints. In DO, each agent iteratively solves a local…

Optimization and Control · Mathematics 2023-03-01 Minseok Ryu , Kibaek Kim

Differential privacy enables organizations to collect accurate aggregates over sensitive data with strong, rigorous guarantees on individuals' privacy. Previous work has found that under differential privacy, computing multiple correlated…

Databases · Computer Science 2016-05-18 Ganzhao Yuan , Yin Yang , Zhenjie Zhang , Zhifeng Hao

Federated learning (FL) emerged as a paradigm designed to improve data privacy by enabling data to reside at its source, thus embedding privacy as a core consideration in FL architectures, whether centralized or decentralized. Contrasting…

Machine Learning · Computer Science 2024-12-03 Wenrui Yu , Qiongxiu Li , Milan Lopuhaä-Zwakenberg , Mads Græsbøll Christensen , Richard Heusdens

Model stealing attacks present a dilemma for public machine learning APIs. To protect financial investments, companies may be forced to withhold important information about their models that could facilitate theft, including uncertainty…

Machine Learning · Computer Science 2022-06-29 Mantas Mazeika , Bo Li , David Forsyth

Distributed algorithms can be efficiently used for solving economic dispatch problem (EDP) in power systems. To implement a distributed algorithm, a communication network is required, making the algorithm vulnerable to noise which may cause…

Systems and Control · Electrical Eng. & Systems 2021-11-18 Wenwen Wu , Shuai Liu , Shanying Zhu

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. This imperfect communication poses a fundamental…

Optimization and Control · Mathematics 2018-10-30 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

In this work, we introduce a novel framework for privately optimizing objectives that rely on Wasserstein distances between data-dependent empirical measures. Our main theoretical contribution is, based on an explicit formulation of the…

Machine Learning · Computer Science 2025-05-22 David Rodríguez-Vítores , Clément Lalanne , Jean-Michel Loubes

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Asynchronous computation and gradient compression have emerged as two key techniques for achieving scalability in distributed optimization for large-scale machine learning. This paper presents a unified analysis framework for distributed…

Optimization and Control · Mathematics 2018-11-30 Sarit Khirirat , Hamid Reza Feyzmahdavian , Mikael Johansson

The interplay between optimization and privacy has become a central theme in privacy-preserving machine learning. Noisy stochastic gradient descent (SGD) has emerged as a cornerstone algorithm, particularly in large-scale settings. These…

Machine Learning · Computer Science 2025-10-21 Shurong Lin , Eric D. Kolaczyk , Adam Smith , Elliot Paquette

Cooperative control is crucial for the effective operation of dynamical multi-agent systems. Especially for distributed control schemes, it is essential to exchange data between the agents. This becomes a privacy threat if the data is…

Systems and Control · Electrical Eng. & Systems 2024-12-19 Philipp Binfet , Janis Adamek , Nils Schlüter , Moritz Schulze Darup

As machine learning becomes more widespread throughout society, aspects including data privacy and fairness must be carefully considered, and are crucial for deployment in highly regulated industries. Unfortunately, the application of…

Machine Learning · Computer Science 2023-02-24 Maria S. Esipova , Atiyeh Ashari Ghomi , Yaqiao Luo , Jesse C. Cresswell

Federated learning is a distributed learning method to train a shared model by aggregating the locally-computed gradient updates. In federated learning, bandwidth and privacy are two main concerns of gradient updates transmission. This…

Machine Learning · Computer Science 2019-08-23 Hongyu Li , Tianqi Han

This paper considers privacy-concerned distributed constraint-coupled resource allocation problems over an undirected network, where each agent holds a private cost function and obtains the solution via only local communication. With…

Optimization and Control · Mathematics 2025-06-05 Wenwen Wu , Shanying Zhu , Shuai Liu , Xinping Guan

Recently, due to the popularity of deep neural networks and other methods whose training typically relies on the optimization of an objective function, and due to concerns for data privacy, there is a lot of interest in differentially…

Machine Learning · Computer Science 2025-02-12 Antoine Barczewski , Jan Ramon