English
Related papers

Related papers: Distributed Online Private Learning of Convex Nond…

200 papers

Many resource allocation problems can be formulated as an optimization problem whose constraints contain sensitive information about participating users. This paper concerns solving this kind of optimization problem in a distributed manner…

Optimization and Control · Mathematics 2016-11-17 Shuo Han , Ufuk Topcu , George J. Pappas

Privacy protection and nonconvexity are two challenging problems in decentralized optimization and learning involving sensitive data. Despite some recent advances addressing each of the two problems separately, no results have been reported…

Optimization and Control · Mathematics 2022-12-16 Yongqiang Wang , Tamer Basar

In this paper, we develop a distributed algorithm for solving a class of distributed convex optimization problems where the local objective functions can be a general nonsmooth function, and all equalities and inequalities are network-wide…

Optimization and Control · Mathematics 2026-04-14 Yeong-Ung Kim , Hyo-Sung Ahn

This paper studies distributed online convex optimization with time-varying coupled constraints, motivated by distributed online control in network systems. Most prior work assumes a separability condition: the global objective and coupled…

Optimization and Control · Mathematics 2026-02-18 Zhaoye Pan , Haozhe Lei , Fan Zuo , Zilin Bian , Tao Li

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

Network routing problems are common across many engineering applications. Computing optimal routing policies requires knowledge about network demand, i.e., the origin and destination (OD) of all requests in the network. However, privacy…

Systems and Control · Electrical Eng. & Systems 2022-10-27 Matthew Tsao , Karthik Gopalakrishnan , Kaidi Yang , Marco Pavone

We present a distributed optimization algorithm for solving online personalized optimization problems over a network of computing and communicating nodes, each of which linked to a specific user. The local objective functions are assumed to…

Systems and Control · Electrical Eng. & Systems 2021-04-15 Ivano Notarnicola , Andrea Simonetto , Francesco Farina , Giuseppe Notarstefano

We study the problem of distributed zero-order optimization for a class of strongly convex functions. They are formed by the average of local objectives, associated to different nodes in a prescribed network of connections. We propose a…

Optimization and Control · Mathematics 2021-06-29 Arya Akhavan , Massimiliano Pontil , Alexandre B. Tsybakov

Distributed online convex optimization (D-OCO) is a powerful paradigm for modeling distributed scenarios with streaming data. However, the communication cost between local learners and the central server is substantial in large-scale…

Machine Learning · Computer Science 2026-04-13 Sifan Yang , Dan-Yue Li , Lijun Zhang

This paper proposes a differentially private gradient-tracking-based distributed stochastic optimization algorithm over directed graphs. In particular, privacy noises are incorporated into each agent's state and tracking variable to…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Jialong Chen , Jimin Wang , Ji-Feng Zhang

In this paper, we consider the problem of preserving privacy in the online learning setting. We study the problem in the online convex programming (OCP) framework---a popular online learning setting with several interesting theoretical and…

Machine Learning · Computer Science 2015-03-19 Prateek Jain , Pravesh Kothari , Abhradeep Thakurta

We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise…

Machine Learning · Computer Science 2025-01-10 Jiaojiao Zhang , Linglingzhi Zhu , Mikael Johansson

We propose a distributed algorithm, termed the Directed-Distributed Projected Subgradient (D-DPS), to solve a constrained optimization problem over a multi-agent network, where the goal of agents is to collectively minimize the sum of…

Optimization and Control · Mathematics 2016-08-30 Chenguang Xi , Usman A. Khan

This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Wei Huo , Xiaomeng Chen , Lingying Huang , Karl Henrik Johansson , Ling Shi

This paper considers a distributed multi-agent optimization problem, with the global objective consisting of the sum of local objective functions of the agents. The agents solve the optimization problem using local computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Shripad Gade , Nitin H. Vaidya

We consider distributed online convex optimization problems, where the distributed system consists of various computing units connected through a time-varying communication graph. In each time step, each computing unit selects a constrained…

Machine Learning · Computer Science 2019-12-23 Deming Yuan , Alexandre Proutiere , Guodong Shi

Distributed online learning has been proven extremely effective in solving large-scale machine learning problems over streaming data. However, information sharing between learners in distributed learning also raises concerns about the…

Machine Learning · Computer Science 2023-10-31 Ziqin Chen , Yongqiang Wang

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert

In this work, we first consider distributed convex constrained optimization problems where the objective function is encoded by multiple local and possibly nonsmooth objectives privately held by a group of agents, and propose a distributed…

Optimization and Control · Mathematics 2020-02-20 Changxin Liu , Huiping Li , Yang Shi

Distributed model predictive control (DMPC) has attracted extensive attention as it can explicitly handle system constraints and achieve optimal control in a decentralized manner. However, the deployment of DMPC strategies generally…

Systems and Control · Electrical Eng. & Systems 2025-11-21 Kaixiang Zhang , Yongqiang Wang , Ziyou Song , Zhaojian Li