English
Related papers

Related papers: Self-Healing First-Order Distributed Optimization …

200 papers

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan

In this paper we consider a general, challenging distributed optimization set-up arising in several important network control applications. Agents of a network want to minimize the sum of local cost functions, each one depending on a local…

Systems and Control · Computer Science 2018-06-15 Ivano Notarnicola , Giuseppe Notarstefano

In shuffle privacy, each user sends a collection of randomized messages to a trusted shuffler, the shuffler randomly permutes these messages, and the resulting shuffled collection of messages must satisfy differential privacy. Prior work in…

Machine Learning · Computer Science 2022-03-15 Albert Cheu , Matthew Joseph , Jieming Mao , Binghui Peng

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

We consider the problem of self-healing in networks that are reconfigurable in the sense that they can change their topology during an attack. Our goal is to maintain connectivity in these networks, even in the presence of repeated…

Data Structures and Algorithms · Computer Science 2016-11-17 Jared Saia , Amitabh Trehan

Bilevel optimization has been applied to a wide variety of machine learning models, and numerous stochastic bilevel optimization algorithms have been developed in recent years. However, most existing algorithms restrict their focus on the…

Machine Learning · Computer Science 2023-03-28 Hongchang Gao , Bin Gu , My T. Thai

Self-stabilization is a versatile methodology in the design of fault-tolerant distributed algorithms for transient faults. A self-stabilizing system automatically recovers from any kind and any finite number of transient faults. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-07 Hirotsugu Kakugawa , Sayaka Kamei , Masahiro Shibata , Fukuhito Ooshita

In this paper we deal with a network of computing agents with local processing and neighboring communication capabilities that aim at solving (without any central unit) a submodular optimization problem. The cost function is the sum of many…

Optimization and Control · Mathematics 2020-05-26 Andrea Testa , Francesco Farina , Giuseppe Notarstefano

Machine learning with big data often involves large optimization models. For distributed optimization over a cluster of machines, frequent communication and synchronization of all model parameters (optimization variables) can be very…

Optimization and Control · Mathematics 2017-10-17 Lin Xiao , Adams Wei Yu , Qihang Lin , Weizhu Chen

Many problems of interest for cyber-physical network systems can be formulated as Mixed-Integer Linear Programs in which the constraints are distributed among the agents. In this paper we propose a distributed algorithmic framework to solve…

Optimization and Control · Mathematics 2019-06-05 Andrea Testa , Alessandro Rucco , Giuseppe Notarstefano

Decentralized strategies are of interest for learning from large-scale data over networks. This paper studies learning over a network of geographically distributed nodes/agents subject to quantization. Each node possesses a private local…

Systems and Control · Electrical Eng. & Systems 2025-01-13 Mohammadreza Doostmohammadian , Muhammad I. Qureshi , Mohammad Hossein Khalesi , Hamid R. Rabiee , Usman A. Khan

This paper proposes a novel class of distributed continuous-time coordination algorithms to solve network optimization problems whose cost function is a sum of local cost functions associated to the individual agents. We establish the…

Optimization and Control · Mathematics 2014-08-25 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

This paper considers distributed optimization algorithms, with application in binary classification via distributed support-vector-machines (D-SVM) over multi-agent networks subject to some link nonlinearities. The agents solve a…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Mohammadreza Doostmohammadian , Alireza Aghasi , Houman Zarrabi

Stochastic bilevel optimization tackles challenges involving nested optimization structures. Its fast-growing scale nowadays necessitates efficient distributed algorithms. In conventional distributed bilevel methods, each worker must…

Optimization and Control · Mathematics 2024-05-30 Yutong He , Jie Hu , Xinmeng Huang , Songtao Lu , Bin Wang , Kun Yuan

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

Modern networks are large, highly complex and dynamic. Add to that the mobility of the agents comprising many of these networks. It is difficult or even impossible for such systems to be managed centrally in an efficient manner. It is…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-07 Amitabh Trehan

We study distributed non-convex optimization on a time-varying multi-agent network. Each node has access to its own smooth local cost function, and the collective goal is to minimize the sum of these functions. We generalize the results…

Optimization and Control · Mathematics 2016-12-06 Tatiana Tatarenko , Behrouz Touri

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

Optimization and Control · Mathematics 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari

In this paper, the distributed resource allocation optimization problem is investigated. The allocation decisions are made to minimize the sum of all the agents' local objective functions while satisfying both the global network resource…

Optimization and Control · Mathematics 2017-04-11 Peng Yi , Yiguang Hong , Feng Liu

We study nonconvex distributed optimization in multi-agent networks with time-varying (nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed minimization of the sum of a smooth (possibly nonconvex and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-02 Paolo Di Lorenzo , Gesualdo Scutari