English
Related papers

Related papers: Distributed Projection-free Algorithm for Constrai…

200 papers

Distributed aggregative optimization underpins many cooperative optimization and multi-agent control systems, where each agent's objective function depends both on its local optimization variable and an aggregate of all agents' optimization…

Systems and Control · Electrical Eng. & Systems 2026-03-30 Ziqin Chen , Yongqiang Wang

In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity…

Optimization and Control · Mathematics 2018-11-16 César A. Uribe , Soomin Lee , Alexander Gasnikov , Angelia Nedić

In the large collection of existing distributed algorithms for convex multi-agent optimization, only a handful of them provide convergence rate guarantees on agent networks with time-varying topologies, which, however, restrict the problem…

Optimization and Control · Mathematics 2018-04-06 Xuyang Wu , Jie Lu

In the paper, we propose a class of accelerated stochastic gradient-free and projection-free (a.k.a., zeroth-order Frank-Wolfe) methods to solve the constrained stochastic and finite-sum nonconvex optimization. Specifically, we propose an…

Optimization and Control · Mathematics 2020-08-11 Feihu Huang , Lue Tao , Songcan Chen

This paper proposes a novel class of distributed continuous-time coordination algorithms to solve network optimization problems whose cost function is a sum of local cost functions associated to the individual agents. We establish the…

Optimization and Control · Mathematics 2014-08-25 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan

In this paper, we study secure distributed optimization against arbitrary gradient attack in multi-agent networks. In distributed optimization, there is no central server to coordinate local updates, and each agent can only communicate with…

Optimization and Control · Mathematics 2022-10-31 Shuhua Yu , Soummya Kar

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

Differentiable optimization has received a significant amount of attention due to its foundational role in the domain of machine learning based on neural networks. This paper proposes a differentiable layer, named Differentiable Frank-Wolfe…

Machine Learning · Computer Science 2024-04-01 Zixuan Liu , Liu Liu , Xueqian Wang , Peilin Zhao

This paper aims at distributed multi-agent convex optimization where the communications network among the agents are presented by a random sequence of possibly state-dependent weighted graphs. This is the first work to consider both random…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Seyyed Shaho Alaviani , Atul Kelkar

This paper studies the application of the blended dynamics approach towards distributed optimization problem where the global cost function is given by a sum of local cost functions. The benefits include (i) individual cost function need…

Optimization and Control · Mathematics 2021-02-26 Seungjoon Lee , Hyungbo Shim

Projection-free optimization algorithms, which are mostly based on the classical Frank-Wolfe method, have gained significant interest in the machine learning community in recent years due to their ability to handle convex constraints that…

Machine Learning · Computer Science 2021-02-24 Dan Garber , Ben Kretzu

In this paper, a novel distributed optimization framework has been proposed. The key idea is to convert optimization problems into optimal control problems where the objective of each agent is to design the current control input minimizing…

Optimization and Control · Mathematics 2025-04-01 Ziyuan Guo , Yue Sun , Yeming Xu , Liping Zhang , Huanshui Zhang

The distributed non-smooth resource allocation problem over multi-agent networks is studied in this paper, where each agent is subject to globally coupled network resource constraints and local feasibility constraints described in terms of…

Optimization and Control · Mathematics 2022-03-11 Xiaohong Nian , Fan Li , Dongxin Liu

We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Ying Sun , Gesualdo Scutari , Daniel Palomar

We study a class of zeroth-order distributed optimization problems, where each agent can control a partial vector and observe a local cost that depends on the joint vector of all agents, and the agents can communicate with each other with…

Optimization and Control · Mathematics 2024-01-09 Xinran Zheng , Tara Javidi , Behrouz Touri

We propose a randomized block-coordinate variant of the classic Frank-Wolfe algorithm for convex optimization with block-separable constraints. Despite its lower iteration cost, we show that it achieves a similar convergence rate in duality…

Machine Learning · Computer Science 2013-01-15 Simon Lacoste-Julien , Martin Jaggi , Mark Schmidt , Patrick Pletscher

This paper examines online distributed Alternating Direction Method of Multipliers (ADMM). The goal is to distributively optimize a global objective function over a network of decision makers under linear constraints. The global objective…

Optimization and Control · Mathematics 2015-10-05 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

Optimization and Control · Mathematics 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii