English
Related papers

Related papers: Distributed Optimization with Inexact Oracle

200 papers

In this paper we design a novel class of online distributed optimization algorithms leveraging control theoretical techniques. We start by focusing on quadratic costs, and assuming to know an internal model of their variation. In this…

Optimization and Control · Mathematics 2026-01-21 Wouter J. A. van Weerelt , Nicola Bastianello

We consider the problem of minimizing a function that is a sum of convex agent functions plus a convex common public function that couples them. The agent functions can only be accessed via a subgradient oracle; the public function is…

Optimization and Control · Mathematics 2023-07-24 Tetiana Parshakova , Fangzhao Zhang , Stephen Boyd

We study distributed multiagent optimization over (directed, time-varying) graphs. We consider the minimization of $F+G$ subject to convex constraints, where $F$ is the smooth strongly convex sum of the agent's losses and $G$ is a nonsmooth…

Optimization and Control · Mathematics 2020-10-13 Ying Sun , Amir Daneshmand , Gesualdo Scutari

Inspired and underpinned by the idea of integral feedback, a distributed constant gain algorithm is proposed for multi-agent networks to solve convex optimization problems with local linear constraints. Assuming agent interactions are…

Optimization and Control · Mathematics 2021-11-19 Xuan Wang , Shaoshuai Mou , Brian. D. O. Anderson

In large-scale modern data analysis, first-order optimization methods are usually favored to obtain sparse estimators in high dimensions. This paper performs theoretical analysis of a class of iterative thresholding based estimators defined…

Statistics Theory · Mathematics 2016-10-11 Yiyuan She

In this article, we present an algorithm that drives the outputs of a network of agents to jointly track the solutions of time-varying optimization problems in a way that is robust to asynchrony in the agents' operations. We consider three…

Optimization and Control · Mathematics 2023-12-04 Gabriel Behrendt , Matthew Longmire , Zachary I. Bell , Matthew Hale

Distributed optimization often consists of two updating phases: local optimization and inter-node communication. Conventional approaches require working nodes to communicate with the server every one or few iterations to guarantee…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-17 Chi Zhang , Qianxiao Li

In this paper, we study secure distributed optimization against arbitrary gradient attack in multi-agent networks. In distributed optimization, there is no central server to coordinate local updates, and each agent can only communicate with…

Optimization and Control · Mathematics 2022-10-31 Shuhua Yu , Soummya Kar

The goal of this thesis is to study the compression problems arising in distributed computing systematically. In the first part of the thesis, we study gradient compression for distributed first-order optimization. We begin by establishing…

Information Theory · Computer Science 2023-01-12 Prathamesh Mayekar

Gradient-type distributed optimization methods have blossomed into one of the most important tools for solving a minimization learning task over a networked agent system. However, only one gradient update per iteration is difficult to…

Optimization and Control · Mathematics 2024-03-06 Mou Wu , Haibin Liao , Zhengtao Ding , Yonggang Xiao

Distributed optimization has gained significant attention in recent years, primarily fueled by the availability of a large amount of data and privacy-preserving requirements. This paper presents a fixed-time convergent optimization…

Systems and Control · Computer Science 2022-05-30 Kunal Garg , Mayank Baranwal

This paper investigates the distributed online optimization problem over a multi-agent network subject to local set constraints and coupled inequality constraints, which has a lot of applications in many areas, such as wireless sensor…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Xinlei Yi , Lihua Xie

This paper considers the distributed smooth optimization problem in which the objective is to minimize a global cost function formed by a sum of local smooth cost functions, by using local information exchange. The standard assumption for…

Optimization and Control · Mathematics 2019-09-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Karl H. Johansson , Tianyou Chai

Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to…

Optimization and Control · Mathematics 2021-03-22 Farzad Yousefian

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

In this paper, distributed convex optimization problem over non-directed dynamical networks is studied. Here, networked agents with single-integrator dynamics are supposed to rendezvous at a point that is the solution of a global convex…

Optimization and Control · Mathematics 2017-07-18 Amir Adibzadeh , Mohsen Zamani , Amir A. Suratgar , Mohammad B. Menhaj

Many of the distributed localization algorithms are based on relaxed optimization formulations of the localization problem. These algorithms commonly rely on first-order optimization methods, and hence may require many iterations or…

Optimization and Control · Mathematics 2016-07-19 Sina Khoshfetrat Pakazad , Emre Özkan , Carsten Fritsche , Anders Hansson , Fredrik Gustafsson

In this paper, we consider distributed optimization design for resource allocation problems over weight-balanced graphs. With the help of singular perturbation analysis, we propose a simple sub-optimal continuous-time optimization…

Optimization and Control · Mathematics 2022-06-14 Shu Liang , Xianlin Zeng , Yiguang Hong

We investigate the information complexity of mixed-integer convex optimization under different types of oracles. We establish new lower bounds for the standard first-order oracle, improving upon the previous best known lower bound. This…

Optimization and Control · Mathematics 2023-08-23 Amitabh Basu , Hongyi Jiang , Phillip Kerger , Marco Molinaro

We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent…

Optimization and Control · Mathematics 2024-04-23 Yaqun Yang , Jinlong Lei