English
Related papers

Related papers: Exponential convergence of a distributed divide-an…

200 papers

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

This paper presents a fully asynchronous and distributed approach for tackling optimization problems in which both the objective function and the constraints may be nonconvex. In the considered network setting each node is active upon…

Optimization and Control · Mathematics 2019-02-25 Francesco Farina , Andrea Garulli , Antonio Giannitrapani , Giuseppe Notarstefano

Deep unfolding networks (DUN) have emerged as a popular iterative framework for accelerated magnetic resonance imaging (MRI) reconstruction. However, conventional DUN aims to reconstruct all the missing information within the entire null…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Chong Wang , Lanqing Guo , Yufei Wang , Hao Cheng , Yi Yu , Bihan Wen

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

This paper proposes an algorithm for solving structured optimization problems, which covers both the backward-backward and the Douglas-Rachford algorithms as special cases, and analyzes its convergence. The set of fixed points of the…

Optimization and Control · Mathematics 2017-09-19 Nguyen Hieu Thao

In this paper, a class of Decentralized Approximate Newton (DEAN) methods for addressing convex optimization on a networked system are developed, where nodes in the networked system seek for a consensus that minimizes the sum of their…

Optimization and Control · Mathematics 2020-12-01 Hejie Wei , Zhihai Qu , Xuyang Wu , Hao Wang , Jie Lu

This paper considers the distributed optimization of a sum of locally observable, non-convex functions. The optimization is performed over a multi-agent networked system, and each local function depends only on a subset of the variables. An…

Optimization and Control · Mathematics 2016-05-04 Sandeep Kumar , Rahul Jain , Ketan Rajawat

This work concerns the analysis and design of distributed first-order optimization algorithms over time-varying graphs. The goal of such algorithms is to optimize a global function that is the average of local functions using only local…

Optimization and Control · Mathematics 2020-02-17 Akhil Sundararajan , Bryan Van Scoy , Laurent Lessard

In this paper, we propose a novel Dual Inexact Splitting Algorithm (DISA) for distributed convex composite optimization problems, where the local loss function consists of a smooth term and a possibly nonsmooth term composed with a linear…

Optimization and Control · Mathematics 2023-04-25 Luyao Guo , Xinli Shi , Shaofu Yang , Jinde Cao

We study non-convex distributed optimization problems where a set of agents collaboratively solve a separable optimization problem that is distributed over a time-varying network. The existing methods to solve these problems rely on (at…

Optimization and Control · Mathematics 2022-04-26 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

In this paper, we focus on solving a distributed convex optimization problem in a network, where each agent has its own convex cost function and the goal is to minimize the sum of the agents' cost functions while obeying the network…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Wei Shi , Jinming Xu , Angelia Nedić

In a recent paper, a distributed algorithm was proposed for solving linear algebraic equations of the form $Ax = b$ assuming that the equation has at least one solution. The equation is presumed to be solved by $m$ agents assuming that each…

Optimization and Control · Mathematics 2017-01-06 Ji Liu , A. Stephen Morse , Angelia Nedich , Tamer Basar

We consider a multi agent optimization problem where a set of agents collectively solves a global optimization problem with the objective function given by the sum of locally known convex functions. We focus on the case when information…

Optimization and Control · Mathematics 2016-03-14 Ali Makhdoumi , Asuman Ozdaglar

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Angelia Nedić

In this paper, a distributed velocity-constrained consensus problem is studied for discrete-time multi-agent systems, where each agent's velocity is constrained to lie in a nonconvex set. A distributed constrained control algorithm is…

Optimization and Control · Mathematics 2020-03-05 Peng Lin , Wei Ren , Huijun Gao

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

Machine Learning · Computer Science 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

In this paper we consider a distributed convex optimization problem over time-varying undirected networks. We propose a dual method, primarily averaged network dual ascent (PANDA), that is proven to converge R-linearly to the optimal point…

Optimization and Control · Mathematics 2018-10-16 Marie Maros , Joakim Jaldén

The paper studies distributed Dictionary Learning (DL) problems where the learning task is distributed over a multi-agent network with time-varying (nonsymmetric) connectivity. This formulation is relevant, for instance, in big-data…

Optimization and Control · Mathematics 2016-12-23 Amir Daneshmand , Gesualdo Scutari , Francisco Facchinei

This paper focuses on the distributed optimization of stochastic saddle point problems. The first part of the paper is devoted to lower bounds for the centralized and decentralized distributed methods for smooth (strongly) convex-(strongly)…

Machine Learning · Computer Science 2025-04-28 Aleksandr Beznosikov , Valentin Samokhin , Alexander Gasnikov