English
Related papers

Related papers: A Finite-Time Cutting Plane Algorithm for Distribu…

200 papers

This paper studies the distributed linearly separable computation problem, which is a generalization of many existing distributed computing problems such as distributed gradient descent and distributed linear transform. In this problem, a…

Information Theory · Computer Science 2020-10-06 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

Cutting plane methods are a fundamental approach for solving integer linear programs (ILPs). In each iteration of such methods, additional linear constraints (cuts) are introduced to the constraint set with the aim of excluding the previous…

Optimization and Control · Mathematics 2024-06-28 Pol Puigdemont , Stratis Skoulakis , Grigorios Chrysos , Volkan Cevher

We consider discrete bilevel optimization problems where the follower solves an integer program with a fixed number of variables. Using recent results in parametric integer programming, we present polynomial time algorithms for pure and…

Optimization and Control · Mathematics 2017-01-03 Matthias Köppe , Maurice Queyranne , Christopher Thomas Ryan

We study the complexity of finding communication trees with the lowest possible completion time for rooted, irregular gather and scatter collective communication operations in fully connected, $k$-ported communication networks under a…

Computational Complexity · Computer Science 2018-11-28 Jesper Larsson Träff

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

In distributed optimization for large-scale learning, a major performance limitation comes from the communications between the different entities. When computations are performed by workers on local data while a coordinator machine…

Optimization and Control · Mathematics 2020-06-26 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick , Massih-Reza Amini

This paper considers the problem of designing a dynamical system to solve constrained optimization problems in a distributed way and in an anytime fashion (i.e., such that the feasible set is forward invariant). For problems with separable…

Optimization and Control · Mathematics 2023-09-07 Pol Mestres , Jorge Cortés

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

Optimization and Control · Mathematics 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

This work aims to jointly optimize the coding and node selection to minimize the processing time for distributed computing tasks over wireless edge networks. Since the joint optimization problem formulation is NP-hard and nonlinear, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-11 Cong T. Nguyen , Diep N. Nguyen , Dinh Thai Hoang , Hoang-Anh Pham , Eryk Dutkiewicz

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin

In this paper, we develop a distributed algorithm for solving a class of distributed convex optimization problems where the local objective functions can be a general nonsmooth function, and all equalities and inequalities are network-wide…

Optimization and Control · Mathematics 2026-04-14 Yeong-Ung Kim , Hyo-Sung Ahn

We propose a dual decomposition and linear program relaxation of the NP -hard minimum cost multicut problem. Unlike other polyhedral relaxations of the multicut polytope, it is amenable to efficient optimization by message passing. Like…

Data Structures and Algorithms · Computer Science 2017-01-13 Paul Swoboda , Bjoern Andres

This paper proposes a fully distributed termination method for distributed optimization algorithms solved by multiple agents. The proposed method guarantees terminating a distributed optimization algorithm after satisfying the global…

Optimization and Control · Mathematics 2024-01-31 Mohannad Alkhraijah , Daniel K. Molzahn

We study two variants of \textsc{Maximum Cut}, which we call \textsc{Connected Maximum Cut} and \textsc{Maximum Minimal Cut}, in this paper. In these problems, given an unweighted graph, the goal is to compute a maximum cut satisfying some…

Data Structures and Algorithms · Computer Science 2019-08-12 Hiroshi Eto , Tesshu Hanaka , Yasuaki Kobayashi , Yusuke Kobayashi

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2019-06-25 Mohammad Vahid Jamali , Mahdi Soleymani , Hessam Mahdavifar

We consider a discrete-time linear-quadratic Gaussian control problem in which we minimize a weighted sum of the directed information from the state of the system to the control input and the control cost. The optimal control and sensing…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Murat Cubuktepe , Takashi Tanaka , Ufuk Topcu

We study non-convex distributed optimization problems where a set of agents collaboratively solve a separable optimization problem that is distributed over a time-varying network. The existing methods to solve these problems rely on (at…

Optimization and Control · Mathematics 2022-04-26 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2021-10-06 Mahdi Soleymani , Mohammad Vahid Jamali , Hessam Mahdavifar

Multiagent planning and coordination problems are common and known to be computationally hard. We show that a wide range of two-agent problems can be formulated as bilinear programs. We present a successive approximation algorithm that…

Artificial Intelligence · Computer Science 2014-01-16 Marek Petrik , Shlomo Zilberstein

This paper proposes distributed algorithms for multi-agent networks to achieve a solution in finite time to a linear equation $Ax=b$ where $A$ has full row rank, and with the minimum $l_1$-norm in the underdetermined case (where $A$ has…

Systems and Control · Computer Science 2017-10-02 Jingqiu Zhou , Wang Xuan , Shaoshuai Mou , Brian. D. O. Anderson