English
Related papers

Related papers: GADMM: Fast and Communication Efficient Framework …

200 papers

Online multi-task learning (OMTL) enhances streaming data processing by leveraging the inherent relations among multiple tasks. It can be described as an optimization problem in which a single loss function is defined for multiple tasks.…

Machine Learning · Computer Science 2024-11-12 Ruiyu Li , Peilin Zhao , Guangxia Li , Zhiqiang Xu , Xuewei Li

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions.…

Optimization and Control · Mathematics 2020-09-16 David Biagioni , Peter Graf , Xiangyu Zhang , Ahmed Zamzam , Kyri Baker , Jennifer King

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

Systems and Control · Computer Science 2016-11-15 Tsung-Hui Chang

We consider a distributed learning problem, where agents minimize a global objective function by exchanging information over a network. Our approach has two distinct features: (i) It substantially reduces communication by triggering…

Machine Learning · Computer Science 2025-11-20 Guner Dilsad Er , Sebastian Trimpe , Michael Muehlebach

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

We present a novel framework, namely AADMM, for acceleration of linearized alternating direction method of multipliers (ADMM). The basic idea of AADMM is to incorporate a multi-step acceleration scheme into linearized ADMM. We demonstrate…

Optimization and Control · Mathematics 2014-02-13 Yuyuan Ouyang , Yunmei Chen , Guanghui Lan , Eduardo Pasiliao

In this paper, we introduce a unified framework for studying various cloud traffic management problems, ranging from geographical load balancing to backbone traffic engineering. We first abstract these real-world problems as a…

Networking and Internet Architecture · Computer Science 2016-02-04 Chen Feng , Hong Xu , Baochun Li

In this work, we consider the asynchronous distributed optimization problem in which each node has its own convex cost function and can communicate directly only with its neighbors, as determined by a directed communication topology…

Optimization and Control · Mathematics 2021-04-27 Wei Jiang , Andreas Grammenos , Evangelia Kalyvianaki , Themistoklis Charalambous

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

The Alternating Direction Method of Multipliers (ADMM) has now days gained tremendous attentions for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the…

Optimization and Control · Mathematics 2020-03-23 Mingxi Zhu , Kresimir Mihic , Yinyu Ye

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

Optimization and Control · Mathematics 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

While Graph Neural Networks (GNNs) are popular in the deep learning community, they suffer from several challenges including over-smoothing, over-squashing, and gradient vanishing. Recently, a series of models have attempted to relieve…

Machine Learning · Computer Science 2022-11-18 Junxiang Wang , Hongyi Li , Zheng Chai , Yongchao Wang , Yue Cheng , Liang Zhao

With the proliferation of distributed energy resources and the volume of data stored due to advancement in metering infrastructure, energy management in power system operation needs distributed computing. In this paper, we propose a fully…

Systems and Control · Electrical Eng. & Systems 2020-05-21 Shailesh Wasti , Pablo Ubiratan , Shahab Afshar , Vahid Disfani

Due to massive amounts of data distributed across multiple locations, distributed machine learning has attracted a lot of research interests. Alternating Direction Method of Multipliers (ADMM) is a powerful method of designing distributed…

Machine Learning · Computer Science 2020-12-10 Jiahao Ding , Xiaoqi Qin , Wenjun Xu , Yanmin Gong , Chi Zhang , Miao Pan

To solve the separable convex optimization problem with linear constraints, Eckstein and Bertsekas introduced the generalized alternating direction method of multipliers (in short, GADMM), which is an efficient and simple acceleration…

Optimization and Control · Mathematics 2022-11-17 Jianwen Peng , Dexi Liu , Xueqing Zhang , Jen-Chih Yao

The electrical network reconfiguration problem aims to minimize losses in a distribution system by adjusting switches while ensuring radial topology. The growing use of renewable energy and the complexity of managing modern power grids make…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Yacine Mokhtari , Patrick Coirault , Emmanuel Moulay , Jérôme Le Ny , Didier Larraillet

One potential future for the next generation of smart grids is the use of decentralized optimization algorithms and secured communications for coordinating renewable generation (e.g., wind/solar), dispatchable devices (e.g.,…

Systems and Control · Electrical Eng. & Systems 2023-01-24 Terrence W. K. Mak , Minas Chatzos , Mathieu Tanneau , Pascal Van Hentenryck

Distributed optimization has attracted lots of attention in the operation of power systems in recent years, where a large area is decomposed into smaller control regions each solving a local optimization problem with periodic information…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Junyao Guo , Gabriela Hug , Ozan Tonguz