中文
相关论文

相关论文: Tight Linear Convergence Rate of ADMM for Decentra…

200 篇论文

Privacy preservation is addressed for decentralized optimization, where $N$ agents cooperatively minimize the sum of $N$ convex functions private to these individual agents. In most existing decentralized optimization approaches,…

最优化与控制 · 数学 2018-07-03 Chunlei Zhang , Muaz Ahmad , Yongqiang Wang

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

网络与互联网体系结构 · 计算机科学 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva

We propose a distributed algorithm, named Distributed Alternating Direction Method of Multipliers (D-ADMM), for solving separable optimization problems in networks of interconnected nodes or agents. In a separable optimization problem there…

最优化与控制 · 数学 2013-04-26 João F. C. Mota , João M. F. Xavier , Pedro M. Q. Aguiar , Markus Püschel

The alternating direction method of multipliers (ADMM) is commonly used for distributed model fitting problems, but its performance and reliability depend strongly on user-defined penalty parameters. We study distributed ADMM methods that…

机器学习 · 计算机科学 2017-06-21 Zheng Xu , Gavin Taylor , Hao Li , Mario Figueiredo , Xiaoming Yuan , Tom Goldstein

This paper focuses on the decentralized optimization problem, where agents in a network cooperate to minimize the sum of their local objective functions by information exchange and local computation. Based on the alternating direction…

最优化与控制 · 数学 2023-01-25 Zhen Zhang , Shaofu Yang , Wenying Xu

We consider the problem of minimizing the sum of cost functions pertaining to agents over a network whose topology is captured by a directed graph (i.e., asymmetric communication). We cast the problem into the ADMM setting, via a consensus…

最优化与控制 · 数学 2023-04-04 Dingran Yi , Nikolaos M. Freris

A key challenge in decentralized optimization is determining the optimal convergence rate and designing algorithms to achieve it. While this problem has been extensively addressed for doubly-stochastic and column-stochastic mixing matrices,…

最优化与控制 · 数学 2025-06-06 Liyuan Liang , Xinyi Chen , Gan Luo , Kun Yuan

Thanks to its versatility, its simplicity, and its fast convergence, ADMM is among the most widely used approaches for solving a convex problem in distributed form. However, making it running efficiently is an art that requires a fine…

最优化与控制 · 数学 2019-07-10 Tomaso Erseghe

Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing (EC). Aided by EC, decentralized federated learning (DFL), which overcomes the single-point-of-failure problem in the parameter server…

网络与互联网体系结构 · 计算机科学 2022-12-06 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Chen Qian

Edge computing provides a promising paradigm to support the implementation of Industrial Internet of Things (IIoT) by offloading tasks to nearby edge nodes. Meanwhile, the increasing network size makes it impractical for centralized data…

机器学习 · 计算机科学 2021-07-02 Wanlu Lei , Yu Ye , Ming Xiao , Mikael Skoglund , Zhu Han

Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of edge networks, however, faces severe performance challenges…

网络与互联网体系结构 · 计算机科学 2025-04-22 Tingyang Sun , Tuan Nguyen , Ting He

In this paper, we focus on an asynchronous distributed optimization problem. In our problem, each node is endowed with a convex local cost function, and is able to communicate with its neighbors over a directed communication network.…

最优化与控制 · 数学 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

Distributed optimization is an important direction of research in modern optimization theory. Its applications include large scale machine learning, distributed signal processing and many others. The paper studies decentralized min-max…

最优化与控制 · 数学 2023-09-08 Nhat Trung Nguyen , Alexander Rogozin , Dmitry Metelev , Alexander Gasnikov

In recent years, the development of smart edge computing systems to process information locally is on the rise. Many near-sensor machine learning (ML) approaches have been implemented to introduce accurate and energy efficient template…

机器学习 · 计算机科学 2025-02-17 Kieran Woodward , Eiman Kanjo , Georgios Papandroulidakis , Shady Agwa , Themis Prodromakis

The electrical network reconfiguration problem aims to minimize losses in a distribution system by adjusting switches while ensuring radial topology. The growing use of renewable energy and the complexity of managing modern power grids make…

系统与控制 · 电气工程与系统科学 2025-08-12 Yacine Mokhtari , Patrick Coirault , Emmanuel Moulay , Jérôme Le Ny , Didier Larraillet

Analyzing networks requires complex algorithms to extract meaningful information. Centrality metrics have shown to be correlated with the importance and loads of the nodes in network traffic. Here, we are interested in the problem of…

数据结构与算法 · 计算机科学 2013-03-05 Ahmet Erdem Sariyuce , Kamer Kaya , Erik Saule , Umit V. Catalyurek

This paper considers decentralized optimization of convex functions with mixed affine equality constraints involving both local and global variables. Constraints on global variables may vary across different nodes in the network, while…

最优化与控制 · 数学 2026-02-05 Demyan Yarmoshik , Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov

This paper addresses the problem of efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double…

机器学习 · 统计学 2025-03-11 Canyi Chen , Nan Qiao , Liping Zhu

Advanced tensor decomposition, such as Tensor train (TT) and Tensor ring (TR), has been widely studied for deep neural network (DNN) model compression, especially for recurrent neural networks (RNNs). However, compressing convolutional…

计算机视觉与模式识别 · 计算机科学 2021-07-28 Miao Yin , Yang Sui , Siyu Liao , Bo Yuan

In this work, we consider the distributed optimization problem in which each node has its own convex cost function and can communicate directly only with its neighbors, as determined by a directed communication topology (directed graph or…

最优化与控制 · 数学 2021-10-07 Wei Jiang , Themistoklis Charalambous