中文
相关论文

相关论文: Distributed Prediction-Correction ADMM for Time-Va…

200 篇论文

We propose a regularized saddle-point algorithm for convex networked optimization problems with resource allocation constraints. Standard distributed gradient methods suffer from slow convergence and require excessive communication when…

系统与控制 · 计算机科学 2012-08-16 Andrea Simonetto , Tamas Keviczky , Mikael Johansson

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

机器学习 · 计算机科学 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher

This paper considers the distributed bandit convex optimization problem with time-varying constraints. In this problem, the global loss function is the average of all the local convex loss functions, which are unknown beforehand. Each agent…

系统与控制 · 电气工程与系统科学 2025-04-25 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Lihua Xie , Tianyou Chai , Tao Yang

Recently, many variance reduced stochastic alternating direction method of multipliers (ADMM) methods (e.g.\ SAG-ADMM, SDCA-ADMM and SVRG-ADMM) have made exciting progress such as linear convergence rates for strongly convex problems.…

机器学习 · 计算机科学 2017-07-12 Yuanyuan Liu , Fanhua Shang , James Cheng

Decentralized optimization strategies are helpful for various applications, from networked estimation to distributed machine learning. This paper studies finite-sum minimization problems described over a network of nodes and proposes a…

系统与控制 · 电气工程与系统科学 2024-08-06 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

最优化与控制 · 数学 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

We develop cloud-assisted remote sensing techniques for enabling distributed consensus estimation of unknown parameters in a given geographic area. We first propose a distributed sensor network virtualization algorithm that searches for,…

网络与互联网体系结构 · 计算机科学 2015-01-16 Sherif Abdelwahab , Bechir Hamdaoui , Mohsen Guizani

In this work, we study decentralized convex constrained optimization problems in networks. We focus on the dual averaging-based algorithmic framework that is well-documented to be superior in handling constraints and complex communication…

最优化与控制 · 数学 2022-08-16 Changxin Liu , Yang Shi , Huiping Li , Wenli Du

The development of online algorithms to track time-varying systems has drawn a lot of attention in the last years, in particular in the framework of online convex optimization. Meanwhile, sparse time-varying optimization has emerged as a…

最优化与控制 · 数学 2020-02-03 Sophie M. Fosson

We present a flexible Alternating Direction Method of Multipliers (F-ADMM) algorithm for solving optimization problems involving a strongly convex objective function that is separable into $n \geq 2$ blocks, subject to (non-separable)…

最优化与控制 · 数学 2015-03-24 Daniel P. Robinson , Rachael E. H. Tappenden

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

最优化与控制 · 数学 2020-01-08 Bryan Van Scoy , Laurent Lessard

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

最优化与控制 · 数学 2025-11-03 Damilola Fasiku , Wentao Tang

In this paper, we aim to provide a comprehensive analysis on the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a certain…

最优化与控制 · 数学 2015-08-11 Deren Han , Defeng Sun , Liwei Zhang

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several nonconvex…

最优化与控制 · 数学 2016-12-13 Zheng Xu , Soham De , Mario Figueiredo , Christoph Studer , Tom Goldstein

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

机器学习 · 统计学 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee

In this paper, a decentralized proximal method of multipliers (DPMM) is proposed to solve constrained convex optimization problems over multi-agent networks, where the local objective of each agent is a general closed convex function, and…

最优化与控制 · 数学 2023-10-25 Kai Gong , Liwei Zhang

Adaptive Moment Estimation (ADAM) is a very popular training algorithm for deep neural networks and belongs to the family of adaptive gradient descent optimizers. However to the best of the authors knowledge no complete convergence analysis…

机器学习 · 计算机科学 2021-02-22 Sebastian Bock , Martin Georg Weiß

In this paper we consider a distributed optimization scenario in which a set of agents has to solve a convex optimization problem with separable cost function, local constraint sets and a coupling inequality constraint. We propose a novel…

系统与控制 · 计算机科学 2018-04-25 Ivano Notarnicola , Giuseppe Notarstefano

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

最优化与控制 · 数学 2015-02-12 Li Shen , Shaohua Pan

We propose a new method for computing Dynamic Mode Decomposition (DMD) evolution matrices, which we use to analyze dynamical systems. Unlike the majority of existing methods, our approach is based on a variational formulation consisting of…

数值分析 · 数学 2019-05-24 Omri Azencot , Wotao Yin , Andrea Bertozzi