中文
相关论文

相关论文: Structure Learning via ADMM in Networks obeying Co…

200 篇论文

The Alternating Direction Method of Multipliers (ADMM) has now days gained tremendous attentions for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the…

最优化与控制 · 数学 2020-03-23 Mingxi Zhu , Kresimir Mihic , Yinyu Ye

Alternating direction method of multipliers (ADMM) is a popular first-order method owing to its simplicity and efficiency. However, similar to other proximal splitting methods, the performance of ADMM degrades significantly when the scale…

最优化与控制 · 数学 2021-08-11 Fengmiao Bian , Jingwei Liang , Xiaoqun Zhang

This article proposes diffusion LMS strategies for distributed estimation over adaptive networks that are able to exploit sparsity in the underlying system model. The approach relies on convex regularization, common in compressive sensing,…

机器学习 · 计算机科学 2015-06-05 Paolo Di Lorenzo , Ali H. Sayed

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

最优化与控制 · 数学 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

机器学习 · 计算机科学 2020-05-19 Zonghao Huang , Yanmin Gong

The alternating direction method of multipliers (ADMM) is a powerful splitting algorithm for linearly constrained convex optimization problems. In view of its popularity and applicability, a growing attention is drawn towards the ADMM in…

最优化与控制 · 数学 2022-08-19 Sedi Bartz , Rubén Campoy , Hung M. Phan

In this paper we present a shape optimization scheme which utilizes the alternating direction method of multipliers (ADMM) to approximate a direction of steepest descent in $W^{1,\infty}$. The followed strategy is a combination of the…

最优化与控制 · 数学 2025-08-26 Philip J. Herbert , Jose A. Pinzon Escobar , Martin Siebenborn

Mathematical modelling, particularly through approaches such as structured sparse support vector machines (SS-SVM), plays a crucial role in processing data with complex feature structures, yet efficient algorithms for distributed…

机器学习 · 计算机科学 2026-01-13 Rongmei Liang , Zizheng Liu , Xiaofei Wu , Jingwen Tu

The four-dimensional variational data assimilation (4D-Var) has emerged as an important methodology, widely used in numerical weather prediction, oceanographic modeling, and climate forecasting. Classical unconstrained gradient-based…

数值分析 · 数学 2024-10-08 Bowen Li , Bin Shi

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

机器学习 · 计算机科学 2013-08-19 Leon Wenliang Zhong , James T. Kwok

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

最优化与控制 · 数学 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

This paper proposes a novel algorithm for training recurrent neural network models of nonlinear dynamical systems from an input/output training dataset. Arbitrary convex and twice-differentiable loss functions and regularization terms are…

机器学习 · 计算机科学 2022-10-18 Alberto Bemporad

Optimization approaches based on operator splitting are becoming popular for solving sparsity regularized statistical machine learning models. While many have proposed fast algorithms to solve these problems for a single regularization…

统计方法学 · 统计学 2015-04-28 Yue Hu , Eric Chi , Genevera I. Allen

Learning to Optimize (L2O) approaches, including algorithm unrolling, plug-and-play methods, and hyperparameter learning, have garnered significant attention and have been successfully applied to the Alternating Direction Method of…

最优化与控制 · 数学 2024-09-27 Ling Liang , Cameron Austin , Haizhao Yang

This work studies the linear convergence of an accelerated scheme of the Alternating Direction Method of Multipliers (ADMM) for strongly convex and Lipschitz-smooth problems. We use the methodology of expressing the accelerated ADMM as a…

最优化与控制 · 数学 2025-12-08 Meisam Tavakoli , Fabian Jakob , Guido Carnevale , Giuseppe Notarstefano , Andrea Iannelli

Optimal transport on a graph focuses on finding the most efficient way to transfer resources from one distribution to another while considering the graph's structure. This paper introduces a new distributed algorithm that solves the optimal…

最优化与控制 · 数学 2025-07-08 Yacine Mokhtari , Emmanuel Moulay , Patrick Coirault , Jérôme Le Ny

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

机器学习 · 计算机科学 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

机器人学 · 计算机科学 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

This paper studies network resilience against structured additive perturbations to its topology. We consider dynamic networks modeled as linear time-invariant systems subject to perturbations of bounded energy satisfying specific sparsity…

系统与控制 · 电气工程与系统科学 2021-05-18 Shenyu Liu , Sonia Martinez , Jorge Cortes

Matrix completion is fundamental for predicting missing data with a wide range of applications in personalized healthcare, e-commerce, recommendation systems, and social network analysis. Traditional matrix completion approaches typically…

机器学习 · 计算机科学 2025-03-19 Patrick Hytla , Tran T. A. Nghia , Duy Nhat Phan , Andrew Rice