中文
相关论文

相关论文: ADMM Algorithm for Graphical Lasso with an $\ell_{…

200 篇论文

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

最优化与控制 · 数学 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

Higher-order tensors are becoming prevalent in many scientific areas such as computer vision, social network analysis, data mining and neuroscience. Traditional tensor decomposition approaches face three major challenges: model selecting,…

数值分析 · 计算机科学 2014-07-08 Fanhua Shang , Yuanyuan Liu , James Cheng

We present ADMM-Softmax, an alternating direction method of multipliers (ADMM) for solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with many examples and features. It…

机器学习 · 计算机科学 2019-07-12 Samy Wu Fung , Sanna Tyrväinen , Lars Ruthotto , Eldad Haber

We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…

最优化与控制 · 数学 2018-06-15 Quoc Tran-Dinh , Yuzixuan Zhu

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

机器学习 · 统计学 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

The estimation of a precision matrix is a crucial problem in various research fields, particularly when working with high dimensional data. In such settings, the most common approach is to use the penalized maximum likelihood. The…

统计方法学 · 统计学 2025-01-10 Vahe Avagyan

We propose an efficient ADMM method with guarantees for high-dimensional problems. We provide explicit bounds for the sparse optimization problem and the noisy matrix decomposition problem. For sparse optimization, we establish that the…

机器学习 · 计算机科学 2015-07-08 Hanie Sedghi , Anima Anandkumar , Edmond Jonckheere

This work proposes a novel adaptive linearized alternating direction multiplier method (LADMM) to convex optimization, which improves the convergence rate of the LADMM-based algorithm by adjusting step-size iteratively.The innovation of…

最优化与控制 · 数学 2024-07-04 Boran Wang

Thanks to its versatility, its simplicity, and its fast convergence, ADMM is among the most widely used approaches for solving a convex problem in distributed form. However, making it running efficiently is an art that requires a fine…

最优化与控制 · 数学 2019-07-10 Tomaso Erseghe

In this paper, we present a distributed algorithm for the reconstruction of large-scale nonlinear networks. In particular, we focus on the identification from time-series data of the nonlinear functional forms and associated parameters of…

最优化与控制 · 数学 2014-03-31 Wei Pan , Aivar Sootla , Guy-Bart Stan

The alternating direction method of multipliers (ADMM) proposed by Glowinski and Marrocco is a benchmark algorithm for two-block separable convex optimization problems with linear equality constraints. It has been modified, specified, and…

最优化与控制 · 数学 2021-07-15 Bingsheng He , Shengjie Xu , Xiaoming Yuan

Sparsity finds applications in areas as diverse as statistics, machine learning, and signal processing. Computations over sparse structures are less complex compared to their dense counterparts, and their storage consumes less space. This…

信号处理 · 电气工程与系统科学 2023-01-31 Omar M. Sleem , M. E. Ashour , N. S. Aybat , Constantino M. Lagoa

The sparse inverse covariance estimation problem is commonly solved using an $\ell_{1}$-regularized Gaussian maximum likelihood estimator known as "graphical lasso", but its computational cost becomes prohibitive for large data sets. A…

机器学习 · 统计学 2018-06-08 Richard Y. Zhang , Salar Fattahi , Somayeh Sojoudi

We consider the problem of estimating differences in two Gaussian graphical models (GGMs) which are known to have similar structure. The GGM structure is encoded in its precision (inverse covariance) matrix. In many applications one is…

机器学习 · 统计学 2023-12-19 Jitendra K Tugnait

In this paper, we show that for a class of linearly constrained convex composite optimization problems, an (inexact) symmetric Gauss-Seidel based majorized multi-block proximal alternating direction method of multipliers (ADMM) is…

最优化与控制 · 数学 2019-01-29 Liang Chen , Xudong Li , Defeng Sun , Kim-Chuan Toh

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees.…

系统与控制 · 电气工程与系统科学 2022-11-17 Vivek Khatana , Murti V. Salapaka

Many problems in machine learning and other fields can be (re)for-mulated as linearly constrained separable convex programs. In most of the cases, there are multiple blocks of variables. However, the traditional alternating direction method…

数值分析 · 计算机科学 2014-05-30 Zhouchen Lin , Risheng Liu , Huan Li

In this paper, a stochastic alternating direction method of multipliers (ADMM) is proposed for a class of nonsmooth composite and stochastic convex optimization problems in Hilbert space, motivated by optimization problems constrained by…

最优化与控制 · 数学 2026-05-18 Weihua Deng , Haiming Song , Hao Wang , Jinda Yang

We consider the stochastic nested composition optimization problem where the objective is a composition of two expected-value functions. We proposed the stochastic ADMM to solve this complicated objective. In order to find an $\epsilon$…

机器学习 · 统计学 2019-11-14 Zhongruo Wang

We consider the problem of learning a sparse undirected graph underlying a given set of multivariate data. We focus on graph Laplacian-related constraints on the sparse precision matrix that encodes conditional dependence between the random…

机器学习 · 统计学 2021-11-17 Jitendra K. Tugnait