中文
相关论文

相关论文: Alternating Direction Method of Multipliers for Sp…

200 篇论文

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

最优化与控制 · 数学 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

Online optimization has emerged as powerful tool in large scale optimization. In this pa- per, we introduce efficient online optimization algorithms based on the alternating direction method (ADM), which can solve online convex optimization…

机器学习 · 计算机科学 2013-07-11 Huahua Wang , Arindam Banerjee

Alternating Direction Method of Multipliers (ADMM) algorithm has been widely adopted for solving the distributed optimization problem (DOP). In this paper, a new distributed parallel ADMM algorithm is proposed, which allows the agents to…

最优化与控制 · 数学 2021-11-23 Ziye Liu , Fanghong Guo , Wei Wang , Xiaoqun Wu

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

最优化与控制 · 数学 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

The alternating direction method of multipliers (ADMM) algorithm is a powerful and flexible tool for complex optimization problems of the form $\min\{f(x)+g(y) : Ax+By=c\}$. ADMM exhibits robust empirical performance across a range of…

最优化与控制 · 数学 2024-02-08 Rina Foygel Barber , Emil Y. Sidky

This paper shows the capability the alternating direction method of multipliers (ADMM) has to track, in a distributed manner, the optimal down-link beam-forming solution in a multiple input multiple output (MISO) multi-cell network given a…

最优化与控制 · 数学 2016-09-12 Marie Maros , Joakim Jaldén

We present a powerful and easy-to-implement iterative algorithm for solving large-scale optimization problems that involve $L_1$/total-variation (TV) regularization. The method is based on combining the Alternating Directions Method of…

最优化与控制 · 数学 2016-02-23 Musa Maharramov , Stewart A. Levin

In this paper, we investigate regrets of an online semi-proximal alternating direction method of multiplier (Online-spADMM) for solving online linearly constrained convex composite optimization problems. Under mild conditions, we establish…

最优化与控制 · 数学 2024-02-09 Yule Zhang , Zehao Xiao , Jia Wu , Liwei Zhang

Estimating conditional dependence graphs and precision matrices are some of the most common problems in modern statistics and machine learning. When data are fully observed, penalized maximum likelihood-type estimators have become standard…

机器学习 · 统计学 2019-04-09 Roger Fan , Byoungwook Jang , Yuekai Sun , Shuheng Zhou

In this paper, we analyze the convergence of the alternating direction method of multipliers (ADMM) for minimizing a nonconvex and possibly nonsmooth objective function, $\phi(x_0,\ldots,x_p,y)$, subject to coupled linear equality…

最优化与控制 · 数学 2018-05-31 Yu Wang , Wotao Yin , Jinshan Zeng

It is widely acknowledged that hyperparameter selection plays a critical role in the effectiveness of sparse optimization problems. The bilevel optimization provides a robust framework for addressing this issue, but these existing methods…

最优化与控制 · 数学 2026-03-11 Yunhai Xiao , Anqi Liu , Peili Li , Yanyun Ding

We consider a convex relaxation of sparse principal component analysis proposed by d'Aspremont et al. in (d'Aspremont et al. SIAM Rev 49:434-448, 2007). This convex relaxation is a nonsmooth semidefinite programming problem in which the…

最优化与控制 · 数学 2011-11-30 Shiqian Ma

Acceleration of deep neural networks to meet a specific latency constraint is essential for their deployment on mobile devices. In this paper, we design an architecture aware latency constrained sparse (ALCS) framework to prune and…

计算机视觉与模式识别 · 计算机科学 2021-09-02 Tianli Zhao , Qinghao Hu , Xiangyu He , Weixiang Xu , Jiaxing Wang , Cong Leng , Jian Cheng

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

最优化与控制 · 数学 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions.…

最优化与控制 · 数学 2020-09-16 David Biagioni , Peter Graf , Xiangyu Zhang , Ahmed Zamzam , Kyri Baker , Jennifer King

This paper considers an optimization problem that components of the objective function are available at different nodes of a network and nodes are allowed to only exchange information with their neighbors. The decentralized alternating…

最优化与控制 · 数学 2015-11-27 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The…

最优化与控制 · 数学 2014-03-20 Wei Deng , Ming-Jun Lai , Zhimin Peng , Wotao Yin

Despite the great achievements of deep neural networks (DNNs), the vulnerability of state-of-the-art DNNs raises security concerns of DNNs in many application domains requiring high reliability.We propose the fault sneaking attack on DNNs,…

机器学习 · 计算机科学 2025-07-08 Pu Zhao , Siyue Wang , Cheng Gongye , Yanzhi Wang , Yunsi Fei , Xue Lin

This paper studies a proximal alternating direction method of multipliers (ADMM) with variable metric indefinite proximal terms for linearly constrained convex optimization problems. The proximal ADMM plays an important role in many…

最优化与控制 · 数学 2019-07-01 Yan Gu , Nobuo Yamashita

Fr\'echet regression has received considerable attention to model metric-space valued responses that are complex and non-Euclidean data, such as probability distributions and vectors on the unit sphere. However, existing Fr\'echet…

统计方法学 · 统计学 2025-04-08 Jiaying Weng , Kai Tan , Cheng Wang , Zhou Yu