中文
相关论文

相关论文: Global Convergence of ADMM in Nonconvex Nonsmooth …

200 篇论文

We study the problem of minimizing the sum of a smooth function and a nonsmooth convex regularizer over a compact Riemannian submanifold embedded in Euclidean space. By introducing an auxiliary splitting variable, we propose an adaptive…

最优化与控制 · 数学 2025-10-22 Kangkang Deng , Jiachen Jin , Jiang Hu , Hongxia Wang

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

数值分析 · 计算机科学 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

We present a flexible Alternating Direction Method of Multipliers (F-ADMM) algorithm for solving optimization problems involving a strongly convex objective function that is separable into $n \geq 2$ blocks, subject to (non-separable)…

最优化与控制 · 数学 2015-03-24 Daniel P. Robinson , Rachael E. H. Tappenden

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

数值分析 · 数学 2021-04-29 Luke Lozenski , Umberto Villa

This paper investigates quantile regression in the presence of non-convex and non-smooth sparse penalties, such as the minimax concave penalty (MCP) and smoothly clipped absolute deviation (SCAD). The non-smooth and non-convex nature of…

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

计算机视觉与模式识别 · 计算机科学 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

The linearly constrained convex composite programming problems whose objective function contains two blocks with each block being the form of nonsmooth+smooth arises frequently in multiple fields of applications. If both of the smooth terms…

最优化与控制 · 数学 2021-11-25 Congying Qin , Yunhai Xiao , Peili Li

We give a general proof of convergence for the Alternating Direction Method of Multipliers (ADMM). ADMM is an optimization algorithm that has recently become very popular due to its capabilities to solve large-scale and/or distributed…

最优化与控制 · 数学 2011-12-13 João F. C. Mota , João M. F. Xavier , Pedro M. Q. Aguiar , Markus Püschel

In this paper, we propose an inertial alternating direction method of multipliers for solving a class of non-convex multi-block optimization problems with \emph{nonlinear coupling constraints}. Distinctive features of our proposed method,…

最优化与控制 · 数学 2024-02-22 Le Thi Khanh Hien , Dimitri Papadimitriou

Sparse signal recovery based on nonconvex and nonsmooth optimization problems has significant applications and demonstrates superior performance in signal processing and machine learning. This work deals with a scale-invariant…

最优化与控制 · 数学 2025-09-29 Lang Yu , Nanjing Huang

In this paper, we establish the convergence properties for a majorized alternating direction method of multipliers (ADMM) for linearly constrained convex optimization problems whose objectives contain coupled functions. Our convergence…

最优化与控制 · 数学 2017-01-18 Ying Cui , Xudong Li , Defeng Sun , Kim-Chuan Toh

Non-convex constrained optimizations are ubiquitous in robotic applications such as multi-agent navigation, UAV trajectory optimization, and soft robot simulation. For this problem class, conventional optimizers suffer from small step sizes…

最优化与控制 · 数学 2025-10-08 Zherong Pan , Kui Wu

The alternating direction method of multipliers (ADMM) is a popular approach for solving optimization problems that are potentially non-smooth and with hard constraints. It has been applied to various computer graphics applications,…

图形学 · 计算机科学 2019-09-04 Juyong Zhang , Yue Peng , Wenqing Ouyang , Bailin Deng

In this paper, we study the local convergence of the standard ADMM scheme for a class of nonconvex composite problems arising from modern imaging and machine learning models. This problem is constrained by a closed convex set, while its…

最优化与控制 · 数学 2026-03-24 Xiyuan Xie , Lihua Yang , Qia li

We present ADMM-Softmax, an alternating direction method of multipliers (ADMM) for solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with many examples and features. It…

机器学习 · 计算机科学 2019-07-12 Samy Wu Fung , Sanna Tyrväinen , Lars Ruthotto , Eldad Haber

This paper develops a scalable new algorithm, called NysADMM, to minimize a smooth convex loss function with a convex regularizer. NysADMM accelerates the inexact Alternating Direction Method of Multipliers (ADMM) by constructing a…

最优化与控制 · 数学 2022-07-05 Shipu Zhao , Zachary Frangella , Madeleine Udell

This paper considers decentralized consensus optimization problems where nodes of a network have access to different summands of a global objective function. Nodes cooperate to minimize the global objective by exchanging information with…

最优化与控制 · 数学 2016-09-21 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

We study the combination of the alternating direction method of multipliers (ADMM) with physics-informed neural networks (PINNs) for a general class of nonsmooth partial differential equation (PDE)-constrained optimization problems, where…

最优化与控制 · 数学 2024-07-30 Yongcun Song , Xiaoming Yuan , Hangrui Yue

This paper proposes a Perturbed Proximal Gradient ADMM (PPG-ADMM) framework for solving general nonconvex composite optimization problems, where the objective function consists of a smooth nonconvex term and a nonsmooth weakly convex term…

最优化与控制 · 数学 2026-01-06 Yuan Zhou , Xinli Shi , Luyao Guo , Jinde Cao , Mahmoud Abdel-Aty

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

数值分析 · 数学 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang