中文
相关论文

相关论文: Provably Convergent Plug & Play Linearized ADMM, a…

200 篇论文

We consider the problem of minimizing block-separable convex functions subject to linear constraints. While the Alternating Direction Method of Multipliers (ADMM) for two-block linear constraints has been intensively studied both…

最优化与控制 · 数学 2014-09-15 Huahua Wang , Arindam Banerjee , Zhi-Quan Luo

Plug-and-play priors (PnP) is a popular framework for regularized signal reconstruction by using advanced denoisers within an iterative algorithm. In this paper, we discuss our recent online variant of PnP that uses only a subset of…

信号处理 · 电气工程与系统科学 2018-11-12 Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

最优化与控制 · 数学 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

The alternating direction method of multipliers (ADMM) has been applied successfully in a broad spectrum of areas. Moreover, it was shown in the literature that ADMM is closely related to the Douglas-Rachford operator-splitting method, and…

最优化与控制 · 数学 2024-01-10 Renyuan Ni

The day-ahead electricity market clearing with nonconvex order types can be formulated as a mixed-integer linear program (MILP), but its LP relaxation may provide weak bounds, and exact solutions can become computationally intractable in…

系统与控制 · 电气工程与系统科学 2026-05-07 Shudian Zhao , Mohammad Reza Karimi Gharigh , Jan Kronqvist , Mohammad Reza Hesamzadeh

Generic deep learning (DL) networks for image restoration like denoising and interpolation lack mathematical interpretability, require voluminous training data to tune a large parameter set, and are fragile in the face of covariate shift.…

图像与视频处理 · 电气工程与系统科学 2025-03-13 Jianghe Cai , Gene Cheung , Fei Chen

Recent advances in neural-network architecture allow for seamless integration of convex optimization problems as differentiable layers in an end-to-end trainable neural network. Integrating medium and large scale quadratic programs into a…

最优化与控制 · 数学 2021-12-15 Andrew Butler , Roy Kwon

We analyse the convergence of an approximate, fully inexact, ADMM algorithm under additive, deterministic and probabilistic error models. We consider the generalized ADMM scheme that is derived from generalized Lagrangian penalty with…

最优化与控制 · 数学 2022-10-06 Anis Hamadouche , Yun Wu , Andrew M. Wallace , Joao F. C. Mota

This paper presents a majorized alternating direction method of multipliers (ADMM) with indefinite proximal terms for solving linearly constrained $2$-block convex composite optimization problems with each block in the objective being the…

最优化与控制 · 数学 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

In this work we propose a novel postprocessing technique for compression-artifact reduction. Our approach is based on posing this task as an inverse problem, with a regularization that leverages on existing state-of-the-art image denoising…

计算机视觉与模式识别 · 计算机科学 2016-06-29 Yehuda Dar , Alfred M. Bruckstein , Michael Elad , Raja Giryes

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

机器学习 · 统计学 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

In this paper we study nonconvex and nonsmooth optimization problems with semi-algebraic data, where the variables vector is split into several blocks of variables. The problem consists of one smooth function of the entire variables vector…

最优化与控制 · 数学 2017-02-09 Thomas Pock , Shoham Sabach

A common approach to solve inverse imaging problems relies on finding a maximum a posteriori (MAP) estimate of the original unknown image, by solving a minimization problem. In thiscontext, iterative proximal algorithms are widely used,…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Hoang Trieu Vy Le , Audrey Repetti , Nelly Pustelnik

Recent work has shown the effectiveness of the plug-and-play priors (PnP) framework for regularized image reconstruction. However, the performance of PnP depends on the quality of the denoisers used as priors. In this letter, we design a…

图像与视频处理 · 电气工程与系统科学 2020-04-22 Guangxiao Song , Yu Sun , Jiaming Liu , Zhijie Wang , Ulugbek S. Kamilov

The Alternating Direction Method of Multipliers (ADMM) and its distributed version have been widely used in machine learning. In the iterations of ADMM, model updates using local private data and model exchanges among agents impose critical…

机器学习 · 计算机科学 2020-08-12 Jiahao Ding , Jingyi Wang , Guannan Liang , Jinbo Bi , Miao Pan

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpropagation-based approaches, our methods inherently mitigate…

机器学习 · 计算机科学 2025-04-01 Jintao Xu , Yifei Li , Wenxun Xing

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

最优化与控制 · 数学 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

Plug-and-Play (PnP) methods have become standard tools for solving imaging inverse problems by replacing the intractable maximum a posteriori (MAP) denoiser with the MMSE one. While this mismatch has been widely treated as unavoidable,…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Kenta Vert , Giacomo Meanti , Scott Pesme , Michael Arbel , Julien Mairal

Regularized inversion methods for image reconstruction are used widely due to their tractability and ability to combine complex physical sensor models with useful regularity criteria. Such methods motivated the recently developed…

计算机视觉与模式识别 · 计算机科学 2018-06-14 Gregery T. Buzzard , Stanley H. Chan , Suhas Sreehari , Charles A. Bouman