Accelerating preconditioned ADMM via degenerate proximal point mappings
Abstract
In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this, we first reformulate the pADMM into a form of proximal point method (PPM) with a positive semidefinite preconditioner which can be degenerate due to the lack of strong convexity of the proximal terms in the pADMM. Then we accelerate the pADMM by accelerating the reformulated degenerate PPM (dPPM). Specifically, we first propose an accelerated dPPM by integrating the Halpern iteration and the fast Krasnosel'ski\u{i}-Mann iteration into it, achieving asymptotic and non-asymptotic convergence rates. Subsequently, building upon the accelerated dPPM, we develop an accelerated pADMM algorithm that exhibits both asymptotic and non-asymptotic nonergodic convergence rates concerning the Karush-Kuhn-Tucker residual and the primal objective function value gap. Preliminary numerical experiments validate the theoretical findings, demonstrating that the accelerated pADMM outperforms the pADMM in solving convex quadratic programming problems.
Keywords
Cite
@article{arxiv.2403.18618,
title = {Accelerating preconditioned ADMM via degenerate proximal point mappings},
author = {Defeng Sun and Yancheng Yuan and Guojun Zhang and Xinyuan Zhao},
journal= {arXiv preprint arXiv:2403.18618},
year = {2024}
}