English
Related papers

Related papers: Efficient ADMM and Splitting Methods for Continuou…

200 papers

The alternating direction method of multipliers (ADMM) is widely used to solve large-scale linearly constrained optimization problems, convex or nonconvex, in many engineering fields. However there is a general lack of theoretical…

Optimization and Control · Mathematics 2015-12-01 Mingyi Hong , Zhi-Quan Luo , Meisam Razaviyayn

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

Optimization and Control · Mathematics 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

Machine Learning · Computer Science 2013-08-19 Leon Wenliang Zhong , James T. Kwok

Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…

Optimization and Control · Mathematics 2023-01-25 Guilherme França , Daniel P. Robinson , René Vidal

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

Interior point methods solve small to medium sized problems to high accuracy in a reasonable amount of time. However, for larger problems as well as stochastic problems, one needs to use first-order methods such as stochastic gradient…

Optimization and Control · Mathematics 2016-10-14 Reza Takapoui , Hamid Javadi

This paper proposes a two-level distributed algorithmic framework for solving the AC optimal power flow (OPF) problem with convergence guarantees. The presence of highly nonconvex constraints in OPF poses significant challenges to…

Optimization and Control · Mathematics 2021-06-14 Kaizhao Sun , Xu Andy Sun

Recent advances in neural-network architecture allow for seamless integration of convex optimization problems as differentiable layers in an end-to-end trainable neural network. Integrating medium and large scale quadratic programs into a…

Optimization and Control · Mathematics 2021-12-15 Andrew Butler , Roy Kwon

An alternating direction method of multipliers (ADMM) solver is described for optimal resource allocation problems with separable convex quadratic costs and constraints and linear coupling constraints. We describe a parallel implementation…

Optimization and Control · Mathematics 2019-07-09 Zawar Qureshi , Sebastian East , Mark Cannon

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this,…

Optimization and Control · Mathematics 2024-12-10 Defeng Sun , Yancheng Yuan , Guojun Zhang , Xinyuan Zhao

This paper proposes a novel numerical method for solving the problem of decision making under cumulative prospect theory (CPT), where the goal is to maximize utility subject to practical constraints, assuming only finite realizations of the…

Optimization and Control · Mathematics 2024-04-29 Xiangyu Cui , Rujun Jiang , Yun Shi , Rufeng Xiao , Yifan Yan

This paper investigates the role of feasible initial guesses and large consensus-violation penalization in distributed optimization for Optimal Power Flow (OPF) problems. Specifically, we discuss the behavior of the Alternating Direction of…

Systems and Control · Computer Science 2019-04-02 Alexander Engelmann , Timm Faulwasser

We introduce a generalization of the linearized Alternating Direction Method of Multipliers to optimize a real-valued function $f$ of multiple arguments with potentially multiple constraints $g_\circ$ on each of them. The function $f$ may…

Optimization and Control · Mathematics 2019-01-28 Fred Moolekamp , Peter Melchior

We present an Alternating Direction Method of Multipliers (ADMM) algorithm for solving optimization problems with an l_1 regularized least-squares cost function subject to recursive equality constraints. The considered optimization problem…

Systems and Control · Computer Science 2012-03-20 Mariette Annergren , Anders Hansson , Bo Wahlberg

Although originally designed and analyzed for convex problems, the alternating direction method of multipliers (ADMM) and its close relatives, Douglas-Rachford splitting (DRS) and Peaceman-Rachford splitting (PRS), have been observed to…

Optimization and Control · Mathematics 2020-02-25 Andreas Themelis , Panagiotis Patrinos

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

Alternating Direction Method of Multipliers (ADMM) algorithm has been widely adopted for solving the distributed optimization problem (DOP). In this paper, a new distributed parallel ADMM algorithm is proposed, which allows the agents to…

Optimization and Control · Mathematics 2021-11-23 Ziye Liu , Fanghong Guo , Wei Wang , Xiaoqun Wu
‹ Prev 1 3 4 5 6 7 10 Next ›