English
Related papers

Related papers: ADMM for Structured Fractional Minimization

200 papers

When the data is distributed across multiple servers, lowering the communication cost between the servers (or workers) while solving the distributed learning problem is an important problem and is the focus of this paper. In particular, we…

Machine Learning · Computer Science 2020-03-25 Anis Elgabli , Jihong Park , Amrit S. Bedi , Mehdi Bennis , Vaneet Aggarwal

The alternating direction multiplier method (ADMM) is widely used in computer graphics for solving optimization problems that can be nonsmooth and nonconvex. It converges quickly to an approximate solution, but can take a long time to…

Optimization and Control · Mathematics 2020-06-29 Wenqing Ouyang , Yue Peng , Yuxin Yao , Juyong Zhang , Bailin Deng

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various convex or nonconvex composite problems that arise in the fields of image & signal processing and machine…

Optimization and Control · Mathematics 2014-12-08 Fenghui Wang , Zongben Xu , Hong-Kun Xu

In this paper we propose two proximal gradient algorithms for fractional programming problems in real Hilbert spaces, where the numerator is a proper, convex and lower semicontinuous function and the denominator is a smooth function, either…

Optimization and Control · Mathematics 2016-02-01 Radu Ioan Bot , Ernö Robert Csetnek

In this paper, we show that for a class of linearly constrained convex composite optimization problems, an (inexact) symmetric Gauss-Seidel based majorized multi-block proximal alternating direction method of multipliers (ADMM) is…

Optimization and Control · Mathematics 2019-01-29 Liang Chen , Xudong Li , Defeng Sun , Kim-Chuan Toh

This paper presents centralized and distributed Alternating Direction Method of Multipliers (ADMM) frameworks for solving large-scale nonconvex optimization problems with binary decision variables subject to spanning tree or rooted…

Optimization and Control · Mathematics 2026-03-10 Yacine Mokhtari

In this paper, we study a constrained minimization problem that arise from materials science to determine the dislocation (line defect) structure of grain boundaries. The problems aims to minimize the energy of the grain boundary with…

Optimization and Control · Mathematics 2024-12-24 Yue Wu , Luchan Zhang , Yang Xiang

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

Optimization and Control · Mathematics 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

In this paper, we propose two low-complexity optimization methods to reduce peak-to-average power ratio (PAPR) values of orthogonal frequency division multiplexing (OFDM) signals via alternating direction method of multipliers (ADMM).…

Signal Processing · Electrical Eng. & Systems 2018-12-26 Yongchao Wang , Yanjiao Wang , Qingjiang Shi

We investigate a class of general combinatorial graph problems, including MAX-CUT and community detection, reformulated as quadratic objectives over nonconvex constraints and solved via the alternating direction method of multipliers…

Systems and Control · Electrical Eng. & Systems 2022-09-09 Chuangchuang Sun

In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper…

Optimization and Control · Mathematics 2022-01-19 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

By coordinating terminal smart devices or microprocessors to engage in cooperative computation to achieve systemlevel targets, distributed optimization is incrementally favored by both engineering and computer science. The well-known…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-24 Yu Yang , Xiaohong Guan , Qing-Shan Jia , Liang Yu , Bolun Xu , Costas J. Spanos

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

Numerical Analysis · Mathematics 2021-04-29 Luke Lozenski , Umberto Villa

In this paper, we investigate a class of nonconvex and nonsmooth fractional programming problems, where the numerator composed of two parts: a convex, nonsmooth function and a differentiable, nonconvex function, and the denominator consists…

Optimization and Control · Mathematics 2025-03-18 Deren Han , Min Tao , Zihao Xia

Zeroth-order (a.k.a, derivative-free) methods are a class of effective optimization methods for solving complex machine learning problems, where gradients of the objective functions are not available or computationally prohibitive.…

Optimization and Control · Mathematics 2023-12-12 Feihu Huang , Shangqian Gao , Jian Pei , Heng Huang

We consider the convex-concave saddle point problem $\min_{\mathbf{x}}\max_{\mathbf{y}}\Phi(\mathbf{x},\mathbf{y})$, where the decision variables $\mathbf{x}$ and/or $\mathbf{y}$ subject to a multi-block structure and affine coupling…

Optimization and Control · Mathematics 2023-03-17 Junyu Zhang , Mengdi Wang , Mingyi Hong , Shuzhong Zhang

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

Machine Learning · Statistics 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

Machine Learning · Computer Science 2022-03-30 Han Wang , Siddartha Marella , James Anderson