English
Related papers

Related papers: A Matrix Splitting Method for Composite Function M…

200 papers

A novel compressive-sensing based signal multiplexing scheme is proposed in this paper to further improve the multiplexing gain for multiple input multiple output (MIMO) system. At the transmitter side, a Gaussian random measurement matrix…

Information Theory · Computer Science 2016-04-05 Chanzi Liu , Qingchun Chen , Xiaohu Tang

Stochastic gradient method (SGM) has been popularly applied to solve optimization problems with objective that is stochastic or an average of many functions. Most existing works on SGMs assume that the underlying problem is unconstrained or…

Optimization and Control · Mathematics 2019-06-19 Yangyang Xu

Accompanied with the rising popularity of compressed sensing, the Alternating Direction Method of Multipliers (ADMM) has become the most widely used solver for linearly constrained convex problems with separable objectives. In this work, we…

Numerical Analysis · Computer Science 2016-07-12 Canyi Lu , Jiashi Feng , Shuicheng Yan , Zhouchen Lin

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

This paper examines the problem of state estimation in power distribution systems under low-observability conditions. The recently proposed constrained matrix completion method which combines the standard matrix completion method and power…

Optimization and Control · Mathematics 2020-06-09 Yajing Liu , April Sagan , Andrey Bernstein , Rui Yang , Xinyang Zhou , Yingchen Zhang

The theory of matrix splitting is a useful tool for finding solution of rectangular linear system of equations, iteratively. The purpose of this paper is two-fold. Firstly, we revisit theory of weak regular splittings for rectangular…

Numerical Analysis · Mathematics 2016-08-23 Debasisha Mishra

In this paper, we propose Riemannian conditional gradient methods for minimizing composite functions, i.e., those that can be expressed as the sum of a smooth function and a retraction-based convex function. We analyze the convergence of…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen , Ellen H. Fukuda

Creating low dimensional representations of a high dimensional data set is an important component in many machine learning applications. How to cluster data using their low dimensional embedded space is still a challenging problem in…

Machine Learning · Computer Science 2023-03-27 Zahra Moslehi , Abdolreza Mirzaei , Mehran Safayani

MM (majorization--minimization) algorithms are an increasingly popular tool for solving optimization problems in machine learning and statistical estimation. This article introduces the MM algorithm framework in general and via three…

Computation · Statistics 2016-11-16 Hien D. Nguyen

Consider the problem of minimizing the sum of a smooth convex function and a separable nonsmooth convex function subject to linear coupling constraints. Problems of this form arise in many contemporary applications including signal…

Optimization and Control · Mathematics 2014-01-29 Mingyi Hong , Tsung-Hui Chang , Xiangfeng Wang , Meisam Razaviyayn , Shiqian Ma , Zhi-Quan Luo

In this paper, we consider solving a class of convex optimization problem which minimizes the sum of three convex functions $f(x)+g(x)+h(Bx)$, where $f(x)$ is differentiable with a Lipschitz continuous gradient, $g(x)$ and $h(x)$ have a…

Optimization and Control · Mathematics 2019-04-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

This paper presents an algorithm to solve the Soft k-Means problem globally. Unlike Fuzzy c-Means, Soft k-Means (SkM) has a matrix factorization-type objective and has been shown to have a close relation with the popular probability…

Machine Learning · Computer Science 2022-12-08 Feiping Nie , Hong Chen , Rong Wang , Xuelong Li

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

This monograph presents a theoretical background and a broad introduction to the Min-Max Framework for Majorization-Minimization (MM4MM), an algorithmic methodology for solving minimization problems by formulating them as min-max problems…

Signal Processing · Electrical Eng. & Systems 2024-11-13 Astha Saini , Petre Stoica , Prabhu Babu , Aakash Arora

A polynomial matrix inequality is a formula asserting that a polynomial matrix is positive semidefinite. Polynomial matrix optimization concerns minimizing the smallest eigenvalue of a symmetric polynomial matrix subject to a tuple of…

Optimization and Control · Mathematics 2025-06-06 Jared Miller , Jie Wang , Feng Guo

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

Optimization and Control · Mathematics 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari

Multiresolution Matrix Factorization (MMF) was recently introduced as an alternative to the dominant low-rank paradigm in order to capture structure in matrices at multiple different scales. Using ideas from multiresolution analysis (MRA),…

Numerical Analysis · Mathematics 2019-10-14 Pramod Kaushik Mudrakarta , Shubhendu Trivedi , Risi Kondor

We consider robust submodular maximization problems (RSMs), where given a set of $m$ monotone submodular objective functions, the robustness is with respect to the worst-case (scaled) objective function. The model we consider generalizes…

Optimization and Control · Mathematics 2023-06-12 Hsin-Yi Huang , Hao-Hsiang Wu , Simge Kucukyavuz

In this paper, we provide novel algorithms with identifiability guarantees for simplex-structured matrix factorization (SSMF), a generalization of nonnegative matrix factorization. Current state-of-the-art algorithms that provide…

Machine Learning · Computer Science 2021-05-12 Maryam Abdolali , Nicolas Gillis

This work developed novel complex matrix factorization methods for face recognition; the methods were complex matrix factorization (CMF), sparse complex matrix factorization (SpaCMF), and graph complex matrix factorization (GraCMF). After…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Viet-Hang Duong , Yuan-Shan Lee , Bach-Tung Pham , Seksan Mathulaprangsan , Pham The Bao , Jia-Ching Wang