English
Related papers

Related papers: A Non-monotone Alternating Updating Method for A C…

200 papers

This article introduces new multiplicative updates for nonnegative matrix factorization with the $\beta$-divergence and sparse regularization of one of the two factors (say, the activation matrix). It is well known that the norm of the…

Machine Learning · Computer Science 2024-03-13 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals…

Machine Learning · Computer Science 2015-05-05 Nirav Bhatt , Arun Ayyar

In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$…

Optimization and Control · Mathematics 2007-05-23 Lorenzo Finesso , Peter Spreij

This paper proposes a multiblock alternating direction method of multipliers for solving a class of multiblock nonsmooth nonconvex optimization problem with nonlinear coupling constraints. We employ a majorization minimization procedure in…

Optimization and Control · Mathematics 2023-12-05 Le Thi Khanh Hien , Dimitri Papadimitriou

This work proposes an efficient parallel algorithm for non-monotone submodular maximization under a knapsack constraint problem over the ground set of size $n$. Our algorithm improves the best approximation factor of the existing parallel…

Artificial Intelligence · Computer Science 2024-09-09 Tan D. Tran , Canh V. Pham , Dung T. K. Ha , Phuong N. H. Pham

Given a matrix $M\in \mathbb{R}^{m\times n}$, the low rank matrix completion problem asks us to find a rank-$k$ approximation of $M$ as $UV^\top$ for $U\in \mathbb{R}^{m\times k}$ and $V\in \mathbb{R}^{n\times k}$ by only observing a few…

Machine Learning · Computer Science 2024-04-03 Yuzhou Gu , Zhao Song , Junze Yin , Lichen Zhang

A matrix completion problem is to recover the missing entries in a partially observed matrix. Most of the existing matrix completion methods assume a low rank structure of the underlying complete matrix. In this paper, we introduce an…

Machine Learning · Statistics 2020-11-16 Chencheng Cai , Rong Chen , Han Xiao

Nonconvex and nonsmooth bi-level optimization poses critical theoretical challenges, while arising in several applications. In this work, we develop a method for nonconvex, nonsmooth bi-level optimization and introduce Binno, a first-order…

Optimization and Control · Mathematics 2026-05-05 Laura Selicato , Flavia Esposito , Andersen Ang

In this paper, we introduce a graph matching method that can account for constraints of arbitrary order, with arbitrary potential functions. Unlike previous decomposition approaches that rely on the graph structures, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 D. Khuê Lê-Huu , Nikos Paragios

Matrix factorization techniques, especially Nonnegative Matrix Factorization (NMF), have been widely used for dimensionality reduction and interpretable data representation. However, existing NMF-based methods are inherently single-scale…

Machine Learning · Computer Science 2026-02-27 Jichao Zhang , Ran Miao , Limin Li

This paper considers a restriction to non-negative matrix factorization in which at least one matrix factor is stochastic. That is, the elements of the matrix factors are non-negative and the columns of one matrix factor sum to 1. This…

Machine Learning · Statistics 2016-09-20 Christopher Adams

For some typical and widely used non-convex half-quadratic regularization models and the Ambrosio-Tortorelli approximate Mumford-Shah model, based on the Kurdyka-\L ojasiewicz analysis and the recent nonconvex proximal algorithms, we…

Optimization and Control · Mathematics 2021-07-30 Shengxiang Deng , Ismail Ben Ayed , Hongpeng Sun

Non-negative matrix factorization (NMF) is the problem of determining two non-negative low rank factors $W$ and $H$, for the given input matrix $A$, such that $A \approx W H$. NMF is a useful tool for many applications in different domains…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-30 Ramakrishnan Kannan , Grey Ballard , Haesun Park

Matrix completion is a class of machine learning methods that concerns the prediction of missing entries in a partially observed matrix. This paper studies matrix completion for mixed data, i.e., data involving mixed types of variables…

Machine Learning · Statistics 2022-11-18 Yunxiao Chen , Xiaoou Li

The symmetric Nonnegative Matrix Factorization (NMF), a special but important class of the general NMF, has found numerous applications in data analysis such as various clustering tasks. Unfortunately, designing fast algorithms for the…

Machine Learning · Computer Science 2023-01-26 Xiao Li , Zhihui Zhu , Qiuwei Li , Kai Liu

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

Machine Learning · Computer Science 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

The multiplicative update (MU) algorithm has been extensively used to estimate the basis and coefficient matrices in nonnegative matrix factorization (NMF) problems under a wide range of divergences and regularizers. However, theoretical…

Optimization and Control · Mathematics 2017-06-08 Renbo Zhao , Vincent Y. F. Tan

Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized…

Optimization and Control · Mathematics 2024-05-21 Wenjing Li , Wei Bian , Kim-Chuan Toh

Clustering with incomplete views is a challenge in multi-view clustering. In this paper, we provide a novel and simple method to address this issue. Specifically, the proposed method simultaneously exploits the local information of each…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Jie Wen , Zheng Zhang , Yong Xu , Zuofeng Zhong

The Nonnegative Matrix Factorization (NMF) of the rating matrix has shown to be an effective method to tackle the recommendation problem. In this paper we propose new methods based on the NMF of the rating matrix and we compare them with…

Machine Learning · Computer Science 2019-08-30 Gianna M. Del Corso , Francesco Romani