中文
相关论文

相关论文: Majorization-minimization for Sparse Nonnegative M…

200 篇论文

This paper addresses the estimation of the latent dimensionality in nonnegative matrix factorization (NMF) with the \beta-divergence. The \beta-divergence is a family of cost functions that includes the squared Euclidean distance,…

机器学习 · 统计学 2012-10-08 Vincent Y. F. Tan , Cédric Févotte

In this paper, we propose a general class of algorithms for optimizing an extensive variety of nonsmoothly penalized objective functions that satisfy certain regularity conditions. The proposed framework utilizes the…

统计计算 · 统计学 2011-01-24 Elizabeth D. Schifano , Robert L. Strawderman , Martin T. Wells

Non-negative matrix factorization (NMF) has become a popular machine learning approach to many problems in text mining, speech and image processing, bio-informatics and seismic data analysis to name a few. In NMF, a matrix of non-negative…

数值分析 · 计算机科学 2013-03-19 Hugo Van hamme

We propose an iterative algorithm for the minimization of a $\ell_1$-norm penalized least squares functional, under additional linear constraints. The algorithm is fully explicit: it uses only matrix multiplications with the three matrices…

数值分析 · 数学 2012-02-16 Ignace Loris , Caroline Verhoeven

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

信号处理 · 电气工程与系统科学 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

A theoretical framework for non-negative matrix factorization based on generalized dual Kullback-Leibler divergence, which includes members of the exponential family of models, is proposed. A family of algorithms is developed using this…

机器学习 · 统计学 2019-05-20 Karthik Devarajan

Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation is needed. Conventional approximation approaches factorize…

机器学习 · 计算机科学 2021-09-20 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

Non-negative matrix factorization (NMF) is a recently developed technique for finding parts-based, linear representations of non-negative data. Although it has successfully been applied in several applications, it does not always result in…

机器学习 · 计算机科学 2007-05-23 Patrik O. Hoyer

Substantial progress has been made recently on developing provably accurate and efficient algorithms for low-rank matrix factorization via nonconvex optimization. While conventional wisdom often takes a dim view of nonconvex optimization…

机器学习 · 计算机科学 2019-10-23 Yuejie Chi , Yue M. Lu , Yuxin Chen

Block majorization-minimization (BMM) is a simple iterative algorithm for constrained nonconvex optimization that sequentially minimizes majorizing surrogates of the objective function in each block while the others are held fixed. BMM…

最优化与控制 · 数学 2025-01-22 Hanbaek Lyu , Yuchen Li

In this paper we consider a general matrix factorization model which covers a large class of existing models with many applications in areas such as machine learning and imaging sciences. To solve this possibly nonconvex, nonsmooth and…

最优化与控制 · 数学 2018-05-16 Lei Yang , Ting Kei Pong , Xiaojun Chen

We present theoretical guarantees for an alternating minimization algorithm for the dictionary learning/sparse coding problem. The dictionary learning problem is to factorize vector samples $y^{1},y^{2},\ldots, y^{n}$ into an appropriate…

机器学习 · 统计学 2019-08-01 Niladri S. Chatterji , Peter L. Bartlett

This paper develops a new class of nonconvex regularizers for low-rank matrix recovery. Many regularizers are motivated as convex relaxations of the matrix rank function. Our new factor group-sparse regularizers are motivated as a…

机器学习 · 计算机科学 2019-11-19 Jicong Fan , Lijun Ding , Yudong Chen , Madeleine Udell

We study the sparse non-negative least squares (S-NNLS) problem. S-NNLS occurs naturally in a wide variety of applications where an unknown, non-negative quantity must be recovered from linear measurements. We present a unified framework…

Nonnegative matrix factorization (NMF) is a data analysis technique used in a great variety of applications such as text mining, image processing, hyperspectral data analysis, computational biology, and clustering. In this paper, we…

最优化与控制 · 数学 2012-08-13 Nicolas Gillis , François Glineur

Nonnegative Matrix Factorization (NMF) is a versatile and powerful tool for discovering latent structures in data matrices, with many variations proposed in the literature. Recently, Leplat et al.\@ (2019) introduced a minimum-volume NMF…

机器学习 · 统计学 2023-09-26 Duc Toan Nguyen , Eric C. Chi

This article utilizes the projected gradient method (PG) for a non-negative matrix factorization problem (NMF), where one or both matrix factors must have orthonormal columns or rows. We penalise the orthonormality constraints and apply the…

最优化与控制 · 数学 2020-03-24 Soodabeh Asadi , Janez Povh

Matrix factorization is an inference problem that has acquired importance due to its vast range of applications that go from dictionary learning to recommendation systems and machine learning with deep networks. The study of its fundamental…

无序系统与神经网络 · 物理学 2023-08-01 Francesco Camilli , Marc Mézard

Nonnegative matrix factorization (NMF) is a popular method in machine learning and signal processing to decompose a given nonnegative matrix into two nonnegative matrices. In this paper, we propose new algorithms, called…

最优化与控制 · 数学 2025-09-29 Shota Takahashi , Mirai Tanaka , Shiro Ikeda

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL)…

计算机视觉与模式识别 · 计算机科学 2014-05-12 Le Li , Jianjun Yang , Kaili Zhao , Yang Xu , Honggang Zhang , Zhuoyi Fan