English
Related papers

Related papers: Exact multiplicative updates for convolutional $\b…

200 papers

In this letter, we generalize the convolutional NMF by taking the $\beta$-divergence as the contrast function and present the correct multiplicative updates for its factors in closed form. The new updates unify the $\beta$-NMF and the…

Machine Learning · Computer Science 2019-06-11 Pedro J. Villasana T. , Stanislaw Gorlow , Arvind T. Hariraman

Nonnegative matrix factorization (NMF) is the problem of approximating an input nonnegative matrix, $V$, as the product of two smaller nonnegative matrices, $W$ and $H$. In this paper, we introduce a general framework to design…

Machine Learning · Computer Science 2022-04-29 Valentin Leplat , Nicolas Gillis , Jérôme Idier

This article proposes new multiplicative updates for nonnegative matrix factorization (NMF) with the $\beta$-divergence objective function. Our new updates are derived from a joint majorization-minimization (MM) scheme, in which an…

Machine Learning · Computer Science 2023-04-18 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

The multiplicative update (MU) algorithm has been extensively used to estimate the basis and coefficient matrices in nonnegative matrix factorization (NMF) problems under a wide range of divergences and regularizers. However, theoretical…

Optimization and Control · Mathematics 2017-06-08 Renbo Zhao , Vincent Y. F. Tan

This paper describes algorithms for nonnegative matrix factorization (NMF) with the beta-divergence (beta-NMF). The beta-divergence is a family of cost functions parametrized by a single shape parameter beta that takes the Euclidean…

Machine Learning · Computer Science 2011-03-09 Cédric Févotte , Jérôme Idier

This article introduces new multiplicative updates for nonnegative matrix factorization with the $\beta$-divergence and sparse regularization of one of the two factors (say, the activation matrix). It is well known that the norm of the…

Machine Learning · Computer Science 2024-03-13 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

Non-negative matrix factorization (NMF) is a fundamental non-convex optimization problem with numerous applications in Machine Learning (music analysis, document clustering, speech-source separation etc). Despite having received extensive…

Machine Learning · Computer Science 2020-03-20 Ioannis Panageas , Stratis Skoulakis , Antonios Varvitsiotis , Xiao Wang

Identifying recurring patterns in high-dimensional time series data is an important problem in many scientific domains. A popular model to achieve this is convolutive nonnegative matrix factorization (CNMF), which extends classic…

Machine Learning · Computer Science 2019-07-02 Anthony Degleris , Ben Antin , Surya Ganguli , Alex H Williams

Deep Nonnegative Matrix Factorization (deep NMF) has recently emerged as a valuable technique for extracting multiple layers of features across different scales. However, all existing deep NMF models and algorithms have primarily centered…

Machine Learning · Computer Science 2025-01-10 Valentin Leplat , Le Thi Khanh Hien , Akwum Onwunta , Nicolas Gillis

Despite the ubiquity of multiway data across scientific domains, there are few user-friendly tools that fit tailored nonnegative tensor factorizations. Researchers may use gradient-based automatic differentiation (which often struggles in…

Machine Learning · Statistics 2026-02-10 John Hood , Aaron Schein

Nonnegative matrix factorization (NMF) is an emerging technique with a wide spectrum of potential applications in data analysis. Mathematically, NMF can be formulated as a minimization problem with nonnegative constraints. This problem is…

Data Structures and Algorithms · Computer Science 2012-12-27 Tran Dang Hien , Do Van Tuan , Pham Van At

We propose a Block Majorization Minimization method with Extrapolation (BMMe) for solving a class of multi-convex optimization problems. The extrapolation parameters of BMMe are updated using a novel adaptive update rule. By showing that…

Machine Learning · Computer Science 2025-09-03 Le Thi Khanh Hien , Valentin Leplat , Nicolas Gillis

Many datasets are obtained as a resolution trade-off between two adversarial dimensions; for example between the frequency and the temporal resolutions for the spectrogram of an audio signal, and between the number of wavelengths and the…

Signal Processing · Electrical Eng. & Systems 2021-12-20 Valentin Leplat , Nicolas Gillis , Cédric Févotte

Non-negative matrix factorisation (NMF) is a widely used tool for unsupervised learning and feature extraction, with applications ranging from genomics to text analysis and signal processing. Standard formulations of NMF are typically…

Machine Learning · Computer Science 2026-03-11 Elisabeth Sommer James , Asger Hobolth , Marta Pelizzola

Nonnegative matrix factorization (NMF) is a data analysis technique used in a great variety of applications such as text mining, image processing, hyperspectral data analysis, computational biology, and clustering. In this paper, we…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

In this paper we explore avenues for improving the reliability of dimensionality reduction methods such as Non-Negative Matrix Factorization (NMF) as interpretive exploratory data analysis tools. We first explore the difficulties of the…

Artificial Intelligence · Computer Science 2009-04-22 Nikolaos Vasiloglou , Alexander G. Gray , David V. Anderson

A convergent algorithm for nonnegative matrix factorization with orthogonality constraints imposed on both factors is proposed in this paper. This factorization concept was first introduced by Ding et al. with intent to further improve…

Machine Learning · Computer Science 2018-11-16 Andri Mirzal

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications. Most existing variations of NMF only consider how each row/column vector of factorised matrices should be shaped, and…

Machine Learning · Computer Science 2019-07-09 Shuai Jiang , Kan Li , Richard Yida Xu

The circular $\beta$ ensemble for $\beta =1,2$ and 4 corresponds to circular orthogonal, unitary and symplectic ensemble respectively as introduced by Dyson. The statistical state of the eigenvalues is then a determinantal point process…

Mathematical Physics · Physics 2025-09-08 Peter J. Forrester , Bo-Jian Shen

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL)…

Computer Vision and Pattern Recognition · Computer Science 2014-05-12 Le Li , Jianjun Yang , Kaili Zhao , Yang Xu , Honggang Zhang , Zhuoyi Fan
‹ Prev 1 2 3 10 Next ›