English
Related papers

Related papers: Topic supervised non-negative matrix factorization

200 papers

Non-negative matrix factorization (NMF) is a technique for finding latent representations of data. The method has been applied to corpora to construct topic models. However, NMF has likelihood assumptions which are often violated by real…

Machine Learning · Statistics 2017-11-22 Skyler Seto , Sarah Tan , Giles Hooker , Martin T. Wells

In our study, we propose a self-supervised neural topic model (NTM) that combines the power of NTMs and regularized self-supervised learning methods to improve performance. NTMs use neural networks to learn latent topics hidden behind the…

Machine Learning · Computer Science 2025-02-27 Weiran Xu , Kengo Hirami , Koji Eguchi

In an effort to develop topic modeling methods that can be quickly applied to large data sets, we revisit the problem of maximum-likelihood estimation in topic models. It is known, at least informally, that maximum-likelihood estimation in…

Machine Learning · Statistics 2026-02-10 Peter Carbonetto , Abhishek Sarkar , Zihao Wang , Matthew Stephens

We introduce a new method based on nonnegative matrix factorization, Neural NMF, for detecting latent hierarchical structure in data. Datasets with hierarchical structure arise in a wide variety of fields, such as document classification,…

Machine Learning · Computer Science 2023-03-02 Tyler Will , Runyu Zhang , Eli Sadovnik , Mengdi Gao , Joshua Vendrow , Jamie Haddock , Denali Molitor , Deanna Needell

Non-negative matrix factorization (NMF) is a recently developed technique for finding parts-based, linear representations of non-negative data. Although it has successfully been applied in several applications, it does not always result in…

Machine Learning · Computer Science 2007-05-23 Patrik O. Hoyer

In this paper, we propose a new Semi-Nonnegative Matrix Factorization method for 2-dimensional (2D) data, named TS-NMF. It overcomes the drawback of existing methods that seriously damage the spatial information of the data by converting 2D…

Machine Learning · Computer Science 2020-05-20 Chong Peng , Zhilu Zhang , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Non-negative matrix factorization (NMF) and non-negative tensor factorization (NTF) decompose non-negative high-dimensional data into non-negative low-rank components. NMF and NTF methods are popular for their intrinsic interpretability and…

Machine Learning · Computer Science 2024-12-02 Alexander Sietsema , Zerrin Vural , James Chapman , Yotam Yaniv , Deanna Needell

Nonnegative matrix factorization (NMF) is a popular model in the field of pattern recognition. It aims to find a low rank approximation for nonnegative data M by a product of two nonnegative matrices W and H. In general, NMF is NP-hard to…

Machine Learning · Computer Science 2021-09-07 Junjun Pan , Michael K. Ng

Language model based methods are powerful techniques for text classification. However, the models have several shortcomings. (1) It is difficult to integrate human knowledge such as keywords. (2) It needs a lot of resources to train the…

Computation and Language · Computer Science 2024-02-09 Weijie Xu , Jay Desai , Srinivasan Sengamedu , Xiaoyu Jiang , Francis Iannacci

Symmetric nonnegative matrix factorization (SNMF) has demonstrated to be a powerful method for data clustering. However, SNMF is mathematically formulated as a non-convex optimization problem, making it sensitive to the initialization of…

Machine Learning · Computer Science 2021-03-03 Yuheng Jia , Hui Liu , Junhui Hou , Sam Kwong , Qingfu Zhang

Nonnegative matrix factorization (NMF) is a linear dimensionality technique for nonnegative data with applications such as image analysis, text mining, audio source separation and hyperspectral unmixing. Given a data matrix $M$ and a…

Machine Learning · Computer Science 2021-04-14 Junjun Pan , Nicolas Gillis

In this work we perform some mathematical analysis on non-negative matrix factorizations (NMF) and apply NMF to some imaging and inverse problems. We will propose a sparse low-rank approximation of big positive data and images in terms of…

Optimization and Control · Mathematics 2015-04-24 Yat Tin Chow , Kazufumi Ito , Jun Zou

Nonnegative Matrix Factorization (NMF) has been a popular representation method for pattern classification problem. It tries to decompose a nonnegative matrix of data samples as the product of a nonnegative basic matrix and a nonnegative…

Machine Learning · Statistics 2013-12-06 Jim Jing-Yan Wang

This paper investigates a non-negative matrix factorization (NMF)-based approach to the semi-supervised single-channel speech enhancement problem where only non-stationary additive noise signals are given. The proposed method relies on…

Sound · Computer Science 2013-09-25 Nikolay Lyubimov , Mikhail Kotov

Nonnegative matrix factorization (NMF) has become a widely used tool for the analysis of high-dimensional data as it automatically extracts sparse and meaningful features from a set of nonnegative data vectors. We first illustrate this…

Machine Learning · Statistics 2014-12-10 Nicolas Gillis

Non-negative Matrix Factorization (NMF) is an intensively used technique for obtaining parts-based, lower dimensional and non-negative representation. Researchers in biology, medicine, pharmacy and other fields often prefer NMF over other…

Machine Learning · Computer Science 2025-02-04 Matej Mihelčić , Pauli Miettinen

Nonnegative matrix factorization (NMF) has become a workhorse for signal and data analytics, triggered by its model parsimony and interpretability. Perhaps a bit surprisingly, the understanding to its model identifiability---the major…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Xiao Fu , Kejun Huang , Nicholas D. Sidiropoulos , Wing-Kin Ma

Topic models have been prevalent for decades to discover latent topics and infer topic proportions of documents in an unsupervised fashion. They have been widely used in various applications like text analysis and context recommendation.…

Computation and Language · Computer Science 2024-06-25 Xiaobao Wu , Thong Nguyen , Anh Tuan Luu

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for nonnegative data, with applications such as hyperspectral unmixing and topic modeling. NMF is a difficult problem in general (NP-hard), and its…

Numerical Analysis · Mathematics 2025-11-11 Junjun Pan , Valentin Leplat , Michael Ng , Nicolas Gillis

Nonnegative Matrix Factorization (NMF) is an important unsupervised learning method to extract meaningful features from data. To address the NMF problem within a polynomial time framework, researchers have introduced a separability…

Machine Learning · Computer Science 2025-01-23 Juefei Chen , Longxiu Huang , Yimin Wei