English
Related papers

Related papers: A New Anchor Word Selection Method for the Separab…

200 papers

Non-negative matrix factorization (NMF) based topic modeling is widely used in natural language processing (NLP) to uncover hidden topics of short text documents. Usually, training a high-quality topic model requires large amount of textual…

Computation and Language · Computer Science 2022-05-27 Shijing Si , Jianzong Wang , Ruiyi Zhang , Qinliang Su , Jing Xiao

Non-negative matrix factorization (NMF) is one of the most popular decomposition techniques for multivariate data. NMF is a core method for many machine-learning related computational problems, such as data compression, feature extraction,…

Numerical Analysis · Computer Science 2017-12-07 Gabriele Torre , Michael Graber

Most existing word embedding methods can be categorized into Neural Embedding Models and Matrix Factorization (MF)-based methods. However some models are opaque to probabilistic interpretation, and MF-based methods, typically solved using…

Computation and Language · Computer Science 2015-08-18 Shaohua Li , Jun Zhu , Chunyan Miao

Symmetric nonnegative matrix factorization (SNMF) has demonstrated to be a powerful method for data clustering. However, SNMF is mathematically formulated as a non-convex optimization problem, making it sensitive to the initialization of…

Machine Learning · Computer Science 2021-03-03 Yuheng Jia , Hui Liu , Junhui Hou , Sam Kwong , Qingfu Zhang

Semi-supervised symmetric non-negative matrix factorization (SNMF) utilizes the available supervisory information (usually in the form of pairwise constraints) to improve the clustering ability of SNMF. The previous methods introduce the…

Machine Learning · Computer Science 2024-10-29 Yuheng Jia , Jia-Nan Li , Wenhui Wu , Ran Wang

Nonnegative matrix factorization (NMF) often relies on the separability condition for tractable algorithm design. Separability-based NMF is mainly handled by two types of approaches, namely, greedy pursuit and convex programming. A notable…

Signal Processing · Electrical Eng. & Systems 2022-07-20 Tri Nguyen , Xiao Fu , Ruiyuan Wu

Classification and topic modeling are popular techniques in machine learning that extract information from large-scale datasets. By incorporating a priori information such as labels or important features, methods have been developed to…

Machine Learning · Computer Science 2022-02-01 Pengyu Li , Christine Tseng , Yaxuan Zheng , Joyce A. Chew , Longxiu Huang , Benjamin Jarman , Deanna Needell

We present a hybrid method for latent information discovery on the data sets containing both text content and connection structure based on constrained low rank approximation. The new method jointly optimizes the Nonnegative Matrix…

Machine Learning · Computer Science 2017-03-29 Rundong Du , Barry Drake , Haesun Park

Non-negative Matrix Factorization (NMF) asks to decompose a (entry-wise) non-negative matrix into the product of two smaller-sized nonnegative matrices, which has been shown intractable in general. In order to overcome this issue, the…

Data Structures and Algorithms · Computer Science 2019-07-15 Zhihuai Chen , Yinan Li , Xiaoming Sun , Pei Yuan , Jialin Zhang

Fully unsupervised topic models have found fantastic success in document clustering and classification. However, these models often suffer from the tendency to learn less-than-meaningful or even redundant topics when the data is biased…

Machine Learning · Computer Science 2021-02-08 Joshua Vendrow , Jamie Haddock , Elizaveta Rebrova , Deanna Needell

Fair clustering is crucial for mitigating bias in unsupervised learning, yet existing algorithms often suffer from quadratic or super-quadratic computational complexity, rendering them impractical for large-scale datasets. To bridge this…

Machine Learning · Computer Science 2025-11-14 Shengfei Wei , Suyuan Liu , Jun Wang , Ke Liang , Miaomiao Li , Lei Luo

Collaborative filtering generates recommendations by exploiting user-item similarities based on rating data, which often contains numerous unrated items. To predict scores for unrated items, matrix factorization techniques such as…

Statistical Mechanics · Physics 2025-07-30 Yukino Terui , Yuka Inoue , Yohei Hamakawa , Kosuke Tatsumura , Kazue Kudo

In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$…

Optimization and Control · Mathematics 2007-05-23 Lorenzo Finesso , Peter Spreij

Nonnegative Matrix Factorization (NMF) is an important unsupervised learning method to extract meaningful features from data. To address the NMF problem within a polynomial time framework, researchers have introduced a separability…

Machine Learning · Computer Science 2025-01-23 Juefei Chen , Longxiu Huang , Yimin Wei

Word feature vectors have been proven to improve many NLP tasks. With recent advances in unsupervised learning of these feature vectors, it became possible to train it with much more data, which also resulted in better quality of learned…

Computation and Language · Computer Science 2022-11-29 Marius Sajgalik , Michal Barla , Maria Bielikova

Topic models, such as Latent Dirichlet Allocation (LDA), posit that documents are drawn from admixtures of distributions over words, known as topics. The inference problem of recovering topics from admixtures, is NP-hard. Assuming…

Machine Learning · Statistics 2014-11-05 Trapit Bansal , Chiranjib Bhattacharyya , Ravindran Kannan

Language model based methods are powerful techniques for text classification. However, the models have several shortcomings. (1) It is difficult to integrate human knowledge such as keywords. (2) It needs a lot of resources to train the…

Computation and Language · Computer Science 2024-02-09 Weijie Xu , Jay Desai , Srinivasan Sengamedu , Xiaoyu Jiang , Francis Iannacci

Non-negative matrix factorization (NMF) is a common method for generating topic models from text data. NMF is widely accepted for producing good results despite its relative simplicity of implementation and ease of computation. One…

Machine Learning · Computer Science 2016-08-09 Brendan Gavin , Vijay Gadepally , Jeremy Kepner

Symmetric nonnegative matrix factorization (SymNMF) is a powerful tool for clustering, which typically uses the $k$-nearest neighbor ($k$-NN) method to construct similarity matrix. However, $k$-NN may mislead clustering since the neighbors…

Machine Learning · Computer Science 2024-12-06 Wenlong Lyu , Yuheng Jia

Nonnegative matrix factorization (NMF) is a widely used tool for learning parts-based, low-dimensional representations of nonnegative data, with applications in vision, text, and bioinformatics. In clustering applications, orthogonal NMF…

Machine Learning · Computer Science 2025-12-10 Manh Nguyen , Daniel Pimentel-Alarcón