中文
相关论文

相关论文: Statistically Optimal K-means Clustering via Nonne…

200 篇论文

In the non-negative matrix factorization (NMF) problem, the input is an $m\times n$ matrix $M$ with non-negative entries and the goal is to factorize it as $M\approx AW$. The $m\times k$ matrix $A$ and the $k\times n$ matrix $W$ are both…

数据结构与算法 · 计算机科学 2021-03-09 Moses Charikar , Lunjia Hu

Text clustering is arguably one of the most important topics in modern data mining. Nevertheless, text data require tokenization which usually yields a very large and highly sparse term-document matrix, which is usually difficult to process…

机器学习 · 计算机科学 2020-02-25 Ali Hassani , Amir Iranmanesh , Najme Mansouri

Nonnegative Matrix Factorization (NMF) has been a popular representation method for pattern classification problem. It tries to decompose a nonnegative matrix of data samples as the product of a nonnegative basic matrix and a nonnegative…

机器学习 · 统计学 2013-12-06 Jim Jing-Yan Wang

Semidefinite programs (SDPs) can be solved in polynomial time by interior point methods, but scalability can be an issue. To address this shortcoming, over a decade ago, Burer and Monteiro proposed to solve SDPs with few equality…

最优化与控制 · 数学 2018-04-12 Nicolas Boumal , Vladislav Voroninski , Afonso S. Bandeira

Given a matrix $M$ (not necessarily nonnegative) and a factorization rank $r$, semi-nonnegative matrix factorization (semi-NMF) looks for a matrix $U$ with $r$ columns and a nonnegative matrix $V$ with $r$ rows such that $UV$ is the best…

数值分析 · 数学 2015-10-28 Nicolas Gillis , Abhishek Kumar

Various Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks, such as clustering, or to preserve some structural properties in the reduced space (e.g., local…

Positive semidefinite matrix factorization (PSDMF) expresses each entry of a nonnegative matrix as the inner product of two positive semidefinite (psd) matrices. When all these psd matrices are constrained to be diagonal, this model is…

信号处理 · 电气工程与系统科学 2021-07-07 Dana Lahat , Yanbin Lang , Vincent Y. F. Tan , Cédric Févotte

This paper studies high-dimensional sparse clustering, a combinatorial NP-hard problem arising from the bilinear coupling between cluster assignment and feature selection. We analyze semidefinite programming (SDP) relaxations of $K$-means…

统计方法学 · 统计学 2026-02-17 Jongmin Mun , Paromita Dubey , Yingying Fan

Non-negative matrix factorization (NMF) is a common method for generating topic models from text data. NMF is widely accepted for producing good results despite its relative simplicity of implementation and ease of computation. One…

机器学习 · 计算机科学 2016-08-09 Brendan Gavin , Vijay Gadepally , Jeremy Kepner

We consider the NP-hard problem of minimizing a convex quadratic function over the integer lattice ${\bf Z}^n$. We present a simple semidefinite programming (SDP) relaxation for obtaining a nontrivial lower bound on the optimal value of the…

最优化与控制 · 数学 2017-03-16 Jaehyun Park , Stephen Boyd

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

最优化与控制 · 数学 2012-08-13 Nicolas Gillis , François Glineur

K-means is a classical clustering algorithm with wide applications. However, soft K-means, or fuzzy c-means at m=1, remains unsolved since 1981. To address this challenging open problem, we propose a novel clustering model, i.e.…

机器学习 · 计算机科学 2020-11-23 Yujian Li , Bowen Liu , Zhaoying Liu , Ting Zhang

The $k$-means algorithm is arguably the most popular nonparametric clustering method but cannot generally be applied to datasets with incomplete records. The usual practice then is to either impute missing values under an assumed…

机器学习 · 统计学 2018-09-11 Andrew Lithio , Ranjan Maitra

We present a new probabilistic model to address semi-nonnegative matrix factorization (SNMF), called Skellam-SNMF. It is a hierarchical generative model consisting of prior components, Skellam-distributed hidden variables and observed data.…

机器学习 · 计算机科学 2021-07-08 Benoit Fuentes , Gaël Richard

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL)…

计算机视觉与模式识别 · 计算机科学 2014-05-12 Le Li , Jianjun Yang , Kaili Zhao , Yang Xu , Honggang Zhang , Zhuoyi Fan

The k-means clustering algorithm is a popular algorithm that partitions data into k clusters. There are many improvements to accelerate the standard algorithm. Most current research employs upper and lower bounds on point-to-cluster…

机器学习 · 计算机科学 2024-10-22 Andreas Lang , Erich Schubert

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for analyzing nonnegative data. A key aspect of NMF is the choice of the objective function that depends on the noise model (or statistics of the noise)…

机器学习 · 计算机科学 2021-02-10 Nicolas Gillis , Le Thi Khanh Hien , Valentin Leplat , Vincent Y. F. Tan

Mixture models are among the most popular tools for clustering. However, when the dimension and the number of clusters is large, the estimation of the clusters become challenging, as well as their interpretation. Restriction on the…

应用统计 · 统计学 2021-05-11 Léna Carel , Pierre Alquier

Nonnegative matrix factorization (NMF) has become a widely used tool for the analysis of high-dimensional data as it automatically extracts sparse and meaningful features from a set of nonnegative data vectors. We first illustrate this…

机器学习 · 统计学 2014-12-10 Nicolas Gillis

The problem of finding overlapping communities in networks has gained much attention recently. Optimization-based approaches use non-negative matrix factorization (NMF) or variants, but the global optimum cannot be provably attained in…

机器学习 · 统计学 2017-06-26 Xueyu Mao , Purnamrita Sarkar , Deepayan Chakrabarti