English
Related papers

Related papers: An Online Expectation-Maximisation Algorithm for N…

200 papers

In the non-negative matrix factorization (NMF) problem, the input is an $m\times n$ matrix $M$ with non-negative entries and the goal is to factorize it as $M\approx AW$. The $m\times k$ matrix $A$ and the $k\times n$ matrix $W$ are both…

Data Structures and Algorithms · Computer Science 2021-03-09 Moses Charikar , Lunjia Hu

Dramatic increases in the size and dimensionality of many recent data sets make crucial the need for sophisticated methods that can exploit inherent structure and handle missing values. In this article we derive an expectation-maximization…

Methodology · Statistics 2013-09-26 Hunter Glanz , Luis Carvalho

Non-negative matrix factorization (NMF) has become a popular method for representing meaningful data by extracting a non-negative basis feature from an observed non-negative data matrix. Some of the unique features of this method in…

Optimization and Control · Mathematics 2022-11-15 Sajad Fathi Hafshejani , Zahra Moaberfard

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

Online Matrix Factorization (OMF) is a fundamental tool for dictionary learning problems, giving an approximate representation of complex data sets in terms of a reduced number of extracted features. Convergence guarantees for most of the…

Machine Learning · Computer Science 2020-11-10 Hanbaek Lyu , Deanna Needell , Laura Balzano

Nonnegative matrix factorization (NMF), which is the approximation of a data matrix as the product of two nonnegative matrices, is a key issue in machine learning and data analysis. One approach to NMF is to formulate the problem as a…

Optimization and Control · Mathematics 2016-11-02 Hideaki Iiduka , Shizuka Nishino

Non-negative matrix factorization (NMF) is a key technique for feature extraction and widely used in source separation. However, existing algorithms may converge to poor local minima, or to one of several minima with similar objective value…

Machine Learning · Computer Science 2024-10-30 Youdong Guo , Timothy E. Holy

The expectation-maximization (EM) algorithm is an iterative computational method to calculate the maximum likelihood estimators (MLEs) from the sample data. It converts a complicated one-time calculation for the MLE of the incomplete data…

Computation · Statistics 2016-08-08 Lingyao Meng

As we all known, the nonnegative matrix factorization (NMF) is a dimension reduction method that has been widely used in image processing, text compressing and signal processing etc. In this paper, an algorithm for nonnegative matrix…

Numerical Analysis · Mathematics 2013-05-27 Shu-Zhen Lai , Hou-Biao Li , Zu-Tao Zhang

Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

Nonnegative matrix factorization (NMF) is an emerging technique with a wide spectrum of potential applications in data analysis. Mathematically, NMF can be formulated as a minimization problem with nonnegative constraints. This problem is…

Data Structures and Algorithms · Computer Science 2012-12-27 Tran Dang Hien , Do Van Tuan , Pham Van At

Non-negative matrix factorization (NMF) is a common method for generating topic models from text data. NMF is widely accepted for producing good results despite its relative simplicity of implementation and ease of computation. One…

Machine Learning · Computer Science 2016-08-09 Brendan Gavin , Vijay Gadepally , Jeremy Kepner

The expectation-maximization (EM) algorithm is a powerful computational technique for finding the maximum likelihood estimates for parametric models when the data are not fully observed. The EM is best suited for situations where the…

Computation · Statistics 2018-05-14 Chanseok Park

Expectation-Maximization (EM) is a prominent approach for parameter estimation of hidden (aka latent) variable models. Given the full batch of data, EM forms an upper-bound of the negative log-likelihood of the model at each iteration and…

Machine Learning · Computer Science 2020-02-24 Ehsan Amid , Manfred K. Warmuth

The Nonnegative Matrix Factorization (NMF) of the rating matrix has shown to be an effective method to tackle the recommendation problem. In this paper we propose new methods based on the NMF of the rating matrix and we compare them with…

Machine Learning · Computer Science 2019-08-30 Gianna M. Del Corso , Francesco Romani

Non-negative Matrix Factorization (NMF) asks to decompose a (entry-wise) non-negative matrix into the product of two smaller-sized nonnegative matrices, which has been shown intractable in general. In order to overcome this issue, the…

Data Structures and Algorithms · Computer Science 2019-07-15 Zhihuai Chen , Yinan Li , Xiaoming Sun , Pei Yuan , Jialin Zhang

Non-negative matrix factorization (NMF) is a recently developed technique for finding parts-based, linear representations of non-negative data. Although it has successfully been applied in several applications, it does not always result in…

Machine Learning · Computer Science 2007-05-23 Patrik O. Hoyer

We propose a unified and systematic framework for performing online nonnegative matrix factorization in the presence of outliers. Our framework is particularly suited to large-scale data. We propose two solvers based on projected gradient…

Machine Learning · Statistics 2016-12-21 Renbo Zhao , Vincent Y. F. Tan

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

Nonnegative matrix factorization (NMF) has been actively investigated and used in a wide range of problems in the past decade. A significant amount of attention has been given to develop NMF algorithms that are suitable to model time series…

Machine Learning · Computer Science 2017-09-04 Nasser Mohammadiha , Paris Smaragdis , Ghazaleh Panahandeh , Simon Doclo