English
Related papers

Related papers: Simplex-Structured Matrix Factorization: Sparsity-…

200 papers

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex…

Machine Learning · Computer Science 2021-11-04 Truong Son Hy , Risi Kondor

Automated per-instance algorithm selection and configuration have shown promising performances for a number of classic optimization problems, including satisfiability, AI planning, and TSP. The techniques often rely on a set of features…

Neural and Evolutionary Computing · Computer Science 2020-10-01 Tome Eftimov , Gorjan Popovski , Quentin Renau , Peter Korosec , Carola Doerr

Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the…

Machine Learning · Computer Science 2024-12-10 Olivier Vu Thanh

Nonnegative matrix factorization (NMF) has become a widely used tool for the analysis of high-dimensional data as it automatically extracts sparse and meaningful features from a set of nonnegative data vectors. We first illustrate this…

Machine Learning · Statistics 2014-12-10 Nicolas Gillis

Learning a dynamical system from input/output data is a fundamental task in the control design pipeline. In the partially observed setting there are two components to identification: parameter estimation to learn the Markov parameters, and…

Optimization and Control · Mathematics 2021-09-08 Han Wang , James Anderson

We study the sparse non-negative least squares (S-NNLS) problem. S-NNLS occurs naturally in a wide variety of applications where an unknown, non-negative quantity must be recovered from linear measurements. We present a unified framework…

Machine Learning · Statistics 2018-01-03 Igor Fedorov , Alican Nalci , Ritwik Giri , Bhaskar D. Rao , Truong Q. Nguyen , Harinath Garudadri

Referring back to the original text in the course of hierarchical learning is a common human trait that ensures the right direction of learning. The models developed based on the concept of Non-negative Matrix Factorization (NMF), in this…

Machine Learning · Computer Science 2024-05-24 Prasun Dutta , Rajat K. De

Analysis and visualization of an information network can be facilitated better using an appropriate embedding of the network. Network embedding learns a compact low-dimensional vector representation for each node of the network, and uses…

Social and Information Networks · Computer Science 2018-07-05 Sambaran Bandyopadhyay , Harsh Kara , Aswin Kannan , M N Murty

Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation is needed. Conventional approximation approaches factorize…

Machine Learning · Computer Science 2021-09-20 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

Non-negative Matrix Factorization (NMF) is one of the most popular techniques for data representation and clustering, and has been widely used in machine learning and data analysis. NMF concentrates the features of each sample into a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Mulin Chen , Maoguo Gong , Xuelong Li

Solving semidefinite programs (SDP) in a short time is the key to managing various mathematical optimization problems. The matrix-completion primal-dual interior-point method (MC-PDIPM) extracts a sparse structure of input SDP by…

Optimization and Control · Mathematics 2014-05-27 Makoto Yamashita , Kazuhide Nakata

Non-negative matrix factorization (NMF) is a powerful tool for dimensionality reduction and clustering. Unfortunately, the interpretation of the clustering results from NMF is difficult, especially for the high-dimensional biological data…

Machine Learning · Computer Science 2021-04-28 Wenwen Min , Taosheng Xu , Xiang Wan , Tsung-Hui Chang

We investigate a general matrix factorization for deviance-based data losses, extending the ubiquitous singular value decomposition beyond squared error loss. While similar approaches have been explored before, our method leverages…

Machine Learning · Statistics 2023-07-04 Liang Wang , Luis Carvalho

In this letter, we propose a new identification criterion that guarantees the recovery of the low-rank latent factors in the nonnegative matrix factorization (NMF) model, under mild conditions. Specifically, using the proposed criterion, it…

Machine Learning · Computer Science 2018-03-14 Xiao Fu , Kejun Huang , Nicholas D. Sidiropoulos

Motivated by an application in computational biology, we consider low-rank matrix factorization with $\{0,1\}$-constraints on one of the factors and optionally convex constraints on the second one. In addition to the non-convexity shared…

Machine Learning · Statistics 2014-01-24 Martin Slawski , Matthias Hein , Pavlo Lutsik

Spectral inference provides fast algorithms and provable optimality for latent topic analysis. But for real data these algorithms require additional ad-hoc heuristics, and even then often produce unusable results. We explain this poor…

Machine Learning · Computer Science 2016-11-02 Moontae Lee , David Bindel , David Mimno

In this work, we study the problem of common and unique feature extraction from noisy data. When we have N observation matrices from N different and associated sources corrupted by sparse and potentially gross noise, can we recover the…

Machine Learning · Computer Science 2025-08-25 Naichen Shi , Salar Fattahi , Raed Al Kontar

A Random SubMatrix method (RSM) is proposed to calculate the low-rank decomposition of large-scale matrices with known entry percentage \rho. RSM is very fast as the floating-point operations (flops) required are compared favorably with the…

Numerical Analysis · Computer Science 2015-10-28 Yiguang Liu

Matrix factorization techniques have been widely used as a method for collaborative filtering for recommender systems. In recent times, different variants of deep learning algorithms have been explored in this setting to improve the task of…

Machine Learning · Computer Science 2019-03-26 Vaibhav Krishna , Tian Guo , Nino Antulov-Fantulin

In this work, we consider nonnegative matrix factorization (NMF) with a regularization that promotes small volume of the convex hull spanned by the basis matrix. We present highly efficient algorithms for three different volume…

Numerical Analysis · Computer Science 2020-01-14 M. S. Ang , Nicolas Gillis