English
Related papers

Related papers: A majorization-minimization algorithm for nonnegat…

200 papers

We propose a method that meta-learns a knowledge on matrix factorization from various matrices, and uses the knowledge for factorizing unseen matrices. The proposed method uses a neural network that takes a matrix as input, and generates…

Machine Learning · Statistics 2021-06-30 Tomoharu Iwata

We consider the problem of developing interpretable and computationally efficient matrix decomposition methods for matrices whose entries have bounded support. Such matrices are found in large-scale DNA methylation studies and many other…

Machine Learning · Computer Science 2024-10-25 Anjali N. Albert , Patrick Flaherty , Aaron Schein

Motivated by an application in computational biology, we consider low-rank matrix factorization with $\{0,1\}$-constraints on one of the factors and optionally convex constraints on the second one. In addition to the non-convexity shared…

Machine Learning · Statistics 2014-01-24 Martin Slawski , Matthias Hein , Pavlo Lutsik

We study majorization-minimization methods for nonnegative tensor decompositions under the $\beta$-divergence family, focusing on nonnegative CP and Tucker models. Our aim is to avoid explicit mode unfoldings and large auxiliary matrices by…

Optimization and Control · Mathematics 2026-03-10 Valentin Leplat

A novel approach to Boolean matrix factorization (BMF) is presented. Instead of solving the BMF problem directly, this approach solves a nonnegative optimization problem with the constraint over an auxiliary matrix whose Boolean structure…

Data Structures and Algorithms · Computer Science 2021-08-27 Duc P. Truong , Erik Skau , Derek Desantis , Boian Alexandrov

To reduce memory footprint and run-time latency, techniques such as neural network pruning and binarization have been explored separately. However, it is unclear how to combine the best of the two worlds to get extremely small and efficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Yinghao Xu , Xin Dong , Yudian Li , Hao Su

The Boolean matrix factorization problem consists in approximating a matrix by the Boolean product of two smaller Boolean matrices. To obtain optimal solutions when the matrices to be factorized are small, we propose SAT and MaxSAT…

Machine Learning · Computer Science 2021-06-21 Florent Avellaneda , Roger Villemaire

Low-rank factorization is a popular model compression technique that minimizes the error $\delta$ between approximated and original weight matrices. Despite achieving performances close to the original models when $\delta$ is optimized, a…

Machine Learning · Computer Science 2025-12-24 Boyang Zhang , Daning Cheng , Yunquan Zhang , Fangming Liu , Jiake Tian

Matrix factorization is a fundamental method in statistics and machine learning for inferring and summarizing structure in multivariate data. Modern data sets often come with "side information" of various forms (images, text, graphs) that…

Many fundamental problems in data mining can be reduced to one or more NP-hard combinatorial optimization problems. Recent advances in novel technologies such as quantum and quantum-inspired hardware promise a substantial speedup for…

Machine Learning · Computer Science 2022-01-10 Osman Asif Malik , Hayato Ushijima-Mwesigwa , Arnab Roy , Avradip Mandal , Indradeep Ghosh

Bayesian parameter inference techniques require a choice of prior distribution which can strongly impact the statistical conclusions drawn. We discuss the construction of least-informative priors for neutrinoless double beta decay searches.…

High Energy Physics - Phenomenology · Physics 2021-10-25 Frank F. Deppisch , Graham Van Goffrier

This paper studies the problem of decomposing a low-rank positive-semidefinite matrix into symmetric factors with binary entries, either $\{\pm 1\}$ or $\{0,1\}$. This research answers fundamental questions about the existence and…

Data Structures and Algorithms · Computer Science 2019-08-01 Richard Kueng , Joel A. Tropp

We introduce negative binomial matrix factorization (NBMF), a matrix factorization technique specially designed for analyzing over-dispersed count data. It can be viewed as an extension of Poisson matrix factorization (PF) perturbed by a…

Machine Learning · Computer Science 2018-01-08 Olivier Gouvert , Thomas Oberlin , Cédric Févotte

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to…

Optimization and Control · Mathematics 2013-02-05 Victor Bittorf , Benjamin Recht , Christopher Re , Joel A. Tropp

There is a wide variety of models in which the dimension of the parameter space is unknown. For example, in factor analysis the number of latent factors is typically not known and has to be inferred from the observed data. Although…

Methodology · Statistics 2020-09-11 Sirio Legramanti , Daniele Durante , David B. Dunson

Matrix factorization is a widely used approach for top-N recommendation and collaborative filtering. When implemented on implicit feedback data (such as clicks), a common heuristic is to upweight the observed interactions. This strategy has…

Information Retrieval · Computer Science 2025-10-14 Alex Ayoub , Samuel Robertson , Dawen Liang , Harald Steck , Nathan Kallus

Clustering methods with dimension reduction have been receiving considerable wide interest in statistics lately and a lot of methods to simultaneously perform clustering and dimension reduction have been proposed. This work presents a novel…

Methodology · Statistics 2014-06-17 Michio Yamamoto , Kenichi Hayashi

Beta process is the standard nonparametric Bayesian prior for latent factor model. In this paper, we derive a structured mean-field variational inference algorithm for a beta process non-negative matrix factorization (NMF) model with…

Machine Learning · Statistics 2014-12-03 Dawen Liang , Matthew D. Hoffman

Bayesian model-based clustering is a widely applied procedure for discovering groups of related observations in a dataset. These approaches use Bayesian mixture models, estimated with MCMC, which provide posterior samples of the model…

Methodology · Statistics 2018-09-24 Ketong Wang , Michael D. Porter

Non-negative matrix factorization (NMF) is widely used in many applications for dimensionality reduction. Inferring an appropriate number of factors for NMF is a challenging problem, and several approaches based on information criteria or…

Methodology · Statistics 2025-02-18 Alessandro Zito , Jeffrey W. Miller