English
Related papers

Related papers: Butterfly Factorization

200 papers

In this paper, a method via sparse-sparse iteration for computing a sparse incomplete factorization of the inverse of a symmetric positive definite matrix is proposed. The resulting factorized sparse approximate inverse is used as a…

Numerical Analysis · Mathematics 2008-08-03 Davod Khojasteh Salkuyeh , Faezeh Toutounian

Non-negative matrix factorization (NMF) has previously been shown to be a useful decomposition for multivariate data. We interpret the factorization in a new way and use it to generate missing attributes from test data. We provide a joint…

Numerical Analysis · Computer Science 2010-07-05 Mithun Das Gupta

Motivated by an application in computational biology, we consider low-rank matrix factorization with $\{0,1\}$-constraints on one of the factors and optionally convex constraints on the second one. In addition to the non-convexity shared…

Machine Learning · Statistics 2014-01-24 Martin Slawski , Matthias Hein , Pavlo Lutsik

Matrix factorization techniques have been widely used as a method for collaborative filtering for recommender systems. In recent times, different variants of deep learning algorithms have been explored in this setting to improve the task of…

Machine Learning · Computer Science 2019-03-26 Vaibhav Krishna , Tian Guo , Nino Antulov-Fantulin

A novel approach to Boolean matrix factorization (BMF) is presented. Instead of solving the BMF problem directly, this approach solves a nonnegative optimization problem with the constraint over an auxiliary matrix whose Boolean structure…

Data Structures and Algorithms · Computer Science 2021-08-27 Duc P. Truong , Erik Skau , Derek Desantis , Boian Alexandrov

Overparameterized neural networks generalize well but are expensive to train. Ideally, one would like to reduce their computational cost while retaining their generalization benefits. Sparse model training is a simple and promising approach…

Machine Learning · Computer Science 2022-05-12 Tri Dao , Beidi Chen , Kaizhao Liang , Jiaming Yang , Zhao Song , Atri Rudra , Christopher Ré

Collaborative filtering generates recommendations by exploiting user-item similarities based on rating data, which often contains numerous unrated items. To predict scores for unrated items, matrix factorization techniques such as…

Statistical Mechanics · Physics 2025-07-30 Yukino Terui , Yuka Inoue , Yohei Hamakawa , Kosuke Tatsumura , Kazue Kudo

Matrix factorization is an important mathematical problem encountered in the context of dictionary learning, recommendation systems and machine learning. We introduce a new `decimation' scheme that maps it to neural network models of…

Disordered Systems and Neural Networks · Physics 2023-07-12 Francesco Camilli , Marc Mézard

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations. Existing matrix factorization is based on least squares and aims to yield a low-rank matrix to interpret the conditional sample…

Machine Learning · Statistics 2017-03-06 Rui Zhu , Di Niu , Linglong Kong , Zongpeng Li

We describe an algorithm for the application of the forward and inverse spherical harmonic transforms. It is based on a new method for rapidly computing the forward and inverse associated Legendre transforms by hierarchically applying the…

Numerical Analysis · Mathematics 2021-08-31 James Bremer , Ze Chen , Haizhao Yang

Matrix factorization is a popular approach for large-scale matrix completion. The optimization formulation based on matrix factorization can be solved very efficiently by standard algorithms in practice. However, due to the non-convexity…

Machine Learning · Computer Science 2016-11-18 Ruoyu Sun , Zhi-Quan Luo

The Boolean matrix factorization problem consists in approximating a matrix by the Boolean product of two smaller Boolean matrices. To obtain optimal solutions when the matrices to be factorized are small, we propose SAT and MaxSAT…

Machine Learning · Computer Science 2021-06-21 Florent Avellaneda , Roger Villemaire

Boolean matrix factorization is a natural and a popular technique for summarizing binary matrices. In this paper, we study a problem of Boolean matrix factorization where we additionally require that the factor matrices have consecutive…

Data Structures and Algorithms · Computer Science 2019-05-16 Nikolaj Tatti , Pauli Miettinen

A new necessary and sufficient condition for the existence of minor left prime factorizations of multivariate polynomial matrices without full row rank is presented. The key idea is to establish a relationship between a matrix and its full…

Symbolic Computation · Computer Science 2020-10-15 Dong Lu , Dingkang Wang , Fanghui Xiao

We present an approximate algorithm for matrix multiplication based on matrix sketching techniques. First one of the matrix is chosen and sparsified using the online matrix sketching algorithm, and then the matrix product is calculated…

Numerical Analysis · Computer Science 2014-06-12 Huan Wang , Christos Boutsidis , Edo Liberty , Daniel Hsu

Low rank matrix factorization is a fundamental building block in machine learning, used for instance to summarize gene expression profile data or word-document counts. To be robust to outliers and differences in scale across features, a…

Machine Learning · Computer Science 2020-07-07 Marco Cuturi , Olivier Teboul , Jonathan Niles-Weed , Jean-Philippe Vert

We give a number of explicit matrix-algorithms for analysis/synthesis in multi-phase filtering; i.e., the operation on discrete-time signals which allow a separation into frequency-band components, one for each of the ranges of bands, say…

Functional Analysis · Mathematics 2014-12-10 Palle Jorgensen , Myung-Sin Song

This work explores non-negative low-rank matrix factorization based on regularized Poisson models (PF or "Poisson factorization" for short) for recommender systems with implicit-feedback data. The properties of Poisson likelihood allow a…

Machine Learning · Computer Science 2022-02-25 David Cortes

Matrix factorization is a very common machine learning technique in recommender systems. Bayesian Matrix Factorization (BMF) algorithms would be attractive because of their ability to quantify uncertainty in their predictions and avoid…

Machine Learning · Computer Science 2020-04-15 Tom Vander Aa , Xiangju Qin , Paul Blomstedt , Roel Wuyts , Wilfried Verachtert , Samuel Kaski

Random butterfly matrices were introduced by Parker in 1995 to remove the need for pivoting when using Gaussian elimination. The growing applications of butterfly matrices have often eclipsed the mathematical understanding of how or why…

Numerical Analysis · Mathematics 2023-09-12 John Peca-Medlin , Thomas Trogdon