English
Related papers

Related papers: Interpolative Butterfly Factorization

200 papers

In solving a linear system with iterative methods, one is usually confronted with the dilemma of having to choose between cheap, inefficient iterates over sparse search directions (e.g., coordinate descent), or expensive iterates in…

Numerical Analysis · Computer Science 2019-08-07 Michael T. Schaub , Maguy Trefois , Paul Van Dooren , Jean-Charles Delvenne

This paper introduces a hierarchical interpolative decomposition butterfly-LU factorization (H-IDBF-LU) preconditioner for solving two-dimensional electric-field integral equations (EFIEs) in electromagnetic scattering problems of perfect…

Numerical Analysis · Mathematics 2020-01-08 Yang Liu , Haizhao Yang

Non-negative matrix factorization (NMF) is a key technique for feature extraction and widely used in source separation. However, existing algorithms may converge to poor local minima, or to one of several minima with similar objective value…

Machine Learning · Computer Science 2024-10-30 Youdong Guo , Timothy E. Holy

This work extends the factorization method to the inverse scattering problem of reconstructing the shape and location of an absorbing penetrable scatterer embedded in a thin infinite elastic (Kirchhoff--Love) plate. With the assumption that…

Analysis of PDEs · Mathematics 2025-11-13 Rafael Ceja Ayala , Isaac Harris , General Ozochiawaeze

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

Sparse matrix factorization is the problem of approximating a matrix $\mathbf{Z}$ by a product of $J$ sparse factors $\mathbf{X}^{(J)} \mathbf{X}^{(J-1)} \ldots \mathbf{X}^{(1)}$. This paper focuses on identifiability issues that appear in…

Machine Learning · Computer Science 2021-11-18 Léon Zheng , Elisa Riccietti , Rémi Gribonval

Overparameterized neural networks generalize well but are expensive to train. Ideally, one would like to reduce their computational cost while retaining their generalization benefits. Sparse model training is a simple and promising approach…

Machine Learning · Computer Science 2022-05-12 Tri Dao , Beidi Chen , Kaizhao Liang , Jiaming Yang , Zhao Song , Atri Rudra , Christopher Ré

Traditional NMF-based signal decomposition relies on the factorization of spectral data, which is typically computed by means of short-time frequency transform. In this paper we propose to relax the choice of a pre-fixed transform and learn…

Machine Learning · Computer Science 2017-12-18 Dylan Fagot , Cédric Févotte , Herwig Wendt

Matrix factorization is a popular framework for modeling low-rank data matrices. Motivated by manifold learning problems, this paper proposes a quadratic matrix factorization (QMF) framework to learn the curved manifold on which the dataset…

Machine Learning · Computer Science 2023-01-31 Zheng Zhai , Hengchao Chen , Qiang Sun

Inpainting based image compression approaches, especially linear and non-linear diffusion models, are an active research topic for lossy image compression. The major challenge in these compression models is to find a small set of…

Computer Vision and Pattern Recognition · Computer Science 2014-05-12 Yunjin Chen , René Ranftl , Thomas Pock

Nowadays, the availability of large-scale data in disparate application domains urges the deployment of sophisticated tools for extracting valuable knowledge out of this huge bulk of information. In that vein, low-rank representations…

Machine Learning · Computer Science 2017-10-06 Paris V. Giampouras , Athanasios A. Rontogiannis , Konstantinos D. Koutroumbas

We exploit the truncated singular value decomposition and the recently proposed circulant decomposition for an efficient first-order approximation of the multiplication of large dense matrices. A decomposition of each matrix into a sum of a…

Numerical Analysis · Mathematics 2026-04-27 Suvendu Kar , Hariprasad M. , Sai Gowri J. N. , Murugesan Venkatapathi

We analyze a distributed algorithm to compute a low-rank matrix factorization on $N$ clients, each holding a local dataset $\mathbf{S}^i \in \mathbb{R}^{n_i \times d}$, mathematically, we seek to solve $min_{\mathbf{U}^i \in…

Machine Learning · Computer Science 2025-07-22 Constantin Philippenko , Kevin Scaman , Laurent Massoulié

The model described in this paper belongs to the family of non-negative matrix factorization methods designed for data representation and dimension reduction. In addition to preserving the data positivity property, it aims also to preserve…

Machine Learning · Computer Science 2022-09-23 Rachid Hedjam , Abdelhamid Abdesselam , Abderrahmane Rahiche , Mohamed Cheriet

Binary matrix factorisation is an essential tool for identifying discrete patterns in binary data. In this paper we consider the rank-k binary matrix factorisation problem (k-BMF) under Boolean arithmetic: we are given an n x m binary…

Optimization and Control · Mathematics 2021-08-05 Reka A. Kovacs , Oktay Gunluk , Raphael A. Hauser

In inverting large sparse matrices, the key difficulty lies in effectively exploiting sparsity during the inversion process. One well-established strategy is the nested dissection, which seeks the so-called sparse Cholesky factorization. We…

Numerical Analysis · Mathematics 2025-05-14 Michał Kos , Krzysztof Podgórski , Hanqing Wu

Nonnegative Matrix Factorization (NMF) is an unsupervised learning algorithm that produces a linear, parts-based approximation of a data matrix. NMF constructs a nonnegative low rank basis matrix and a nonnegative low rank matrix of weights…

Machine Learning · Statistics 2020-12-08 Matthew Corsetti , Ernest Fokoué

We present a new Monte Carlo algorithm for the interpolation of a straight-line program as a sparse polynomial $f$ over an arbitrary finite field of size $q$. We assume a priori bounds $D$ and $T$ are given on the degree and number of terms…

Symbolic Computation · Computer Science 2014-05-05 Andrew Arnold , Mark Giesbrecht , Daniel S. Roche

This text investigates relations between two well-known family of algorithms, matrix factorisations and recursive linear filters, by describing a probabilistic model in which approximate inference corresponds to a matrix factorisation…

Machine Learning · Statistics 2015-09-08 Ömer Deniz Akyıldız

It is well known that matrices with low Hessenberg-structured displacement rank enjoy fast algorithms for certain matrix factorizations. We show how $n\times n$ principal finite sections of the Gram matrix for the orthogonal polynomial…

Numerical Analysis · Mathematics 2024-12-24 Karim Gumerov , Samantha Rigg , Richard Mikael Slevinsky