English
Related papers

Related papers: Localized inverse factorization

200 papers

This paper introduces a factorization for the inverse of discrete Fourier integral operators that can be applied in quasi-linear time. The factorization starts by approximating the operator with the butterfly factorization. Next, a…

Numerical Analysis · Mathematics 2021-09-15 Jordi Feliu-Fabà , Lexing Ying

Binary quadratic programming problems have attracted much attention in the last few decades due to their potential applications. This type of problems are NP-hard in general, and still considered a challenge in the design of efficient…

Data Structures and Algorithms · Computer Science 2014-11-20 Khaled Elbassioni , Trung Thanh Nguyen

In solving a linear system with iterative methods, one is usually confronted with the dilemma of having to choose between cheap, inefficient iterates over sparse search directions (e.g., coordinate descent), or expensive iterates in…

Numerical Analysis · Computer Science 2019-08-07 Michael T. Schaub , Maguy Trefois , Paul Van Dooren , Jean-Charles Delvenne

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

When a matrix has a banded inverse there is a remarkable formula that quickly computes that inverse, using only local information in the original matrix. This local inverse formula holds more generally, for matrices with sparsity patterns…

Numerical Analysis · Mathematics 2016-10-06 Gilbert Strang , Shev MacNamara

The inverse-free extreme learning machine (ELM) algorithm proposed in [4] was based on an inverse-free algorithm to compute the regularized pseudo-inverse, which was deduced from an inverse-free recursive algorithm to update the inverse of…

Machine Learning · Computer Science 2019-11-13 Hufei Zhu , Chenghao Wei

As electronic structure simulations continue to grow in size, the system-size scaling of computational costs increases in importance relative to cost prefactors. Presently, linear-scaling costs for three-dimensional systems are only…

Computational Physics · Physics 2019-07-04 Jonathan E. Moussa , Andrew D. Baczewski

If learning methods are to scale to the massive sizes of modern datasets, it is essential for the field of machine learning to embrace parallel and distributed computing. Inspired by the recent development of matrix factorization methods…

Machine Learning · Computer Science 2013-10-29 Lester Mackey , Ameet Talwalkar , Michael I. Jordan

The algorithms in the current sequential numerical linear algebra libraries (e.g. LAPACK) do not parallelize well on multicore architectures. A new family of algorithms, the tile algorithms, has recently been introduced. Previous research…

Mathematical Software · Computer Science 2010-02-23 Emmanuel Agullo , Henricus Bouwmeester , Jack Dongarra , Jakub Kurzak , Julien Langou , Lee Rosenberg

Iterative majorize-minimize (MM) (also called optimization transfer) algorithms solve challenging numerical optimization problems by solving a series of "easier" optimization problems that are constructed to guarantee monotonic descent of…

Computation · Statistics 2015-10-23 Madison G. McGaffin , Jeffrey A. Fessler

We propose a unified framework to solve general low-rank plus sparse matrix recovery problems based on matrix factorization, which covers a broad family of objective functions satisfying the restricted strong convexity and smoothness…

Machine Learning · Statistics 2018-02-21 Xiao Zhang , Lingxiao Wang , Quanquan Gu

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where…

Machine Learning · Computer Science 2014-05-14 Behnam Neyshabur , Rina Panigrahy

Polynomial factorization over $ZZ$ is of great historical and practical importance. Currently, the standard technique is to factor the polynomial over finite fields first and then to lift to integers. Factorization over finite fields can be…

Symbolic Computation · Computer Science 2024-10-22 Shahriar Iravanian

LU-factorization of matrices is one of the fundamental algorithms of linear algebra. The widespread use of supercomputers with distributed memory requires a review of traditional algorithms, which were based on the common memory of a…

Symbolic Computation · Computer Science 2020-11-10 Gennadi Malaschonok

Binary optimization, a representative subclass of discrete optimization, plays an important role in mathematical optimization and has various applications in computer vision and machine learning. Usually, binary optimization problems are…

Optimization and Control · Mathematics 2021-05-18 Huan Xiong , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

We comment on two randomized algorithms for constructing low-rank matrix decompositions. Both algorithms employ the Subsampled Randomized Hadamard Transform [14]. The first algorithm appeared recently in [9]; here, we provide a novel…

Data Structures and Algorithms · Computer Science 2012-04-04 Christos Boutsidis

This paper develops matrix-multiplication-based iterative refinement for diagonalizable non-Hermitian eigendecompositions. The main theory concerns simple eigenvalues and distinguishes two input regimes. In the right-only regime, where only…

Numerical Analysis · Mathematics 2026-04-06 Takeshi Terao

In this paper, we consider a regularization strategy for the factorization method when there is noise added to the data operator. The factorization method is a qualitative method used in shape reconstruction problems. These methods are…

Analysis of PDEs · Mathematics 2023-04-05 Isaac Harris

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The…

Optimization and Control · Mathematics 2013-02-11 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

In this paper, we propose iterative inner/outer approximations based on a recent notion of block factor-width-two matrices for solving semidefinite programs (SDPs). Our inner/outer approximating algorithms generate a sequence of upper/lower…

Optimization and Control · Mathematics 2022-09-30 Feng-Yi Liao , Yang Zheng