English
Related papers

Related papers: Mixed Precision Iterative Refinement with Sparse A…

200 papers

This is the first paper of a two-long series in which we study linear generalized inverses that minimize matrix norms. Such generalized inverses are famously represented by the Moore-Penrose pseudoinverse (MPP) which happens to minimize the…

Information Theory · Computer Science 2017-07-14 Ivan Dokmanić , Rémi Gribonval

A linearly implicit conservative difference scheme is applied to discretize the attractive coupled nonlinear Schr\"odinger equations with fractional Laplacian. Complex symmetric linear systems can be obtained, and the system matrices are…

Numerical Analysis · Mathematics 2023-10-19 Yan Cheng , Xi Yang

Gaussian Processes (GPs) are highly expressive, probabilistic models. A major limitation is their computational complexity. Naively, exact GP inference requires $\mathcal{O}(N^3)$ computations with $N$ denoting the number of modeled points.…

Machine Learning · Computer Science 2022-06-23 Gordian Edenhofer , Reimar H. Leike , Philipp Frank , Torsten A. Enßlin

Incomplete LU factorizations of sparse matrices are widely used as preconditioners in Krylov subspace methods to speed up solving linear systems. Unfortunately, computing the preconditioner itself can be time-consuming and sensitive to…

Machine Learning · Computer Science 2024-12-12 Paul Häusner , Aleix Nieto Juscafresa , Jens Sjölund

We investigate the SPAI and PSAI preconditioning procedures and shed light on two important features of them: (i) For the large linear system $Ax=b$ with $A$ irregular sparse, i.e., with $A$ having $s$ relatively dense columns, SPAI may be…

Numerical Analysis · Mathematics 2015-03-17 Zhongxiao Jia , Qian Zhang

We present two minimum residual methods for solving sequences of shifted linear systems, the right-preconditioned shifted GMRES and shifted recycled GMRES algorithms which use a seed projection strategy often employed to solve multiple…

Numerical Analysis · Mathematics 2016-02-04 Kirk M. Soodhalter

The emergence of low precision floating-point arithmetic in computer hardware has led to a resurgence of interest in the use of mixed precision numerical linear algebra. For linear systems of equations, there has been renewed enthusiasm for…

Numerical Analysis · Mathematics 2024-02-22 Jennifer Scott , Miroslav Tůma

Consider solving large sparse range symmetric singular linear systems $ A {\bf x}= {\bf b} $ which arise, for instance, in the discretization of convection diffusion equations with periodic boundary conditions, and partial differential…

Numerical Analysis · Mathematics 2022-11-02 Kota Sugihara , Ken Hayami , Liao Zeyu

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

We describe how variable precision floating point arithmetic can be used in the iterative solver GMRES. We show how the precision of the inner products carried out in the algorithm can be reduced as the iterations proceed, without affecting…

Numerical Analysis · Mathematics 2020-02-20 Serge Gratton , Ehouarn Simon , David Titley-Peloquin , Philippe Toint

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

Multistep matrix splitting iterations serve as preconditioning for Krylov subspace methods for solving singular linear systems. The preconditioner is applied to the generalized minimal residual (GMRES) method and the flexible GMRES (FGMRES)…

Numerical Analysis · Mathematics 2021-11-09 Keiichi Morikuni

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

It is a survey on recent results in constructive sparse approximation. Three directions are discussed here: (1) Lebesgue-type inequalities for greedy algorithms with respect to a special class of dictionaries, (2) constructive sparse…

Numerical Analysis · Mathematics 2015-11-06 Vladimir Temlyakov

We introduce an adaptive optical refinement method enabling ultra-precise micro-milling of arbitrary surfaces. Through repeated iteration, our method reduces surface error without requiring significant specific surface engineering. This…

This work is concerned with the convergence of the iterative solution for the Stokes flow, discretized with the weak Galerkin finite element method and preconditioned using inexact block Schur complement preconditioning. The resulting…

Numerical Analysis · Mathematics 2024-09-26 Weizhang Huang , Zhuoran Wang

In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting…

Machine Learning · Statistics 2015-05-28 Hojjat S. Mousavi , Vishal Monga , Trac D. Tran

We introduce a new iterative rounding technique to round a point in a matroid polytope subject to further matroid constraints. This technique returns an independent set in one matroid with limited violations of the other ones. On top of the…

Data Structures and Algorithms · Computer Science 2018-11-26 André Linhares , Neil Olver , Chaitanya Swamy , Rico Zenklusen

The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a…

Statistics Theory · Mathematics 2008-06-26 Adam J. Rothman , Peter J. Bickel , Elizaveta Levina , Ji Zhu

We propose Bayesian methods for Gaussian graphical models that lead to sparse and adaptively shrunk estimators of the precision (inverse covariance) matrix. Our methods are based on lasso-type regularization priors leading to parsimonious…

Methodology · Statistics 2013-10-07 Rajesh Talluri , Veerabhadran Baladandayuthapani , Bani K. Mallick