English
Related papers

Related papers: Schur Complement based domain decomposition precon…

200 papers

Semidefinite programs (SDPs) often arise in relaxations of some NP-hard problems, and if the solution of the SDP obeys certain rank constraints, the relaxation will be tight. Decomposition methods based on chordal sparsity have already been…

Optimization and Control · Mathematics 2020-09-17 Jared Miller , Yang Zheng , Biel Roig-Solvas , Mario Sznaier , Antonis Papachristodoulou

Randomized neural networks (RaNNs), in which hidden layers remain fixed after random initialization, provide an efficient alternative for parameter optimization compared to fully parameterized networks. In this paper, RaNNs are integrated…

Numerical Analysis · Mathematics 2024-12-30 Yong Shang , Alexander Heinlein , Siddhartha Mishra , Fei Wang

This work proposes a new class of preconditioners for the low rank Generalized Minimal Residual Method (GMRES) for multiterm matrix equations arising from implicit timestepping of linear matrix differential equations. We are interested in…

Numerical Analysis · Mathematics 2024-10-11 Shixu Meng , Daniel Appelo , Yingda Cheng

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie

Solving sparse linear systems from discretized PDEs is challenging. Direct solvers have in many cases quadratic complexity (depending on geometry), while iterative solvers require problem dependent preconditioners to be robust and…

Numerical Analysis · Mathematics 2017-03-14 Kai Yang , Hadi Pouransari , Eric Darve

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

This paper proposes a framework for simultaneous dimensionality reduction and regression in the presence of outliers in data by applying low-rank and sparse matrix decomposition. For multivariate data corrupted with outliers, it is…

Signal Processing · Electrical Eng. & Systems 2024-07-10 Farwa Abbas , Hussain Ahmad

Low-rank and sparse composite approximation is a natural idea to compress Large Language Models (LLMs). However, such an idea faces two primary challenges that adversely affect the performance of existing methods. The first challenge…

Machine Learning · Computer Science 2026-02-27 Changhai Zhou , Qian Qiao , Yuhua Zhou , Yuxin Wu , Shichao Weng , Weizhong Zhang , Cheng Jin

A well-known method for completing low-rank matrices based on convex optimization has been established by Cand{\`e}s and Recht. Although theoretically complete, the method may not entirely solve the low-rank matrix completion problem. This…

Methodology · Statistics 2014-07-17 Guangcan Liu , Ping Li

The low displacement rank (LDR) framework for structured matrices represents a matrix through two displacement operators and a low-rank residual. Existing use of LDR matrices in deep learning has applied fixed displacement operators…

Machine Learning · Computer Science 2019-01-03 Anna T. Thomas , Albert Gu , Tri Dao , Atri Rudra , Christopher Ré

A combination of block-Jacobi and deflation preconditioning is used to solve a high-order discontinuous collocation-based discretization of the Schur complement of the Poisson-Neumann system as arises in the operator splitting of the…

Numerical Analysis · Mathematics 2016-03-23 Sumedh M. Joshi , Greg N. Thomsen , Peter J. Diamessis

Efficient algorithms for the solution of partial differential equations on parallel computers are often based on domain decomposition methods. Schwarz preconditioners combined with standard Krylov space solvers are widely used in this…

High Energy Physics - Lattice · Physics 2009-11-10 Martin Lüscher

In a recent paper [{\em F. Bernal, J. Mor\'on-Vidal and J.A. Acebr\'on, Comp.$\&$ Math. App. 146:294-308 (2023)}] an hybrid supercomputing algorithm for elliptic equations has been put forward. The idea is that the interfacial nodal…

Numerical Analysis · Mathematics 2023-11-16 Jorge Morón-Vidal , Francisco Bernal , Atsushi Suzuki

The aim of this paper is to solve large-and-sparse linear Semidefinite Programs (SDPs) with low-rank solutions. We propose to use a preconditioned conjugate gradient method within second-order SDP algorithms and introduce a new efficient…

Optimization and Control · Mathematics 2021-05-19 Soodeh Habibi , Arefeh Kavand , Michal Kocvara , Michael Stingl

The time harmonic Maxwell equations are of current interest in computational science and applied mathematics with many applications in modern physics. In this work, we present parallel finite element solver for the time harmonic Maxwell…

Numerical Analysis · Mathematics 2021-05-26 Sven Beuchler , Sebastian Kinnewig , Thomas Wick

We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be…

Numerical Analysis · Mathematics 2016-02-02 Gil Shabat , Yaniv Shmueli , Yariv Aizenbud , Amir Averbuch

Low-rank matrix approximation is a fundamental tool in data analysis for processing large datasets, reducing noise, and finding important signals. In this work, we present a novel truncated LU factorization called Spectrum-Revealing LU…

Numerical Analysis · Computer Science 2017-08-21 David G. Anderson , Ming Gu

In this work we present a space-time least squares isogeometric discretization of the Schr\"odinger equation and propose a preconditioner for the arising linear system in the parametric domain. Exploiting the tensor product structure of the…

Numerical Analysis · Mathematics 2023-12-01 Andrea Bressan , Alen Kushova , Giancarlo Sangalli , Mattia Tani

Latest least squares regression (LSR) methods mainly try to learn slack regression targets to replace strict zero-one labels. However, the difference of intra-class targets can also be highlighted when enlarging the distance between…

Computer Vision and Pattern Recognition · Computer Science 2019-10-09 Zhe Chen , Xiao-Jun Wu , Josef Kittler

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng