English
Related papers

Related papers: Sparsify and sweep: an efficient preconditioner fo…

200 papers

One of the main tools for solving linear systems arising from the discretization of the Helmholtz equation is the shifted Laplace preconditioner, which results from the discretization of a perturbed Helmholtz problem $-\Delta u - (k^2 + i…

Numerical Analysis · Mathematics 2020-06-18 Luis García Ramos , Reinhard Nabben

Large Language Models (LLMs) are difficult to fully fine-tune (e.g., with instructions or human feedback) due to their sheer number of parameters. A family of parameter-efficient sparse fine-tuning methods have proven promising in terms of…

Computation and Language · Computer Science 2024-02-05 Alan Ansell , Ivan Vulić , Hannah Sterz , Anna Korhonen , Edoardo M. Ponti

Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of its hidden state space. A small number of hidden states may…

Artificial Intelligence · Computer Science 2013-12-04 Zitao Liu , Milos Hauskrecht

Solution of the discretized Lippmann-Schwinger equation in the spatial frequency domain involves the inversion of a linear operator specified by the scattering potential. To regularize this inevitably ill-conditioned problem, we propose a…

Computational Physics · Physics 2020-10-30 Subeen Pang , George Barbastathis

We present a sparse matrix permutation from graph theory that gives stable incomplete Lower-Upper (LU) preconditioners necessary for iterative solutions to the steady state density matrix for quantum optomechanical systems. This reordering…

Quantum Physics · Physics 2015-01-28 P. D. Nation , J. R. Johansson , M. P. Blencowe , A. J. Rimberg

Perfectly Matched Layer (PML) is a widely adopted non-reflecting boundary treatment for wave simulations. Reducing numerical reflections from a discretized PML has been a long lasting challenge. This paper presents a new discrete PML for…

Numerical Analysis · Mathematics 2019-03-12 Albert Chern

In this paper we present an overview of recent progress on the development and analysis of domain decomposition preconditioners for discretised Helmholtz problems, where the preconditioner is constructed from the corresponding problem with…

Numerical Analysis · Mathematics 2016-06-24 I. G. Graham , E. A. Spence , E. Vainikko

Minimizing sum of two functions under a linear constraint is what we called splitting problem. This convex optimization has wide applications in machine learning problems, such as Lasso, Group Lasso and Sparse logistic regression. A recent…

Computation · Statistics 2017-11-20 Sen Na , Cho-Jui Hsieh

Presented in this paper is a new sparse linear solver methodology motivated by multigrid principles and based around general local transformations that diagonalize a matrix while maintaining its sparsity. These transformations are…

Numerical Analysis · Mathematics 2007-05-23 Jonathan E. Moussa

Convergence in self-consistent-field cycles can be a major computational bottleneck of density-functional theory calculations. We propose a Resta-like preconditioning method for full-potential all-electron calculations in the linearized…

Materials Science · Physics 2023-01-05 Jongmin Kim , Matthias M. May

The Poisson pressure solve resulting from the spectral element discretization of the incompressible Navier-Stokes equation requires fast, robust, and scalable preconditioning. In the current work, a parallel scaling study of…

Numerical Analysis · Mathematics 2021-12-14 Malachi Phillips , Stefan Kerkemeier , Paul Fischer

Long-lived and ultra-confined plasmons in two-dimensional (2D) electron systems may provide a sub-wavelength diagnostic tool to investigate localized dielectric, electromagnetic, and pseudo-electromagnetic perturbations. In this Article, we…

Mesoscale and Nanoscale Physics · Physics 2017-08-02 Iacopo Torre , Mikhail I. Katsnelson , Alberto Diaspro , Vittorio Pellegrini , Marco Polini

We propose an augmented Lagrangian-based preconditioner to accelerate the convergence of Krylov subspace methods applied to linear systems of equations with a block three-by-three structure such as those arising from mixed finite element…

Numerical Analysis · Mathematics 2023-10-26 Fatemeh P. A. Beik , Michele Benzi

A new preconditioner is developed for high order finite element approximation of linear elastic problems on triangular meshes in two dimensions. The new preconditioner results in a condition number that is bounded independently of the…

Numerical Analysis · Mathematics 2023-02-10 Mark Ainsworth , Charles Parker

This paper presents a scalable multigrid preconditioner targeting large-scale systems arising from discontinuous Petrov-Galerkin (DPG) discretizations of high-frequency wave operators. This work is built on previously developed multigrid…

Numerical Analysis · Mathematics 2023-10-06 Jacob Badger , Stefan Henneking , Socratis Petrides , Leszek Demkowicz

For non-preconditioned Galerkin systems, the condition number grows with the number of elements as well as the quotient of the maximal and the minimal mesh-size. Therefore, reliable and effective numerical computations, in particular on…

Numerical Analysis · Mathematics 2017-04-04 Michael Feischl , Thomas Führer , Dirk Praetorius , Ernst P. Stephan

Discretization of flow in fractured porous media commonly lead to large systems of linear equations that require dedicated solvers. In this work, we develop an efficient linear solver and its practical implementation for mixed-dimensional…

Numerical Analysis · Mathematics 2023-02-08 Xiaozhe Hu , Eirik Keilegavlen , Jan M. Nordbotten

The research of two-level overlapping Schwarz (TL-OS) method based on constrained energy minimizing coarse space is still in its infancy, and there exist some defects, e.g. mainly for second order elliptic problem and too heavy…

Numerical Analysis · Mathematics 2021-06-04 Qing Lu , Junxian Wang , Shi Shu , Jie Peng

We consider the problem of minimizing a Lipschitz differentiable function over a class of sparse symmetric sets that has wide applications in engineering and science. For this problem, it is known that any accumulation point of the…

Optimization and Control · Mathematics 2015-12-01 Zhaosong Lu

This paper introduces and analyzes a preconditioned modified of the Hermitian and skew-Hermitian splitting (PMHSS). The large sparse continuous Sylvester equations are solved by PMHSS iterative algorithm based on nonHermitian, complex,…

Numerical Analysis · Mathematics 2020-12-29 Yuye Feng , Qingbiao Wu