English
Related papers

Related papers: A Krylov subspace method for the approximation of …

200 papers

We consider the problem of approximating the solution to $A(\mu) x(\mu) = b$ for many different values of the parameter $\mu$. Here we assume $A(\mu)$ is large, sparse, and nonsingular with a nonlinear dependence on $\mu$. Our method is…

Numerical Analysis · Mathematics 2023-10-10 Siobhán Correnty , Elias Jarlebring , Daniel B. Szyld

We present a novel method to compute the overlap Dirac operator at zero and nonzero quark chemical potential. To approximate the sign function of large, sparse matrices, standard methods project the operator on a much smaller Krylov…

High Energy Physics - Lattice · Physics 2010-05-19 Jacques C. R. Bloch , Simon Heybrock

We consider the solution of large stiff systems of ordinary differential equations with explicit exponential Runge--Kutta integrators. These problems arise from semi-discretized semi-linear parabolic partial differential equations on…

Numerical Analysis · Mathematics 2023-08-24 Kai Bergermann , Martin Stoll

We study the approximation by tensor networks (TNs) of functions from classical smoothness classes. The considered approximation tool combines a tensorization of functions in $L^p([0,1))$, which allows to identify a univariate function with…

Functional Analysis · Mathematics 2024-06-26 Mazen Ali , Anthony Nouy

We consider the linear least squares problem with linear equality constraints (LSE problem) formulated as $\min_{x\in\mathbb{R}^{n}}\|Ax-b\|_2 \ \mathrm{s.t.} \ Cx = d$. Although there are some classical methods available to solve this…

Numerical Analysis · Mathematics 2025-01-06 Haibo Li

Matrix square roots and their inverses arise frequently in machine learning, e.g., when sampling from high-dimensional Gaussians $\mathcal{N}(\mathbf 0, \mathbf K)$ or whitening a vector $\mathbf b$ against covariance matrix $\mathbf K$.…

Machine Learning · Computer Science 2020-12-02 Geoff Pleiss , Martin Jankowiak , David Eriksson , Anil Damle , Jacob R. Gardner

We present an algorithm for the solution of Sylvester equations with right-hand side of low rank. The method is based on projection onto a block rational Krylov subspace, with two key contributions with respect to the state-of-the-art.…

Numerical Analysis · Mathematics 2023-08-28 Angelo A. Casulli , Leonardo Robol

Different variants of approximate inverse iteration like the locally optimal block preconditioned conjugate gradient method became in recent years increasingly popular for the solution of the large matrix eigenvalue problems arising from…

Numerical Analysis · Mathematics 2016-11-15 Harry Yserentant

One of the most computationally expensive steps of the low-rank ADI method for large-scale Lyapunov equations is the solution of a shifted linear system at each iteration. We propose the use of the extended Krylov subspace method for this…

Numerical Analysis · Mathematics 2022-08-09 Peter Benner , Davide Palitta , Jens Saak

This paper is concerned with the solution of large-scale linear discrete ill-posed problems with error-contaminated data. Tikhonov regularization is a popular approach to determine meaningful approximate solutions of such problems. The…

Numerical Analysis · Mathematics 2016-02-11 Guangxin Huang , Silvia Noschese , Lothar Reichel

In this paper we present an efficient active-set method for the solution of convex quadratic programming problems with general piecewise-linear terms in the objective, with applications to sparse approximations and risk-minimization. The…

Optimization and Control · Mathematics 2024-05-08 Spyridon Pougkakiotis , Jacek Gondzio , Dionysis Kalogerias

In this paper we develop an optimisation based approach to multivariate Chebyshev approximation on a finite grid. We consider two models: multivariate polynomial approximation and multivariate generalised rational approximation. In the…

Optimization and Control · Mathematics 2025-01-30 R. Díaz Millán , V. Peiris , N. Sukhorukova , J. Ugon

In this paper, we propose a second order optimization method to learn models where both the dimensionality of the parameter space and the number of training samples is high. In our method, we construct on each iteration a Krylov subspace…

Machine Learning · Statistics 2011-11-21 Oriol Vinyals , Daniel Povey

In the present paper, we introduce new tensor Krylov subspace methods for solving linear tensor equations. The proposed methods use the well known T-product for tensors and tensor subspaces related to tube fibers. We introduce some new…

Numerical Analysis · Mathematics 2021-03-02 A. El Ichi , K. Jbilou , R. Sadaka

This paper introduces a new class of algorithms for solving large-scale linear inverse problems based on new flexible and inexact Golub-Kahan factorizations. The proposed methods iteratively compute regularized solutions by approximating a…

Numerical Analysis · Mathematics 2025-10-22 Malena Sabaté Landman , Silvia Gazzola

We develop and analyze an inexact regularized alternating projection method for nonconvex feasibility problems. Such a method employs inexact projections on one of the two sets, according to a set of well-defined conditions. We prove the…

Optimization and Control · Mathematics 2025-07-28 Stefania Bellavia , Simone Rebegoldi , Mattia Silei

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

This paper presents an efficient algorithm to solve total variation (TV) regularizations of images contaminated by a both blur and noise. The unconstrained structure of the problem suggests that one can solve a constrained optimization…

Numerical Analysis · Computer Science 2018-02-13 A. Bentbib , M. El Guide , K. Jbilou

In this research, we solve polynomial, Sobolev polynomial, rational, and Sobolev rational least squares problems. Although the increase in the approximation degree allows us to fit the data better in attacking least squares problems, the…

Numerical Analysis · Mathematics 2024-07-09 Amin Faghih , Marc Van Barel , Niel Van Buggenhout , Raf Vandebril

Given a set of matrices, modeled as samples of a matrix-valued function, we suggest a method to approximate the underline function using a product approximation operator. This operator extends known approximation methods by exploiting the…

Numerical Analysis · Mathematics 2016-11-15 Nira Dyn , Uri Itai , Nir Sharon