English
Related papers

Related papers: How Descriptive are GMRES Convergence Bounds?

200 papers

Electrostatic interactions between dielectric objects are complex and of a many-body nature, owing to induced surface bound charge. We present a collection of techniques to simulate dynamical dielectric objects. We calculate the surface…

Soft Condensed Matter · Physics 2018-09-17 Kipton Barros , Daniel Sinkovits , Erik Luijten

We consider solving nonconvex composite optimization problems in which the sum of a smooth function and a nonsmooth function is minimized. Many of convergence analyses of proximal gradient-type methods rely on global descent property…

Optimization and Control · Mathematics 2026-04-09 Shotaro Yagishita , Masaru Ito

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

Machine Learning · Statistics 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

The trust region subproblem (TRS) is to minimize a possibly nonconvex quadratic function over a Euclidean ball. There are typically two cases for (TRS), the so-called ``easy case'' and ``hard case''. Even in the ``easy case'', the sequence…

Optimization and Control · Mathematics 2022-07-13 Mengmeng Song , Yong Xia , Jinyang Zheng

By incorporating a new matrix splitting and the momentum acceleration into the relaxed-based matrix splitting (RMS) method \cite{soso2023}, a generalization of the RMS (GRMS) iterative method for solving the generalized absolute value…

Numerical Analysis · Mathematics 2025-03-04 Xuehua Li , Cairong Chen , Deren Han

This paper develops a new class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized sketching to accelerate subspace projection methods, such as GMRES and Rayleigh--Ritz. This approach…

Numerical Analysis · Mathematics 2022-02-17 Yuji Nakatsukasa , Joel A. Tropp

In large-scale X-ray computed tomography (CT), matrix-free iterative methods are essential due to the prohibitive cost of explicitly forming the system matrix. In practice, forward projectors and backprojectors are often implemented with…

Numerical Analysis · Mathematics 2026-02-23 Ryan Bentley , Mirjeta Pasha , Malena Sabaté Landman , Luisa Yang , Jeffery Zhang

A general asynchronous alternating iterative model is designed, for which convergence is theoretically ensured both under classical spectral radius bound and, then, for a classical class of matrix splittings for $\mathsf H$-matrices. The…

Numerical Analysis · Mathematics 2023-12-29 Guillaume Gbikpi-Benissan , Qinmeng Zou , Frédéric Magoulès

The hybrid LSMR algorithm is proposed for large-scale general-form regularization. It is based on a Krylov subspace projection method where the matrix $A$ is first projected onto a subspace, typically a Krylov subspace, which is implemented…

Numerical Analysis · Mathematics 2024-09-17 Yanfei Yang

We resolve a longstanding open problem in the computational modeling of nonlinear plates by introducing a numerical method that exactly enforces the isometry constraint, namely, that the first fundamental form of the mid-surface coincides…

Numerical Analysis · Mathematics 2026-05-11 Brendan Keith , Frédéric Marazzato

In this paper, we develop an efficient spectral-Galerkin-type search extension method (SGSEM) for finding multiple solutions to semilinear elliptic boundary value problems. This method constructs effective initial data for multiple…

Numerical Analysis · Mathematics 2023-08-15 Wei Liu , Ziqing Xie , Yongjun Yuan

The generalized symmetry method is applied to a class of completely discrete equations including the Adler-Bobenko-Suris list. Assuming the existence of a generalized symmetry, we derive a few integrability conditions suitable for testing…

Exactly Solvable and Integrable Systems · Physics 2015-05-13 D. Levi , R. I. Yamilov

Methods for inference and simulation of linearly constrained Gaussian Markov Random Fields (GMRF) are computationally prohibitive when the number of constraints is large. In some cases, such as for intrinsic GMRFs, they may even be…

Methodology · Statistics 2021-06-04 David Bolin , Jonas Wallin

This article proposes an efficient numerical method for solving nonlinear partial differential equations (PDEs) based on sparse Gaussian processes (SGPs). Gaussian processes (GPs) have been extensively studied for solving PDEs by…

Numerical Analysis · Mathematics 2023-08-09 Rui Meng , Xianjin Yang

The gradient discretisation method (GDM) is a generic framework designed recently, as a discretise in spatial space, to partial differential equations. This paper aims to use the GDM to establish a first general error estimate for numerical…

Numerical Analysis · Mathematics 2020-09-22 Yahya Alnashri

Analyzing massive spatial datasets using Gaussian process model poses computational challenges. This is a problem prevailing heavily in applications such as environmental modeling, ecology, forestry and environmental heath. We present a…

Methodology · Statistics 2021-12-07 Suman Majumder , Yawen Guan , Brian J. Reich , Arvind K. Saibaba

We introduce a novel spectral, finite-dimensional approximation of general Sobolev spaces in terms of Chebyshev polynomials. Based on this polynomial surrogate model (PSM), we realise a variational formulation, solving a vast class of…

Numerical Analysis · Mathematics 2023-01-13 Juan-Esteban Suarez Cardona , Phil-Alexander Hofmann , Michael Hecht

We consider bounds on the convergence of Ritz values from a sequence of Krylov subspaces to interior eigenvalues of Hermitean matrices. These bounds are useful in regions of low spectral density, for example near voids in the spectrum, as…

Numerical Analysis · Mathematics 2011-10-18 Chris Johnson , A. D. Kennedy