English
Related papers

Related papers: A Progressive Statistical Method for Preconditioni…

200 papers

This paper presents a method for building a preconditioner for a kernel ridge regression problem, where the preconditioner is not only effective in its ability to reduce the condition number substantially, but also efficient in its…

Numerical Analysis · Mathematics 2021-04-07 Gil Shabat , Era Choshen , Dvir Ben Or , Nadav Carmel

In this paper, we present numerical methods suitable for solving convex quadratic Fractional Differential Equation (FDE) constrained optimization problems, with box constraints on the state and/or control variables. We develop an…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , John W. Pearson , Santolo Leveque , Jacek Gondzio

This paper introduces the Nystr\"om PCG algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nystr\"om method to form a low-rank approximation of the matrix, which leads to an efficient…

Numerical Analysis · Mathematics 2021-12-20 Zachary Frangella , Joel A. Tropp , Madeleine Udell

The solution of systems of linear(ized) equations lies at the heart of many problems in Scientific Computing. In particular for systems of large dimension, iterative methods are a primary approach. Stationary iterative methods are generally…

Numerical Analysis · Mathematics 2025-04-08 Andy Wathen

The goal of this work is to present a fast and viable approach for the numerical solution of the high-contrast state problems arising in topology optimization. The optimization process is iterative, and the gradients are obtained by an…

Numerical Analysis · Mathematics 2020-06-25 Miguel Zambrano , Sintya Serrano , Boyan S. Lazarov , Juan Galvis

Context. Numerical solutions to transfer problems of polarized radiation in solar and stellar atmospheres commonly rely on stationary iterative methods, which often perform poorly when applied to large problems. In recent times, stationary…

Numerical Analysis · Mathematics 2021-12-08 Pietro Benedusi , Gioele Janett , Luca Belluzzi , Rolf Krause

Bayesian statistical inverse problems are often solved with Markov chain Monte Carlo (MCMC)-type schemes. When the problems are governed by large-scale discrete nonlinear partial differential equations (PDEs), they are computationally…

Numerical Analysis · Mathematics 2019-09-06 Howard C. Elman , Akwum Onwunta

Unless special conditions apply, the attempt to solve ill-conditioned systems of linear equations with standard numerical methods leads to uncontrollably high numerical error. Often, such systems arise from the discretization of operator…

Numerical Analysis · Mathematics 2021-05-18 Stephan Mohr , Yuji Nakatsukasa , Carolina Urzúa-Torres

Preconditioning is a common method applied to modify Markov chain Monte Carlo algorithms with the goal of making them more efficient. In practice it is often extremely effective, even when the preconditioner is learned from the chain. We…

Computation · Statistics 2026-02-12 Max Hird , Florian Maire , Jeffrey Negrea

We present a randomized algorithm that, on input a symmetric, weakly diagonally dominant n-by-n matrix A with m nonzero entries and an n-vector b, produces a y such that $\norm{y - \pinv{A} b}_{A} \leq \epsilon \norm{\pinv{A} b}_{A}$ in…

Numerical Analysis · Mathematics 2025-10-20 Daniel A. Spielman , Shang-Hua Teng

Hybridizable discretizations allow for the elimination of local degrees-of-freedom leading to reduced linear systems. In this paper, we determine and analyse an approach to construct parameter-robust preconditioners for these reduced…

Numerical Analysis · Mathematics 2025-03-11 Esteban Henriquez , Jeonghun J. Lee , Sander Rhebergen

We present an efficient preconditioner for linear problems $A x=y$. It guarantees monotonic convergence of the memory-efficient fixed-point iteration for all accretive systems of the form $A = L + V$, where $L$ is an approximation of $A$,…

Numerical Analysis · Mathematics 2023-10-02 Tom Vettenburg , Ivo M. Vellekoop

In this paper, we revisit the large-scale constrained linear regression problem and propose faster methods based on some recent developments in sketching and optimization. Our algorithms combine (accelerated) mini-batch SGD with a new…

Machine Learning · Computer Science 2018-02-12 Di Wang , Jinhui Xu

We give a stochastic optimization algorithm that solves a dense $n\times n$ real-valued linear system $Ax=b$, returning $\tilde x$ such that $\|A\tilde x-b\|\leq \epsilon\|b\|$ in time: $$\tilde O((n^2+nk^{\omega-1})\log1/\epsilon),$$ where…

Data Structures and Algorithms · Computer Science 2024-06-10 Michał Dereziński , Jiaming Yang

The discontinuous Galerkin time-stepping method has many advantageous properties for solving parabolic equations. However, it requires the solution of a large nonsymmetric system at each time-step. This work develops a fully robust and…

Numerical Analysis · Mathematics 2025-01-29 Iain Smears

We provide two solutions to the heretofore open problem of stabilization of systems with arbitrarily long delays at the input and output of a nonlinear system using output feedback only. Both of our solutions are global, employ the…

Optimization and Control · Mathematics 2011-08-24 Iasson Karafyllis , Miroslav Krstic

The efficient solution of discretisations of coupled systems of partial differential equations (PDEs) is at the core of much of numerical simulation. Significant effort has been expended on scalable algorithms to precondition Krylov…

Mathematical Software · Computer Science 2018-02-22 Robert C. Kirby , Lawrence Mitchell

We introduce a new class of hybrid preconditioners for solving parametric linear systems of equations. The proposed preconditioners are constructed by hybridizing the deep operator network, namely DeepONet, with standard iterative methods.…

Numerical Analysis · Mathematics 2024-01-11 Alena Kopaničáková , George Em Karniadakis

We consider the problem of estimating the transition rate matrix of a continuous-time Markov chain from a finite-duration realisation of this process. We approach this problem in an imprecise probabilistic framework, using a set of prior…

Machine Learning · Statistics 2018-07-12 Thomas Krak , Alexander Erreygers , Jasper De Bock

For some typical and widely used non-convex half-quadratic regularization models and the Ambrosio-Tortorelli approximate Mumford-Shah model, based on the Kurdyka-\L ojasiewicz analysis and the recent nonconvex proximal algorithms, we…

Optimization and Control · Mathematics 2021-07-30 Shengxiang Deng , Ismail Ben Ayed , Hongpeng Sun