English
Related papers

Related papers: Nearly-Linear Time Algorithms for Preconditioning …

200 papers

We revisit the Subset Sum problem over the finite cyclic group $\mathbb{Z}_m$ for some given integer $m$. A series of recent works has provided near-optimal algorithms for this problem under the Strong Exponential Time Hypothesis. Koiliaris…

Data Structures and Algorithms · Computer Science 2020-11-02 Kyriakos Axiotis , Arturs Backurs , Karl Bringmann , Ce Jin , Vasileios Nakos , Christos Tzamos , Hongxun Wu

In this paper we introduce a notion of spectral approximation for directed graphs. While there are many potential ways one might define approximation for directed graphs, most of them are too strong to allow sparse approximations in…

Data Structures and Algorithms · Computer Science 2016-11-03 Michael B. Cohen , Jonathan Kelner , John Peebles , Richard Peng , Anup Rao , Aaron Sidford , Adrian Vladu

We consider the problem of preprocessing an $n\times n$ matrix $\mathbf{M}$, and supporting queries that, for any vector $v$, returns the matrix-vector product $\mathbf{M} v$. This problem has been extensively studied in both theory and…

Data Structures and Algorithms · Computer Science 2026-02-10 Emile Anand , Jan van den Brand , Rose McCarty

Algorithms for data assimilation try to predict the most likely state of a dynamical system by combining information from observations and prior models. Variational approaches, such as the weak-constraint four-dimensional variational data…

Numerical Analysis · Mathematics 2023-04-05 Davide Palitta , Jemima M. Tabeart

A unified framework for fourth-order semilinear problems with trilinear nonlinearity and general source allows for quasi-best approximation with lowest-order finite element methods. This paper establishes the stability and a priori error…

Numerical Analysis · Mathematics 2023-05-23 Carsten Carstensen , Neela Nataraj , Gopikrishnan C. Remesan , Devika Shylaja

We present an efficient preconditioner for linear problems $A x=y$. It guarantees monotonic convergence of the memory-efficient fixed-point iteration for all accretive systems of the form $A = L + V$, where $L$ is an approximation of $A$,…

Numerical Analysis · Mathematics 2023-10-02 Tom Vettenburg , Ivo M. Vellekoop

Covariance matrices are central to data assimilation and inverse methods derived from statistical estimation theory. Previous work has considered the application of an all-at-once diffusion-based representation of a covariance matrix…

Numerical Analysis · Mathematics 2026-05-11 Jemima M. Tabeart , Selime Gürol , John W. Pearson , Anthony T. Weaver

The discretization of robust quadratic optimal control problems under uncertainty using the finite element method and the stochastic collocation method leads to large saddle-point systems, which are fully coupled across the random…

Numerical Analysis · Mathematics 2021-10-15 Fabio Nobile , Tommaso Vanzan

We introduce tensor numerical techniques for solving optimal control problems constrained by elliptic operators in $\mathbb{R}^d$, $d=2,3$, with variable coefficients, which can be represented in a low rank separable form. We construct a…

Numerical Analysis · Mathematics 2021-05-28 Boris N. Khoromskij , Britta Schmitt , Volker Schulz

Arising from structural graph theory, treewidth has become a focus of study in fixed-parameter tractable algorithms in various communities including combinatorics, integer-linear programming, and numerical analysis. Many NP-hard problems…

Data Structures and Algorithms · Computer Science 2023-09-14 Sally Dong , Yin Tat Lee , Guanghao Ye

Hankel matrices are an important class of highly-structured matrices, arising across computational mathematics, engineering, and theoretical computer science. It is well-known that positive semidefinite (PSD) Hankel matrices are always…

Data Structures and Algorithms · Computer Science 2025-11-27 Michael Kapralov , Cameron Musco , Kshiteej Sheth

The class of quasiseparable matrices is defined by the property that any submatrix entirely below or above the main diagonal has small rank, namely below a bound called the order of quasiseparability. These matrices arise naturally in…

Symbolic Computation · Computer Science 2019-10-22 Clement Pernet , Arne Storjohann

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

Layer-wise preconditioning methods are a family of memory-efficient optimization algorithms that introduce preconditioners per axis of each layer's weight tensors. These methods have seen a recent resurgence, demonstrating impressive…

Machine Learning · Computer Science 2025-02-05 Thomas T. Zhang , Behrad Moniri , Ansh Nagwekar , Faraz Rahman , Anton Xue , Hamed Hassani , Nikolai Matni

An algorithm for a family of self-starting high-order implicit time integration schemes with controllable numerical dissipation is proposed for both linear and nonlinear transient problems. This work builds on the previous works of the…

Numerical Analysis · Mathematics 2024-09-23 Daniel O'Shea , Xiaoran Zhang , Shayan Mohammadian , Chongmin Song

We consider the problem of approximating the solution to $A(\mu) x(\mu) = b$ for many different values of the parameter $\mu$. Here we assume $A(\mu)$ is large, sparse, and nonsingular with a nonlinear dependence on $\mu$. Our method is…

Numerical Analysis · Mathematics 2023-10-10 Siobhán Correnty , Elias Jarlebring , Daniel B. Szyld

In this work, we propose a simple yet generic preconditioned Krylov subspace method for a large class of nonsymmetric block Toeplitz all-at-once systems arising from discretizing evolutionary partial differential equations. Namely, our main…

Numerical Analysis · Mathematics 2023-08-11 Sean Hon , Po Yin Fung , Jiamei Dong , Stefano Serra-Capizzano

Variational models for image deblurring problems typically consist of a smooth term and a potentially non-smooth convex term. A common approach to solving these problems is using proximal gradient methods. To accelerate the convergence of…

Numerical Analysis · Mathematics 2025-05-22 Stefano Aleotti , Marco Donatelli , Rolf Krause , Giuseppe Scarlato

We present an algorithm that, with high probability, generates a random spanning tree from an edge-weighted undirected graph in $\tilde{O}(n^{4/3}m^{1/2}+n^{2})$ time (The $\tilde{O}(\cdot)$ notation hides $\operatorname{polylog}(n)$…

Data Structures and Algorithms · Computer Science 2017-06-22 David Durfee , Rasmus Kyng , John Peebles , Anup B. Rao , Sushant Sachdeva

We present original time-parallel algorithms for the solution of the implicit Euler discretization of general linear parabolic evolution equations with time-dependent self-adjoint spatial operators. Motivated by the inf-sup theory of…

Numerical Analysis · Mathematics 2021-03-24 Martin Neumuller , Iain Smears