English
Related papers

Related papers: Robust Shift-and-Invert Preconditioning: Faster an…

200 papers

We provide the first nearly-linear time algorithm for approximating $\ell_{q \rightarrow p}$-norms of non-negative matrices, for $q \geq p \geq 1$. Our algorithm returns a $(1-\varepsilon)$-approximation to the matrix norm in time…

Data Structures and Algorithms · Computer Science 2025-03-26 Étienne Objois , Adrian Vladu

For many hard computational problems, simple algorithms that run in time $2^n \cdot n^{O(1)}$ arise, say, from enumerating all subsets of a size-$n$ set. Finding (exponentially) faster algorithms is a natural goal that has driven much of…

Data Structures and Algorithms · Computer Science 2025-06-30 László Kozma , Junqi Tan

Semidefinite programs (SDPs) are a fundamental class of optimization problems with important recent applications in approximation algorithms, quantum complexity, robust learning, algorithmic rounding, and adversarial deep learning. This…

Data Structures and Algorithms · Computer Science 2020-09-23 Haotian Jiang , Tarun Kathuria , Yin Tat Lee , Swati Padmanabhan , Zhao Song

Here, we give an algorithm for deciding if the nonnegative rank of a matrix $M$ of dimension $m \times n$ is at most $r$ which runs in time $(nm)^{O(r^2)}$. This is the first exact algorithm that runs in time singly-exponential in $r$. This…

Data Structures and Algorithms · Computer Science 2012-05-02 Ankur Moitra

The algorithmic tasks of computing the Hamming distance between a given pattern of length $m$ and each location in a text of length $n$ is one of the most fundamental algorithmic tasks in string algorithms. Unfortunately, there is evidence…

Data Structures and Algorithms · Computer Science 2015-12-15 Tsvi Kopelowitz , Ely Porat

We develop a new algorithmic technique that allows to transfer some constant time approximation algorithms for general graphs into random order streaming algorithms. We illustrate our technique by proving that in random order streams with…

Data Structures and Algorithms · Computer Science 2017-11-15 Pan Peng , Christian Sohler

We study the bit complexity of inverting diagonally dominant matrices, which are associated with random walk quantities such as hitting times and escape probabilities. Such quantities can be exponentially small, even on undirected…

Data Structures and Algorithms · Computer Science 2025-10-23 Mehrdad Ghadiri , Hoai-An Nguyen , Junzhao Yang

Computing optimal transport (OT) distances such as the earth mover's distance is a fundamental problem in machine learning, statistics, and computer vision. In this paper, we study the problem of approximating the general OT distance…

Data Structures and Algorithms · Computer Science 2023-01-18 Zhao Song , Tianyi Zhou

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We propose a second-order accurate method to estimate the eigenvectors of extremely large matrices thereby addressing a problem of relevance to statisticians working in the analysis of very large datasets. More specifically, we show that…

Numerical Analysis · Mathematics 2010-02-05 Noureddine El Karoui , Alexandre d'Aspremont

We give a randomized $2^{n+o(n)}$-time and space algorithm for solving the Shortest Vector Problem (SVP) on n-dimensional Euclidean lattices. This improves on the previous fastest algorithm: the deterministic $\widetilde{O}(4^n)$-time and…

Data Structures and Algorithms · Computer Science 2019-01-28 Divesh Aggarwal , Daniel Dadush , Oded Regev , Noah Stephens-Davidowitz

We develop a general framework for estimating the $L_\infty(\mathbb{T}^d)$ error for the approximation of multivariate periodic functions belonging to specific reproducing kernel Hilbert spaces (RHKS) using approximants that are…

Numerical Analysis · Mathematics 2019-09-06 Lutz Kämmerer

We study a classical iterative algorithm for balancing matrices in the $L_\infty$ norm via a scaling transformation. This algorithm, which goes back to Osborne and Parlett \& Reinsch in the 1960s, is implemented as a standard preconditioner…

Data Structures and Algorithms · Computer Science 2015-06-16 Leonard J. Schulman , Alistair Sinclair

We study algorithms for spectral graph sparsification. The input is a graph $G$ with $n$ vertices and $m$ edges, and the output is a sparse graph $\tilde{G}$ that approximates $G$ in an algebraic sense. Concretely, for all vectors $x$ and…

Data Structures and Algorithms · Computer Science 2013-11-19 Ioannis Koutis , Alex Levin , Richard Peng

We develop and analyze efficient "coordinate-wise" methods for finding the leading eigenvector, where each step involves only a vector-vector product. We establish global convergence with overall runtime guarantees that are at least as good…

Numerical Analysis · Computer Science 2017-02-28 Jialei Wang , Weiran Wang , Dan Garber , Nathan Srebro

Given a source of iid samples of edges of an input graph $G$ with $n$ vertices and $m$ edges, how many samples does one need to compute a constant factor approximation to the maximum matching size in $G$? Moreover, is it possible to obtain…

Data Structures and Algorithms · Computer Science 2019-07-15 Michael Kapralov , Slobodan Mitrović , Ashkan Norouzi-Fard , Jakab Tardos

Have you ever wanted to multiply an $n \times d$ matrix $X$, with $n \gg d$, on the left by an $m \times n$ matrix $\tilde G$ of i.i.d. Gaussian random variables, but could not afford to do it because it was too slow? In this work we…

Data Structures and Algorithms · Computer Science 2020-12-10 Michael Kapralov , Vamsi K. Potluru , David P. Woodruff

Subspace methods are commonly used for finding approximate eigenvalues and singular values of large-scale matrices. Once a subspace is found, the Rayleigh-Ritz method (for symmetric eigenvalue problems) and Petrov-Galerkin projection (for…

Numerical Analysis · Mathematics 2025-10-07 Irina-Beatrice Haas , Yuji Nakatsukasa

Optimal transportation, or computing the Wasserstein or ``earth mover's'' distance between two distributions, is a fundamental primitive which arises in many learning and statistical settings. We give an algorithm which solves this problem…

Data Structures and Algorithms · Computer Science 2019-06-04 Arun Jambulapati , Aaron Sidford , Kevin Tian

The largest eigenvalue of a matrix is always larger or equal than its largest diagonal entry. We show that for a large class of random Laplacian matrices, this bound is essentially tight: the largest eigenvalue is, up to lower order terms,…

Probability · Mathematics 2015-07-28 Afonso S. Bandeira