English
Related papers

Related papers: A Kaczmarz-Inspired Method for Orthogonalization

200 papers

The Orthogonal Vectors problem ($\textsf{OV}$) asks: given $n$ vectors in $\{0,1\}^{O(\log n)}$, are two of them orthogonal? $\textsf{OV}$ is easily solved in $O(n^2 \log n)$ time, and it is a central problem in fine-grained complexity:…

Data Structures and Algorithms · Computer Science 2018-11-30 Lijie Chen , Ryan Williams

We propose a randomized algorithm for enumerating the vertices of a zonotope, which is a low-dimensional linear projection of a hypercube. The algorithm produces a pair of the zonotope's vertices by sampling a random linear combination of…

Numerical Analysis · Mathematics 2016-02-24 Kerrek Stinson , David F. Gleich , Paul G. Constantine

Phase retrieval has been an attractive but difficult problem rising from physical science, and there has been a gap between state-of-the-art theoretical convergence analyses and the corresponding efficient retrieval methods. Firstly, these…

Information Theory · Computer Science 2017-12-06 Gen Li , Yuchen Jiao , Yuantao Gu

The speed of convergence of the R-linear GMRES is bounded in terms of a polynomial approximation problem on a finite subset of the spectrum. This result resembles the classical GMRES convergence estimate except that the matrix involved is…

Numerical Analysis · Mathematics 2011-12-15 Marko Huhtanen , Allan Perämäki

We present a methodology for parallel acceleration of learning in the presence of matrix orthogonality and unitarity constraints of interest in several branches of machine learning. We show how an apparently sequential elementary rotation…

Machine Learning · Computer Science 2021-06-02 Firas Hamze

We prove that with high probability, a uniform sample of $n$ points in a convex domain in $\mathbb{R}^d$ can be rounded to points on a grid of step size proportional to $1/n^{d+1+\epsilon}$ without changing the underlying chirotope…

Computational Geometry · Computer Science 2020-01-23 Jean Cardinal , Ruy Fabila-Monroy , Carlos Hidalgo-Toscano

We consider a sequence H_N of Hilbert spaces of dimensions d_N tending to infinity. The motivating examples are eigenspaces or quasi-mode spaces of a Laplace or Schrodinger operator. We define a random ONB of H_N by fixing one ONB and…

Spectral Theory · Mathematics 2014-03-05 Steve Zelditch

We describe a data structure, a rectangular complex, that can be used to represent hyperconvex metric spaces that have the same topology (although not necessarily the same distance function) as subsets of the plane. We show how to use this…

Computational Geometry · Computer Science 2016-08-12 David Eppstein

We develop an iterative refinement method that improves the accuracy of a user-chosen subset of $k$ eigenvectors ($k\ll n$) of an $n\times n$ real symmetric matrix. Using an orthogonal matrix represented in compact WY form, the method…

Numerical Analysis · Mathematics 2026-03-02 Takeshi Terao , Katsuhisa Ozaki , Toshiyuki Imamura , Takeshi Ogita

We examine directed spanners through flow-based linear programming relaxations. We design an $\~O(n^{2/3})$-approximation algorithm for the directed $k$-spanner problem that works for all $k\geq 1$, which is the first sublinear…

Data Structures and Algorithms · Computer Science 2010-11-23 Michael Dinitz , Robert Krauthgamer

In this paper, we study the question when a (rational or Gaussian) integral vector can be extended to an integral orthogonal basis consisting of vectors of equal length. We also study when a set of integral vectors has such an extension.…

Number Theory · Mathematics 2025-08-05 Márton Erdélyi , Péter Maga , Gergely Zábrádi

Randomized Kaczmarz is a simple iterative method for finding solutions of linear systems $Ax = b$. We point out that the arising sequence $(x_k)_{k=1}^{\infty}$ tends to converge to the solution $x$ in an interesting way: generically, as $k…

Numerical Analysis · Mathematics 2021-09-15 Stefan Steinerberger

The classical Kaczmarz iteration and its randomized variants are popular tools for fast inversion of linear overdetermined systems. This method extends naturally to the setting of the phase retrieval problem via substituting at each…

Numerical Analysis · Mathematics 2017-07-25 Halyun Jeong , C. Sinan Güntürk

The computation of tunes and matched beam distributions are essential steps in the analysis of circular accelerators. If certain symmetries - like midplane symmetrie - are present, then it is possible to treat the betatron motion in the…

Mathematical Physics · Physics 2013-07-17 Christian Baumgarten

For any finite point set in $D$-dimensional space equipped with the 1-norm, we present random linear embeddings to $k$-dimensional space, with a new metric, having the following properties. For any pair of points from the point set that are…

Probability · Mathematics 2020-11-09 Michael P. Casey

An important theorem of Banaszczyk (Random Structures & Algorithms `98) states that for any sequence of vectors of $\ell_2$ norm at most $1/5$ and any convex body $K$ of Gaussian measure $1/2$ in $\mathbb{R}^n$, there exists a signed…

Data Structures and Algorithms · Computer Science 2016-12-14 Daniel Dadush , Shashwat Garg , Shachar Lovett , Aleksandar Nikolov

It is known that a unitary matrix can be decomposed into a product of reflections, one for each dimension, and the Haar measure on the unitary group pushes forward to independent uniform measures on the reflections. We consider the sequence…

Probability · Mathematics 2014-09-10 Kenneth Maples , Joseph Najnudel , Ashkan Nikeghbali

We consider a one-parameter family of piecewise isometries of a rhombus. The rotational component is fixed, and its coefficients belong to the quadratic number field $K=\mathbb{Q}(\sqrt{2})$. The translations depend on a parameter $s$ which…

Dynamical Systems · Mathematics 2014-06-27 John H. Lowenstein , Franco Vivaldi

Uniform random rotations are a useful primitive in applications such as fast Johnson-Lindenstrauss embeddings, kernel approximation, communication-efficient learning, and recent AI compression pipelines, but they are computationally…

Machine Learning · Computer Science 2026-04-28 Tomer Zilca , Gal Mendelson

We establish a new perturbation theory for orthogonal polynomials using a Riemann--Hilbert approach and consider applications in numerical linear algebra and random matrix theory. This new approach shows that the orthogonal polynomials with…

Probability · Mathematics 2022-09-23 Xiucai Ding , Thomas Trogdon