English
Related papers

Related papers: Analysis of a Classical Matrix Preconditioning Alg…

200 papers

A saddlepoint of an $n \times n$ matrix $A$ is an entry of $A$ that is a maximum in its row and a minimum in its column. Knuth (1968) gave several different algorithms for finding a saddlepoint. The worst-case running time of these…

Data Structures and Algorithms · Computer Science 2023-10-26 Justin Dallant , Frederik Haagensen , Riko Jacob , László Kozma , Sebastian Wild

In this paper we consider the well-studied problem of finding a perfect matching in a d-regular bipartite graph on 2n nodes with m=nd edges. The best-known algorithm for general bipartite graphs (due to Hopcroft and Karp) takes time…

Data Structures and Algorithms · Computer Science 2010-11-15 Ashish Goel , Michael Kapralov , Sanjeev Khanna

We study randomized variants of two classical algorithms: coordinate descent for systems of linear equations and iterated projections for systems of linear inequalities. Expanding on a recent randomized iterated projection algorithm of…

Optimization and Control · Mathematics 2008-06-19 D. Leventhal , A. S. Lewis

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

We study stochastic approximation algorithms with Markovian noise and constant step-size $\alpha$. We develop a method based on infinitesimal generator comparisons to study the bias of the algorithm, which is the expected difference between…

Machine Learning · Statistics 2024-10-28 Sebastian Allmeier , Nicolas Gast

We present an algorithm that, with high probability, generates a random spanning tree from an edge-weighted undirected graph in $\tilde{O}(n^{4/3}m^{1/2}+n^{2})$ time (The $\tilde{O}(\cdot)$ notation hides $\operatorname{polylog}(n)$…

Data Structures and Algorithms · Computer Science 2017-06-22 David Durfee , Rasmus Kyng , John Peebles , Anup B. Rao , Sushant Sachdeva

In this paper, we address the weighted linear matroid intersection problem from the computation of the degree of the determinants of a symbolic matrix. We show that a generic algorithm computing the degree of noncommutative determinants,…

Data Structures and Algorithms · Computer Science 2020-03-06 Hiroki Furue , Hiroshi Hirai

Many applications, including rank aggregation and crowd-labeling, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and columns. We consider the problem of estimating such a matrix based on…

Machine Learning · Statistics 2018-06-06 Cheng Mao , Ashwin Pananjady , Martin J. Wainwright

Algebraic matrix multiplication algorithms are designed by bounding the rank of matrix multiplication tensors, and then using a recursive method. However, designing algorithms in this way quickly leads to large constant factors: if one…

Computational Complexity · Computer Science 2024-10-29 Josh Alman , Hantao Yu

In the online bipartite matching problem with replacements, all the vertices on one side of the bipartition are given, and the vertices on the other side arrive one by one with all their incident edges. The goal is to maintain a maximum…

Data Structures and Algorithms · Computer Science 2018-05-07 Aaron Bernstein , Jacob Holm , Eva Rotenberg

We propose quantum algorithms, purely quantum in nature, for calculating the determinant and inverse of an $(N-1)\times (N-1)$ matrix (depth is $O(N^2\log N)$) which is a simple modification of the algorithm for calculating the determinant…

Quantum Physics · Physics 2025-06-02 Alexander I. Zenchuk , Georgii A. Bochkin , Wentao Qi , Asutosh Kumar , Junde Wu

We consider the problem of online forecasting of sequences of length $n$ with total-variation at most $C_n$ using observations contaminated by independent $\sigma$-subgaussian noise. We design an $O(n\log n)$-time algorithm that achieves a…

Machine Learning · Computer Science 2019-10-29 Dheeraj Baby , Yu-Xiang Wang

In this article, we present a new approach to averaging in non-Hamiltonian systems with periodic forcing. The results here do not depend on the existence of a small parameter. In fact, we show that our averaging method fits into an…

Dynamical Systems · Mathematics 2010-06-15 Mickaël D. Chekroun , Michael Ghil , Jean Roux , Ferenc Varadi

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

In a classical scheduling problem, we are given a set of $n$ jobs of unit length along with precedence constraints and the goal is to find a schedule of these jobs on $m$ identical machines that minimizes the makespan. This problem is…

Data Structures and Algorithms · Computer Science 2022-08-05 Jesper Nederlof , Céline M. F. Swennenhuis , Karol Węgrzycki

Early stopping of iterative algorithms is an algorithmic regularization method to avoid over-fitting in estimation and classification. In this paper, we show that early stopping can also be applied to obtain the minimax optimal testing in a…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Guang Cheng

Lin and Lin have recently shown how starting with a classical query algorithm (decision tree) for a function, we may find upper bounds on its quantum query complexity. More precisely, they have shown that given a decision tree for a…

Quantum Physics · Physics 2020-03-04 Salman Beigi , Leila Taghavi

The main purpose of this paper is to propose a variance-based Bregman extragradient algorithm with line search for solving stochastic variational inequalities, which is robust with respect an unknown Lipschitz constant. We prove the almost…

Optimization and Control · Mathematics 2022-08-31 Xian-Jun Long , Yue-Hong He , Nan-Jing Huang

Finding the sparset solution of an underdetermined system of linear equations $y=Ax$ has attracted considerable attention in recent years. Among a large number of algorithms, iterative thresholding algorithms are recognized as one of the…

Information Theory · Computer Science 2013-10-16 Jinshan Zeng , Shaobo Lin , Zongben Xu

The purpose of this paper is to establish bounds on the rate of convergence of the conjugate gradient algorithm when the underlying matrix is a random positive definite perturbation of a deterministic positive definite matrix. We estimate…

Numerical Analysis · Mathematics 2016-11-08 Govind Menon , Thomas Trogdon