English
Related papers

Related papers: Analysis of a Classical Matrix Preconditioning Alg…

200 papers

In this paper we consider graph algorithms in models of computation where the space usage (random accessible storage, in addition to the read only input) is sublinear in the number of edges $m$ and the access to input data is constrained.…

Data Structures and Algorithms · Computer Science 2015-04-21 Kook Jin Ahn , Sudipto Guha

We consider the problem of sorting $n$ items, given the outcomes of $m$ pre-existing comparisons. We present a simple and natural deterministic algorithm that runs in $O(m + \log T)$ time and does $O(\log T)$ comparisons, where $T$ is the…

Data Structures and Algorithms · Computer Science 2026-05-06 Bernhard Haeupler , Richard Hladík , John Iacono , Vaclav Rozhon , Robert Tarjan , Jakub Tětek

Classic cache-oblivious parallel matrix multiplication algorithms achieve optimality either in time or space, but not both, which promotes lots of research on the best possible balance or tradeoff of such algorithms. We study modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-14 Yuan Tang

In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized…

Functional Analysis · Mathematics 2010-10-26 Kristian Bredies , Dirk A. Lorenz

Min-plus product of two $n\times n$ matrices is a fundamental problem in algorithm research. It is known to be equivalent to APSP, and in general it has no truly subcubic algorithms. In this paper, we focus on the min-plus product on a…

Data Structures and Algorithms · Computer Science 2022-02-03 Shucheng Chi , Ran Duan , Tianle Xie

We present a sorting algorithm for the case of recurrent random comparison errors. The algorithm essentially achieves simultaneously good properties of previous algorithms for sorting $n$ distinct elements in this model. In particular, it…

Data Structures and Algorithms · Computer Science 2017-09-22 Barbara Geissmann , Stefano Leucci , Chih-Hung Liu , Paolo Penna

We provide new high-accuracy randomized algorithms for solving linear systems and regression problems that are well-conditioned except for $k$ large singular values. For solving such $d \times d$ positive definite system our algorithms…

Data Structures and Algorithms · Computer Science 2025-07-17 Michał Dereziński , Aaron Sidford

Time-parallel algorithms, such as Parareal, are well-understood for linear problems, but their convergence analysis for nonlinear, chaotic systems remains limited. This paper introduces a new theoretical framework for analysing…

Numerical Analysis · Mathematics 2026-04-02 Giancarlo Antonino Antonucci , Raphael Andreas Hauser , Debasmita Samaddar , James Buchanan

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

Interval scheduling is a basic problem in the theory of algorithms and a classical task in combinatorial optimization. We develop a set of techniques for partitioning and grouping jobs based on their starting and ending times, that enable…

Data Structures and Algorithms · Computer Science 2023-02-27 Spencer Compton , Slobodan Mitrović , Ronitt Rubinfeld

Preconditioning has long been a staple technique in optimization, often applied to reduce the condition number of a matrix and speed up the convergence of algorithms. Although there are many popular preconditioning techniques in practice,…

Optimization and Control · Mathematics 2022-11-08 Zhaonan Qu , Wenzhi Gao , Oliver Hinder , Yinyu Ye , Zhengyuan Zhou

This paper considers the matrix completion problem. We show that it is not necessary to assume joint incoherence, which is a standard but unintuitive and restrictive condition that is imposed by previous studies. This leads to a sample…

Information Theory · Computer Science 2016-11-15 Yudong Chen

Many classical and modern machine learning algorithms require solving optimization tasks under orthogonality constraints. Solving these tasks with feasible methods requires a gradient descent update followed by a retraction operation on the…

Optimization and Control · Mathematics 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

Permutation patterns and pattern avoidance have been intensively studied in combinatorics and computer science, going back at least to the seminal work of Knuth on stack-sorting (1968). Perhaps the most natural algorithmic question in this…

Data Structures and Algorithms · Computer Science 2019-08-14 Benjamin Aram Berendsohn , László Kozma , Dániel Marx

We present an iterative algorithm for computing an invariant subspace associated with the algebraically smallest eigenvalues of a large sparse or structured Hermitian matrix A. We are interested in the case in which the dimension of the…

Numerical Analysis · Mathematics 2015-06-22 Eugene Vecharynski , Chao Yang , John E. Pask

We provide faster algorithms and improved sample complexities for approximating the top eigenvector of a matrix. Offline Setting: Given an $n \times d$ matrix $A$, we show how to compute an $\epsilon$ approximate top eigenvector in time…

Data Structures and Algorithms · Computer Science 2016-05-31 Chi Jin , Sham M. Kakade , Cameron Musco , Praneeth Netrapalli , Aaron Sidford

We consider the problem of deterministic load balancing of tokens in the discrete model. A set of $n$ processors is connected into a $d$-regular undirected network. In every time step, each processor exchanges some of its tokens with each…

Data Structures and Algorithms · Computer Science 2015-02-24 Petra Berenbrink , Ralf Klasing , Adrian Kosowski , Frederik Mallmann-Trenn , Przemyslaw Uznanski

We consider stochastic variational inequality problems where the mapping is monotone over a compact convex set. We present two robust variants of stochastic extragradient algorithms for solving such problems. Of these, the first scheme…

Optimization and Control · Mathematics 2014-03-25 Farzad Yousefian , Angelia Nedic , Uday V. Shanbhag

Chaining algorithms aim to form a semi-global alignment of two sequences based on a set of anchoring local alignments as input. Depending on the optimization criteria and the exact definition of a chain, there are several $O(n \log n)$ time…

Data Structures and Algorithms · Computer Science 2020-04-27 Veli Mäkinen , Kristoffer Sahlin

Asymptotically tight lower bounds are derived for the I/O complexity of a general class of hybrid algorithms computing the product of $n \times n$ square matrices combining ``\emph{Strassen-like}'' fast matrix multiplication approach with…

Data Structures and Algorithms · Computer Science 2019-04-30 Lorenzo De Stefani