English
Related papers

Related papers: Optimal Algorithms for Linear Algebra in the Curre…

200 papers

We study three fundamental problems of Linear Algebra, lying in the heart of various Machine Learning applications, namely: 1)"Low-rank Column-based Matrix Approximation". We are given a matrix A and a target rank k. The goal is to select a…

Data Structures and Algorithms · Computer Science 2011-05-05 Christos Boutsidis

The Minimum Linear Arrangement problem (MLA) consists of finding a mapping $\pi$ from vertices of a graph to distinct integers that minimizes $\sum_{\{u,v\}\in E}|\pi(u) - \pi(v)|$. In that setting, vertices are often assumed to lie on a…

Data Structures and Algorithms · Computer Science 2025-11-05 Lluís Alemany-Puig , Juan Luis Esteban , Ramon Ferrer-i-Cancho

Many existing algorithms for streaming geometric data analysis have been plagued by exponential dependencies in the space complexity, which are undesirable for processing high-dimensional data sets. In particular, once $d\geq\log n$, there…

Data Structures and Algorithms · Computer Science 2022-09-28 David P. Woodruff , Taisuke Yasuda

We initiate the study of numerical linear algebra in the sliding window model, where only the most recent $W$ updates in a stream form the underlying data set. We first introduce a unified row-sampling based framework that gives randomized…

Data Structures and Algorithms · Computer Science 2023-04-12 Vladimir Braverman , Petros Drineas , Cameron Musco , Christopher Musco , Jalaj Upadhyay , David P. Woodruff , Samson Zhou

What is the time complexity of matrix multiplication of sparse integer matrices with $m_{in}$ nonzeros in the input and $m_{out}$ nonzeros in the output? This paper provides improved upper bounds for this question for almost any choice of…

Data Structures and Algorithms · Computer Science 2023-09-13 Amir Abboud , Karl Bringmann , Nick Fischer , Marvin Künnemann

We observe that any $T(n)$ time algorithm (quantum or classical) for several central linear algebraic problems, such as computing $\det(A)$, $tr(A^3)$, or $tr(A^{-1})$ for an $n \times n$ integer matrix $A$, yields a $O(T(n)) + \tilde…

Data Structures and Algorithms · Computer Science 2025-09-25 Kyle Doney , Cameron Musco

We propose a new polynomial-time algorithm for linear programming. We further extend the ideas used in this new linear programming algorithm for nonlinear programming problems. The new algorithm is based on the idea of treating the…

General Mathematics · Mathematics 2019-03-14 Dhananjay P. Mehendale

Polynomial system solving is a classical problem in mathematics with a wide range of applications. This makes its complexity a fundamental problem in computer science. Depending on the context, solving has different meanings. In order to…

Symbolic Computation · Computer Science 2013-07-16 Jean-Charles Faugère , Pierrick Gaudry , Louise Huot , Guénaël Renault

We study the problem of maximizing a monotone submodular set function subject to linear packing constraints. An instance of this problem consists of a matrix $A \in [0,1]^{m \times n}$, a vector $b \in [1,\infty)^m$, and a monotone…

Data Structures and Algorithms · Computer Science 2012-05-01 Yossi Azar , Iftah Gamzu

We show that for the problem of testing if a matrix $A \in F^{n \times n}$ has rank at most $d$, or requires changing an $\epsilon$-fraction of entries to have rank at most $d$, there is a non-adaptive query algorithm making…

Data Structures and Algorithms · Computer Science 2018-10-19 Maria-Florina Balcan , Yi Li , David P. Woodruff , Hongyang Zhang

In this paper, we study matrix scaling and balancing, which are fundamental problems in scientific computing, with a long line of work on them that dates back to the 1960s. We provide algorithms for both these problems that, ignoring…

Data Structures and Algorithms · Computer Science 2017-08-22 Michael B. Cohen , Aleksander Madry , Dimitris Tsipras , Adrian Vladu

Efficiently computing accurate representations of high-dimensional data is essential for data analysis and unsupervised learning. Dendrograms, also known as ultrametrics, are widely used representations that preserve hierarchical…

Data Structures and Algorithms · Computer Science 2025-03-18 Gabriel Bathie , Guillaume Lagarde

We consider the problem of efficiently solving large-scale linear least squares problems that have one or more linear constraints that must be satisfied exactly. Whilst some classical approaches are theoretically well founded, they can face…

Numerical Analysis · Mathematics 2021-12-24 Jennifer Scott , Miroslav Tuma

We study the influence of a graph parameter called modular-width on the time complexity for optimally solving well-known polynomial problems such as Maximum Matching, Triangle Counting, and Maximum $s$-$t$ Vertex-Capacitated Flow. The…

Data Structures and Algorithms · Computer Science 2018-04-27 Stefan Kratsch , Florian Nelles

We study the following problem and its applications: given a homogeneous degree-$d$ polynomial $g$ as an arithmetic circuit, and a $d \times d$ matrix $X$ whose entries are homogeneous linear polynomials, compute $g(\partial/\partial x_1,…

Data Structures and Algorithms · Computer Science 2020-05-12 Cornelius Brand , Kevin Pratt

We study the problem of solving linear program in the streaming model. Given a constraint matrix $A\in \mathbb{R}^{m\times n}$ and vectors $b\in \mathbb{R}^m, c\in \mathbb{R}^n$, we develop a space-efficient interior point method that…

Data Structures and Algorithms · Computer Science 2023-05-19 S. Cliff Liu , Zhao Song , Hengjie Zhang , Lichen Zhang , Tianyi Zhou

We use lookup tables to design faster algorithms for important algebraic problems over finite fields. These faster algorithms, which only use arithmetic operations and lookup table operations, may help to explain the difficulty of…

Data Structures and Algorithms · Computer Science 2022-11-10 Josh Alman

The goal of this paper is to understand how exponential-time approximation algorithms can be obtained from existing polynomial-time approximation algorithms, existing parameterized exact algorithms, and existing parameterized approximation…

Data Structures and Algorithms · Computer Science 2023-06-28 Barış Can Esmer , Ariel Kulik , Dániel Marx , Daniel Neuen , Roohani Sharma

Can linear systems be solved faster than matrix multiplication? While there has been remarkable progress for the special cases of graph structured linear systems, in the general setting, the bit complexity of solving an $n \times n$ linear…

Data Structures and Algorithms · Computer Science 2021-01-08 Richard Peng , Santosh Vempala

Near isometric orthogonal embeddings to lower dimensions are a fundamental tool in data science and machine learning. In this paper, we present the construction of such embeddings that minimizes the maximum distortion for a given set of…

Machine Learning · Statistics 2017-12-15 Kshiteej Sheth , Dinesh Garg , Anirban Dasgupta