English
Related papers

Related papers: Solving Dense Linear Systems Faster Than via Preco…

200 papers

Linear regression is one of the most fundamental linear algebra problems. Given a dense matrix $A \in \mathbb{R}^{n \times d}$ and a vector $b$, the goal is to find $x'$ such that $ \| Ax' - b \|_2^2 \leq (1+\epsilon) \min_{x} \| A x - b…

Quantum Physics · Physics 2023-11-28 Zhao Song , Junze Yin , Ruizhe Zhang

We show new algorithms and constructions over linear delta-matroids. We observe an alternative representation for linear delta-matroids, as a contraction representation over a skew-symmetric matrix. This is equivalent to the more standard…

Data Structures and Algorithms · Computer Science 2024-02-20 Tomohiro Koana , Magnus Wahlström

In this paper we show how to recover a spectral approximations to broad classes of structured matrices using only a polylogarithmic number of adaptive linear measurements to either the matrix or its inverse. Leveraging this result we obtain…

Data Structures and Algorithms · Computer Science 2018-12-18 Arun Jambulapati , Kirankumar Shiragur , Aaron Sidford

We give a fully dynamic deterministic algorithm for maintaining a maximal matching of an $n$-vertex graph in $\tilde{O}(n^{8/9})$ amortized update time. This breaks the long-standing $\Omega(n)$-update-time barrier on dense graphs,…

Data Structures and Algorithms · Computer Science 2025-09-01 Aaron Bernstein , Sayan Bhattacharya , Peter Kiss , Thatchaphol Saranurak

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

We investigate the parameterized complexity of Vertex Cover parameterized by the difference between the size of the optimal solution and the value of the linear programming (LP) relaxation of the problem. By carefully analyzing the change…

Data Structures and Algorithms · Computer Science 2012-03-14 Daniel Lokshtanov , N. S. Narayanaswamy , Venkatesh Raman , M. S. Ramanujan , Saket Saurabh

In this paper we provide new randomized algorithms with improved runtimes for solving linear programs with two-sided constraints. In the special case of the minimum cost flow problem on $n$-vertex $m$-edge graphs with integer…

Data Structures and Algorithms · Computer Science 2021-08-24 Jan van den Brand , Yin Tat Lee , Yang P. Liu , Thatchaphol Saranurak , Aaron Sidford , Zhao Song , Di Wang

We propose a stochastic gradient framework for solving stochastic composite convex optimization problems with (possibly) infinite number of linear inclusion constraints that need to be satisfied almost surely. We use smoothing and homotopy…

Optimization and Control · Mathematics 2019-02-04 Olivier Fercoq , Ahmet Alacaoglu , Ion Necoara , Volkan Cevher

We present space efficient Monte Carlo algorithms that solve Subset Sum and Knapsack instances with $n$ items using $O^*(2^{0.86n})$ time and polynomial space, where the $O^*(\cdot)$ notation suppresses factors polynomial in the input size.…

Data Structures and Algorithms · Computer Science 2017-06-27 Nikhil Bansal , Shashwat Garg , Jesper Nederlof , Nikhil Vyas

We study \emph{sublinear} algorithms that solve linear systems locally. In the classical version of this problem the input is a matrix $S\in \mathbb{R}^{n\times n}$ and a vector $b\in\mathbb{R}^n$ in the range of $S$, and the goal is to…

Data Structures and Algorithms · Computer Science 2026-02-23 Alexandr Andoni , Robert Krauthgamer , Yosef Pogrow

We consider stochastic algorithms derived from methods for solving deterministic optimization problems, especially comparison-based algorithms derived from stochastic approximation algorithms with a constant step-size. We develop a…

Optimization and Control · Mathematics 2022-01-03 Youhei Akimoto , Anne Auger , Nikolaus Hansen

We present improved deterministic distributed algorithms for a number of well-studied matching problems, which are simpler, faster, more accurate, and/or more general than their known counterparts. The common denominator of these results is…

Data Structures and Algorithms · Computer Science 2017-08-08 Manuela Fischer

We propose an algorithm for solution of high-dimensional evolutionary equations (ODEs and discretized time-dependent PDEs) in the Tensor Train (TT) decomposition, assuming that the solution and the right-hand side of the ODE admit such a…

Numerical Analysis · Mathematics 2017-10-05 Sergey V. Dolgov

This paper develops and analyzes an optimal-order semi-discrete scheme and its fully discrete finite element approximation for nonlinear stochastic elastic wave equations with multiplicative noise. A non-standard time-stepping scheme is…

Numerical Analysis · Mathematics 2025-04-08 Xiaobing Feng , Yukun Li , Liet Vo

We consider the problem of solving mixed random linear equations with $k$ components. This is the noiseless setting of mixed linear regression. The goal is to estimate multiple linear models from mixed samples in the case where the labels…

Machine Learning · Computer Science 2016-08-23 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

Traditionally, robust statistics has focused on designing estimators tolerant to a minority of contaminated data. Robust list-decodable learning focuses on the more challenging regime where only a minority $\frac 1 k$ fraction of the…

Data Structures and Algorithms · Computer Science 2020-11-20 Ilias Diakonikolas , Daniel M. Kane , Daniel Kongsgaard , Jerry Li , Kevin Tian

The metric $k$-median problem is a textbook clustering problem. As input, we are given a metric space $V$ of size $n$ and an integer $k$, and our task is to find a subset $S \subseteq V$ of at most $k$ `centers' that minimizes the total…

Data Structures and Algorithms · Computer Science 2026-03-31 Martín Costa , Ermiya Farokhnejad

The efficient solution of moderately large-scale linear systems arising from the KKT conditions in optimal control problems (OCPs) is a critical challenge in robotics. With the stagnation of Moore's law, there is growing interest in…

Optimization and Control · Mathematics 2025-05-21 Shaohui Yang , Toshiyuki Ohtsuka , Brian Plancher , Colin N. Jones

In this work, we introduce an asynchronous decentralized accelerated stochastic gradient descent type of method for decentralized stochastic optimization, considering communication and synchronization are the major bottlenecks. We establish…

Optimization and Control · Mathematics 2018-09-26 Guanghui Lan , Yi Zhou

We present new iterative algorithms for solving a square linear system $Ax=b$ in dimension $n$ by employing the {\it Triangle Algorithm} \cite{kal12}, a fully polynomial-time approximation scheme for testing if the convex hull of a finite…

Numerical Analysis · Computer Science 2012-10-31 Bahman Kalantari
‹ Prev 1 3 4 5 6 7 10 Next ›