English
Related papers

Related papers: Solving Tall Dense Linear Programs in Nearly Linea…

200 papers

We present an iterative algorithm for solving a class of \\nonlinear Laplacian system of equations in $\tilde{O}(k^2m \log(kn/\epsilon))$ iterations, where $k$ is a measure of nonlinearity, $n$ is the number of variables, $m$ is the number…

Data Structures and Algorithms · Computer Science 2015-07-29 Eric J. Friedman , Adam S. Landsberg

We study the algorithmic problem of estimating the mean of heavy-tailed random vector in $\mathbb{R}^d$, given $n$ i.i.d. samples. The goal is to design an efficient estimator that attains the optimal sub-gaussian error bound, only assuming…

Statistics Theory · Mathematics 2020-02-19 Zhixian Lei , Kyle Luh , Prayaag Venkat , Fred Zhang

Recently, a class of algorithms combining classical fixed point iterations with repeated random sparsification of approximate solution vectors has been successfully applied to eigenproblems with matrices as large as $10^{108} \times…

Numerical Analysis · Mathematics 2025-04-28 Jonathan Weare , Robert J. Webber

This paper presents fast first-order methods for solving linear programs (LPs) approximately. We adapt online linear programming algorithms to offline LPs and obtain algorithms that avoid any matrix multiplication. We also introduce a…

Optimization and Control · Mathematics 2024-11-07 Wenzhi Gao , Dongdong Ge , Chunlin Sun , Yinyu Ye

Short integer linear programs are programs with a relatively small number of constraints. We show how recent improvements on the running-times of solvers for such programs can be used to obtain fast pseudo-polynomial time algorithms for…

Data Structures and Algorithms · Computer Science 2026-02-09 Danny Hermelin , Dvir Shabtay

In this paper, we obtain improved running times for regression and top eigenvector computation for numerically sparse matrices. Given a data matrix $A \in \mathbb{R}^{n \times d}$ where every row $a \in \mathbb{R}^d$ has $\|a\|_2^2 \leq L$…

Data Structures and Algorithms · Computer Science 2018-11-28 Neha Gupta , Aaron Sidford

We propose statistically robust and computationally efficient linear learning methods in the high-dimensional batch setting, where the number of features $d$ may exceed the sample size $n$. We employ, in a generic learning setting, two…

Machine Learning · Statistics 2023-05-30 Ibrahim Merad , Stéphane Gaïffas

We give a proof of the conjecture of Nelson and Nguyen [FOCS 2013] on the optimal dimension and sparsity of oblivious subspace embeddings, up to sub-polylogarithmic factors: For any $n\geq d$ and $\epsilon\geq d^{-O(1)}$, there is a random…

Data Structures and Algorithms · Computer Science 2025-11-18 Shabarish Chenakkod , Michał Dereziński , Xiaoyu Dong

We study the problem of robustly learning multi-dimensional histograms. A $d$-dimensional function $h: D \rightarrow \mathbb{R}$ is called a $k$-histogram if there exists a partition of the domain $D \subseteq \mathbb{R}^d$ into $k$…

Machine Learning · Computer Science 2018-02-26 Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We investigate quantum algorithms for classification, a fundamental problem in machine learning, with provable guarantees. Given $n$ $d$-dimensional data points, the state-of-the-art (and optimal) classical algorithm for training…

Quantum Physics · Physics 2019-05-28 Tongyang Li , Shouvanik Chakrabarti , Xiaodi Wu

We address complexity issues for linear differential equations in characteristic $p>0$: resolution and computation of the $p$-curvature. For these tasks, our main focus is on algorithms whose complexity behaves well with respect to $p$. We…

Symbolic Computation · Computer Science 2009-01-27 Alin Bostan , Éric Schost

We consider the problem of recovering a low-multilinear-rank tensor from a small amount of linear measurements. We show that the Riemannian gradient algorithm initialized by one step of iterative hard thresholding can reconstruct an…

Numerical Analysis · Mathematics 2021-01-14 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

In this paper, we provide faster algorithms for computing various fundamental quantities associated with random walks on a directed graph, including the stationary distribution, personalized PageRank vectors, hitting times, and escape…

Data Structures and Algorithms · Computer Science 2016-11-03 Michael B. Cohen , Jon Kelner , John Peebles , Richard Peng , Aaron Sidford , Adrian Vladu

This paper shows how to solve linear programs of the form $\min_{Ax=b,x\geq0} c^\top x$ with $n$ variables in time $$O^*((n^{\omega}+n^{2.5-\alpha/2}+n^{2+1/6}) \log(n/\delta))$$ where $\omega$ is the exponent of matrix multiplication,…

Data Structures and Algorithms · Computer Science 2020-10-21 Michael B. Cohen , Yin Tat Lee , Zhao Song

We present a faster interior-point method for optimizing sum-of-squares (SOS) polynomials, which are a central tool in polynomial optimization and capture convex programming in the Lasserre hierarchy. Let $p = \sum_i q^2_i$ be an…

Optimization and Control · Mathematics 2022-02-18 Shunhua Jiang , Bento Natura , Omri Weinstein

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

We study the differentially private top-$k$ selection problem, aiming to identify a sequence of $k$ items with approximately the highest scores from $d$ items. Recent work by Gillenwater et al. (ICML '22) employs a direct sampling approach…

Cryptography and Security · Computer Science 2026-01-09 Hao WU , Hanwen Zhang

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

We present an asymptotically faster algorithm for solving linear systems in well-structured 3-dimensional truss stiffness matrices. These linear systems arise from linear elasticity problems, and can be viewed as extensions of graph…

Data Structures and Algorithms · Computer Science 2018-05-25 Rasmus Kyng , Richard Peng , Robert Schwieterman , Peng Zhang

We consider integer and linear programming problems for which the linear constraints exhibit a (recursive) block-structure: The problem decomposes into independent and efficiently solvable sub-problems if a small number of constraints is…

Computational Complexity · Computer Science 2020-08-04 Jana Cslovjecsek , Friedrich Eisenbrand , Christoph Hunkenschröder , Lars Rohwedder , Robert Weismantel