English
Related papers

Related papers: On Near-Linear-Time Algorithms for Dense Subset Su…

200 papers

We study algorithms for approximating pairwise similarity matrices that arise in natural language processing. Generally, computing a similarity matrix for $n$ data points requires $\Omega(n^2)$ similarity computations. This quadratic…

Machine Learning · Computer Science 2022-04-28 Archan Ray , Nicholas Monath , Andrew McCallum , Cameron Musco

Estimating the density of a distribution from its samples is a fundamental problem in statistics. Hypothesis selection addresses the setting where, in addition to a sample set, we are given $n$ candidate distributions -- referred to as…

Data Structures and Algorithms · Computer Science 2025-10-23 Maryam Aliakbarpour , Zhan Shi , Ria Stevens , Vincent X. Wang

Estimation is the computational task of recovering a hidden parameter $x$ associated with a distribution $D_x$, given a measurement $y$ sampled from the distribution. High dimensional estimation problems arise naturally in statistics,…

Data Structures and Algorithms · Computer Science 2019-08-07 Prasad Raghavendra , Tselil Schramm , David Steurer

We give a high precision polynomial-time approximation scheme for the supremum of any honest n-variate (n+2)-nomial with a constant term, allowing real exponents as well as real coefficients. Our complexity bounds count field operations and…

Algebraic Geometry · Mathematics 2010-11-09 Philippe Pebay , J. Maurice Rojas , David C. Thompson

The weighted low-rank approximation problem is a fundamental numerical linear algebra problem and has many applications in machine learning. Given a $n \times n$ weight matrix $W$ and a $n \times n$ matrix $A$, the goal is to find two…

Computational Complexity · Computer Science 2025-02-25 Chenyang Li , Yingyu Liang , Zhenmei Shi , Zhao Song

In the average-case $k$-SUM problem, given $r$ integers chosen uniformly at random from $\{0,\dots,M-1\}$, the objective is to find a ``solution'' set of $k$ numbers that sum to $0$ modulo $M$. In the dense regime of $M \leq r^k$, where…

Computational Complexity · Computer Science 2023-11-22 Shweta Agrawal , Sagnik Saha , Nikolaj I. Schwartzbach , and Akhil Vanukuri , Prashant Nalini Vasudevan

In this work we study the {\it moment estimation} problem using weighted sampling. Given sample access to a set $A$ with $n$ weighted elements, and a parameter $t>0$, we estimate the $t$-th moment of $A$ given as $S_t=\sum_{a\in A} w(a)^t$.…

Data Structures and Algorithms · Computer Science 2025-02-24 Anup Bhattacharya , Pinki Pradhan

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

Data Structures and Algorithms · Computer Science 2017-11-21 Samuel B. Hopkins , Jerry Li

We describe a probabilistic, {\it sublinear} runtime, measurement-optimal system for model-based sparse recovery problems through dimensionality reducing, {\em dense} random matrices. Specifically, we obtain a linear sketch $u\in \R^M$ of a…

Information Theory · Computer Science 2012-06-22 Anastasios Kyrillidis , Volkan Cevher

Sumsets are central objects in additive combinatorics. In 2007, Granville asked whether one can efficiently recognize whether a given set $S$ is a sumset, i.e. whether there is a set $A$ such that $A+A=S$. Granville suggested an algorithm…

Data Structures and Algorithms · Computer Science 2024-10-29 Amir Abboud , Nick Fischer , Ron Safier , Nathan Wallheimer

We study the algorithmic problem of estimating the mean of heavy-tailed random vector in $\mathbb{R}^d$, given $n$ i.i.d. samples. The goal is to design an efficient estimator that attains the optimal sub-gaussian error bound, only assuming…

Statistics Theory · Mathematics 2020-02-19 Zhixian Lei , Kyle Luh , Prayaag Venkat , Fred Zhang

Recently [Bhattacharya et al., STOC 2015] provide the first non-trivial algorithm for the densest subgraph problem in the streaming model with additions and deletions to its edges, i.e., for dynamic graph streams. They present a…

Data Structures and Algorithms · Computer Science 2015-07-30 Hossein Esfandiari , MohammadTaghi Hajiaghayi , David P. Woodruff

We study the problem of estimating the size of a maximum matching in sublinear time. The problem has been studied extensively in the literature and various algorithms and lower bounds are known for it. Our result is a $0.5109$-approximation…

Data Structures and Algorithms · Computer Science 2025-06-03 Sepideh Mahabadi , Mohammad Roghani , Jakub Tarnawski

We revisit the 3SUM problem in the \emph{preprocessed universes} setting. We present an algorithm that, given three sets $A$, $B$, $C$ of $n$ integers, preprocesses them in quadratic time, so that given any subsets $A' \subseteq A$, $B'…

Data Structures and Algorithms · Computer Science 2025-10-22 Shashwat Kasliwal , Adam Polak , Pratyush Sharma

In this paper we address the constrained longest common subsequence problem. Given two sequences $X$, $Y$ and a constrained sequence $P$, a sequence $Z$ is a constrained longest common subsequence for $X$ and $Y$ with respect to $P$ if $Z$…

Data Structures and Algorithms · Computer Science 2021-03-05 Francis Yuk Lun Chin , Ngai Lam Ho , Alfredo De Santis , S. K. Kim

A conditional sampling oracle for a probability distribution D returns samples from the conditional distribution of D restricted to a specified subset of the domain. A recent line of work (Chakraborty et al. 2013 and Cannone et al. 2014)…

Data Structures and Algorithms · Computer Science 2016-08-18 Themistoklis Gouleakis , Christos Tzamos , Manolis Zampetakis

We consider the problem of estimating the number of distinct elements in a large data set (or, equivalently, the support size of the distribution induced by the data set) from a random sample of its elements. The problem occurs in many…

Machine Learning · Computer Science 2021-06-17 Talya Eden , Piotr Indyk , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner

Integer linear programs $\min\{c^T x : A x = b, x \in \mathbb{Z}^n_{\ge 0}\}$, where $A \in \mathbb{Z}^{m \times n}$, $b \in \mathbb{Z}^m$, and $c \in \mathbb{Z}^n$, can be solved in pseudopolynomial time for any fixed number of constraints…

Data Structures and Algorithms · Computer Science 2024-09-06 Lars Rohwedder , Karol Węgrzycki

The area of sublinear algorithms have recently received a lot of attention. In this setting, one has to choose specific access model for the input, as the algorithm does not have time to pre-process or even to see the whole input. A…

Data Structures and Algorithms · Computer Science 2020-09-24 Jakub Tětek

In the restricted shortest paths problem, we are given a graph $G$ whose edges are assigned two non-negative weights: lengths and delays, a source $s$, and a delay threshold $D$. The goal is to find, for each target $t$, the length of the…

Data Structures and Algorithms · Computer Science 2024-10-23 Vikrant Ashvinkumar , Aaron Bernstein , Adam Karczmarz