English
Related papers

Related papers: Optimal quantile estimation: beyond the comparison…

200 papers

In this paper, we present a new algorithm for maintaining linear sketches in turnstile streams with faster update time. As an application, we show that $\log n$ \texttt{Count} sketches or \texttt{CountMin} sketches with a constant number of…

Data Structures and Algorithms · Computer Science 2019-11-05 Josh Alman , Huacheng Yu

In this paper, we show that the bundle method can be applied to solve semidefinite programming problems with a low rank solution without ever constructing a full matrix. To accomplish this, we use recent results from randomly sketching…

Optimization and Control · Mathematics 2021-02-02 Lijun Ding , Benjamin Grimmer

Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts…

Data Structures and Algorithms · Computer Science 2024-02-14 Homin K. Lee , Charles Masson

Given a set of n points in the plane, each point having a positive weight, and an integer k>0, we present an optimal O(n \log n)-time deterministic algorithm to compute a step function with k steps that minimizes the maximum weighted…

Data Structures and Algorithms · Computer Science 2012-10-12 Hervé Fournier , Antoine Vigneron

Consider the problem of estimating the median of N items to a precision epsilon, i.e., the estimate should be such that, with a high probability, the number of items, with values both smaller than and larger than this estimate, is less than…

Quantum Physics · Physics 2007-05-23 Lov K. Grover

CountSketch and Feature Hashing (the "hashing trick") are popular randomized dimensionality reduction methods that support recovery of $\ell_2$-heavy hitters (keys $i$ where $v_i^2 > \epsilon \|\boldsymbol{v}\|_2^2$) and approximate inner…

Data Structures and Algorithms · Computer Science 2022-08-30 Edith Cohen , Jelani Nelson , Tamás Sarlós , Uri Stemmer

Estimating quantiles, like the median or percentiles, is a fundamental task in data mining and data science. A (streaming) quantile summary is a data structure that can process a set S of n elements in a streaming fashion and at the end,…

Data Structures and Algorithms · Computer Science 2023-03-14 Sepehr Assadi , Nirmit Joshi , Milind Prabhu , Vihan Shah

Count-Min Sketch is a widely adopted algorithm for approximate event counting in large scale processing. However, the original version of the Count-Min-Sketch (CMS) suffers of some deficiences, especially if one is interested by the…

Information Retrieval · Computer Science 2015-02-18 Guillaume Pitel , Geoffroy Fouquier

This paper addresses the limitations of conventional vector quantization algorithms, particularly K-Means and its variant K-Means++, and investigates the Stochastic Quantization (SQ) algorithm as a scalable alternative for high-dimensional…

Machine Learning · Computer Science 2025-03-11 Anton Kozyriev , Vladimir Norkin

Given point sets $A$ and $B$ in $\mathbb{R}^d$ where $A$ and $B$ have equal size $n$ for some constant dimension $d$ and a parameter $\varepsilon>0$, we present the first deterministic algorithm that computes, in $n\cdot(\varepsilon^{-1}…

Data Structures and Algorithms · Computer Science 2022-04-11 Pankaj K. Agarwal , Hsien-Chih Chang , Sharath Raghvendra , Allen Xiao

We give the first L_1-sketching algorithm for integer vectors which produces nearly optimal sized sketches in nearly linear time. This answers the first open problem in the list of open problems from the 2006 IITK Workshop on Algorithms for…

Data Structures and Algorithms · Computer Science 2009-04-15 Jelani Nelson , David P. Woodruff

We prove that two popular linear contextual bandit algorithms, OFUL and Thompson Sampling, can be made efficient using Frequent Directions, a deterministic online sketching technique. More precisely, we show that a sketch of size $m$ allows…

Machine Learning · Computer Science 2022-03-22 Ilja Kuzborskij , Leonardo Cella , Nicolò Cesa-Bianchi

Quantum state tomography (QST), the task of estimating an unknown quantum state given measurement outcomes, is essential to building reliable quantum computing devices. Whereas computing the maximum-likelihood (ML) estimate corresponds to…

Machine Learning · Computer Science 2022-08-30 Chien-Ming Lin , Yu-Ming Hsu , Yen-Huan Li

We give a quantum approximation scheme (i.e., $(1 + \varepsilon)$-approximation for every $\varepsilon > 0$) for the classical $k$-means clustering problem in the QRAM model with a running time that has only polylogarithmic dependence on…

Quantum Physics · Physics 2025-05-27 Ragesh Jaiswal

Maximum consensus estimation plays a critically important role in robust fitting problems in computer vision. Currently, the most prevalent algorithms for consensus maximization draw from the class of randomized hypothesize-and-verify…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Huu Le , Tat-Jun Chin , Anders Eriksson , Thanh-Toan Do , David Suter

We initiate a broad study of classical problems in the streaming model with insertions and deletions in the setting where we allow the approximation factor $\alpha$ to be much larger than $1$. Such algorithms can use significantly less…

Data Structures and Algorithms · Computer Science 2022-07-19 Yi Li , Honghao Lin , David P. Woodruff , Yuheng Zhang

Kernel methods are fundamental in machine learning, and faster algorithms for kernel approximation provide direct speedups for many core tasks in machine learning. The polynomial kernel is especially important as other kernels can often be…

Data Structures and Algorithms · Computer Science 2021-08-24 Zhao Song , David P. Woodruff , Zheng Yu , Lichen Zhang

We consider the problem of ranking $N$ objects starting from a set of noisy pairwise comparisons provided by a crowd of equal workers. We assume that objects are endowed with intrinsic qualities and that the probability with which an object…

Information Retrieval · Computer Science 2020-02-27 Evgenia Christoforou , Alessandro Nordio , Alberto Tarable , Emilio Leonardi

We provide efficient algorithms for overconstrained linear regression problems with size $n \times d$ when the loss function is a symmetric norm (a norm invariant under sign-flips and coordinate-permutations). An important class of…

Data Structures and Algorithms · Computer Science 2019-10-08 Zhao Song , Ruosong Wang , Lin F. Yang , Hongyang Zhang , Peilin Zhong

Quantile summaries provide a scalable way to estimate the distribution of individual attributes in large datasets that are often distributed across multiple machines or generated by sensor networks. ReqSketch (arXiv:2004.01668) is currently…

Data Structures and Algorithms · Computer Science 2025-11-24 Tomáš Domes , Pavel Veselý