English
Related papers

Related papers: Generalizing Greenwald-Khanna Streaming Quantile S…

200 papers

Quantiles, such as the median or percentiles, provide concise and useful information about the distribution of a collection of items, drawn from a totally ordered universe. We study data structures, called quantile summaries, which keep…

Data Structures and Algorithms · Computer Science 2026-01-27 Graham Cormode , Pavel Veselý

Quantile computation is a core primitive in large-scale data analytics. In Spark, practitioners typically rely on the Greenwald-Khanna (GK) Sketch, an approximate method. When exact quantiles are required, the default option is an expensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-29 Ivan Cao , Jaromir J. Saloni , David A. G. Harrison

Approximating quantiles and distributions over streaming data has been studied for roughly two decades now. Recently, Karnin, Lang, and Liberty proposed the first asymptotically optimal algorithm for doing so. This manuscript complements…

Data Structures and Algorithms · Computer Science 2019-07-02 Nikita Ivkin , Edo Liberty , Kevin Lang , Zohar Karnin , Vladimir Braverman

Space-efficient streaming estimation of quantiles in massive datasets is a fundamental problem with numerous applications in data monitoring and analysis. While theoretical research led to optimal algorithms, such as the Greenwald-Khanna…

Data Structures and Algorithms · Computer Science 2025-09-12 Aleksander Łukasiewicz , Jakub Tětek , Pavel Veselý

Empirical copula functions can be used to model the dependence structure of multivariate data. The Greenwald and Khanna algorithm is adapted in order to provide a space-memory efficient approximation to the empirical copula function of a…

Computation · Statistics 2019-01-23 Alastair Gregory

Exponential histograms, with bins of the form $\left\{ \left(\rho^{k-1},\rho^{k}\right]\right\} _{k\in\mathbb{Z}}$, for $\rho>1$, straightforwardly summarize the quantiles of streaming data sets (Masson et al. 2019). While they guarantee…

Statistics Theory · Mathematics 2024-04-30 Philip T. Labo

Two crucial issues for text summarization to generate faithful summaries are to make use of knowledge beyond text and to make use of cross-sentence relations in text. Intuitive ways for the two issues are Knowledge Graph (KG) and Graph…

Computation and Language · Computer Science 2023-12-07 Jingqiang Chen

Estimating quantiles is one of the foundational problems of data sketching. Given $n$ elements $x_1, x_2, \dots, x_n$ from some universe of size $U$ arriving in a data stream, a quantile sketch estimates the rank of any element with…

Data Structures and Algorithms · Computer Science 2024-04-08 Meghal Gupta , Mihir Singhal , Hongxun Wu

Stream monitoring is fundamental in many data stream applications, such as financial data trackers, security, anomaly detection, and load balancing. In that respect, quantiles are of particular interest, as they often capture the user's…

Data Structures and Algorithms · Computer Science 2022-01-07 Rana Shahout , Roy Friedman , Ran Ben Basat

Efficient learning from streaming data is important for modern data analysis due to the continuous and rapid evolution of data streams. Despite significant advancements in stream pattern mining, challenges persist, particularly in managing…

Machine Learning · Computer Science 2024-11-04 Lamine Diop , Marc Plantevit , Arnaud Soulet

A graph stream is a continuous sequence of data items, in which each item indicates an edge, including its two endpoints and edge weight. It forms a dynamic graph that changes with every item in the stream. Graph streams play important…

Data Structures and Algorithms · Computer Science 2018-09-06 Xiangyang Gou , Lei Zou , Chenxingyu Zhao , Tong Yang

A quantile summary is a data structure that approximates to $\varepsilon$-relative error the order statistics of a much larger underlying dataset. In this paper we develop a randomized online quantile summary for the cash register data…

Data Structures and Algorithms · Computer Science 2015-03-05 David Felber , Rafail Ostrovsky

Knowledge Graphs (KGs) integrate heterogeneous data, but one challenge is the development of efficient tools for allowing end users to extract useful insights from these sources of knowledge. In such a context, reducing the size of a…

Databases · Computer Science 2022-05-30 Emetis Niazmand , Gezim Sejdiu , Damien Graux , Maria-Esther Vidal

Query-focused summarization (QFS) aims to provide a summary of a document that satisfies information need of a given query and is useful in various IR applications, such as abstractive snippet generation. Current QFS approaches typically…

Information Retrieval · Computer Science 2023-04-25 Zhichao Xu , Daniel Cohen

An $\varepsilon$-approximate quantile sketch over a stream of $n$ inputs approximates the rank of any query point $q$ - that is, the number of input points less than $q$ - up to an additive error of $\varepsilon n$, generally with some…

Data Structures and Algorithms · Computer Science 2023-04-18 Nicholas Schiefer , Justin Y. Chen , Piotr Indyk , Shyam Narayanan , Sandeep Silwal , Tal Wagner

Graph streams, which refer to the graph with edges being updated sequentially in a form of a stream, have wide applications such as cyber security, social networks and transportation networks. This paper studies the problem of summarizing…

Databases · Computer Science 2015-10-09 Nan Tang , Qing Chen , Prasenjit Mitra

Estimating ranks, quantiles, and distributions over streaming data is a central task in data analysis and monitoring. Given a stream of $n$ items from a data universe equipped with a total order, the task is to compute a sketch (data…

Data Structures and Algorithms · Computer Science 2023-08-25 Graham Cormode , Zohar Karnin , Edo Liberty , Justin Thaler , Pavel Veselý

Sequential quantile estimation refers to incorporating observations into quantile estimates in an incremental fashion thus furnishing an online estimate of one or more quantiles at any given point in time. Sequential quantile estimation is…

Computation · Statistics 2017-03-07 Michael Stephanou , Melvin Varughese , Iain Macdonald

Estimation of the accuracy of a large-scale knowledge graph (KG) often requires humans to annotate samples from the graph. How to obtain statistically meaningful estimates for accuracy evaluation while keeping human annotation costs low is…

Databases · Computer Science 2019-07-24 Junyang Gao , Xian Li , Yifan Ethan Xu , Bunyamin Sisman , Xin Luna Dong , Jun Yang

We introduce the poly-streaming model, a generalization of streaming models of computation in which $k$ processors process $k$ data streams containing a total of $N$ items. The algorithm is allowed $O\left(f(k)\cdot M_1\right)$ space, where…

Data Structures and Algorithms · Computer Science 2025-07-21 Ahammed Ullah , S. M. Ferdous , Alex Pothen
‹ Prev 1 2 3 10 Next ›