中文
相关论文

相关论文: Analysis of Knuth's Sampling Algorithm D and D'

200 篇论文

Given $m$ distributed data streams $A_1, \dots, A_m$, we consider the problem of estimating the number of unique identifiers in streams defined by set expressions over $A_1, \dots, A_m$. We identify a broad class of algorithms for solving…

数据结构与算法 · 计算机科学 2016-02-25 Anirban Dasgupta , Kevin Lang , Lee Rhodes , Justin Thaler

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

数据库 · 计算机科学 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

数据结构与算法 · 计算机科学 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

计算机视觉与模式识别 · 计算机科学 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

Common clustering algorithms require multiple scans of all the data to achieve convergence, and this is prohibitive when large databases, with data arriving in streams, must be processed. Some algorithms to extend the popular K-means method…

应用统计 · 统计学 2017-12-22 Giacomo Aletti , Alessandra Micheletti

The turnstile continual release model of differential privacy captures scenarios where a privacy-preserving real-time analysis is sought for a dataset evolving through additions and deletions. In typical applications of real-time data…

数据结构与算法 · 计算机科学 2025-05-30 Rachel Cummings , Alessandro Epasto , Jieming Mao , Tamalika Mukherjee , Tingting Ou , Peilin Zhong

Computing the approximate quantiles or ranks of a stream is a fundamental task in data monitoring. Given a stream of elements $x_1, x_2, \dots, x_n$ and a query $x$, a relative-error quantile estimation algorithm can estimate the rank of…

数据结构与算法 · 计算机科学 2024-11-05 Elena Gribelyuk , Pachara Sawettamalya , Hongxun Wu , Huacheng Yu

Topic models, such as Latent Dirichlet Allocation (LDA), posit that documents are drawn from admixtures of distributions over words, known as topics. The inference problem of recovering topics from admixtures, is NP-hard. Assuming…

机器学习 · 统计学 2014-11-05 Trapit Bansal , Chiranjib Bhattacharyya , Ravindran Kannan

We consider the distinct elements problem, where the goal is to estimate the number of distinct colors in an urn containing $ k $ balls based on $n$ samples drawn with replacements. Based on discrete polynomial approximation and…

统计理论 · 数学 2018-01-16 Yihong Wu , Pengkun Yang

This material introduces the D-Subspace algorithm derived on the basis of the centralized algorithm [1], which originally addresses parameter estimation problems under a subspace constraint.

信号处理 · 电气工程与系统科学 2024-11-19 Yitong Chen , Danqi Jin , Jie Chen , Cedric Richard

A streaming algorithm is adversarially robust if it is guaranteed to perform correctly even in the presence of an adaptive adversary. Recently, several sophisticated frameworks for robustification of classical streaming algorithms have been…

数据结构与算法 · 计算机科学 2021-09-09 Omri Ben-Eliezer , Talya Eden , Krzysztof Onak

A set of intervals is independent when the intervals are pairwise disjoint. In the interval selection problem we are given a set $\mathbb{I}$ of intervals and we want to find an independent subset of intervals of largest cardinality. Let…

数据结构与算法 · 计算机科学 2015-02-05 Sergio Cabello , Pablo Pérez-Lantero

We present data streaming algorithms for the $k$-median problem in high-dimensional dynamic geometric data streams, i.e. streams allowing both insertions and deletions of points from a discrete Euclidean space $\{1, 2, \ldots \Delta\}^d$.…

数据结构与算法 · 计算机科学 2017-06-14 Vladimir Braverman , Gereon Frahling , Harry Lang , Christian Sohler , Lin F. Yang

Estimating frequencies of elements appearing in a data stream is a key task in large-scale data analysis. Popular sketching approaches to this problem (e.g., CountMin and CountSketch) come with worst-case guarantees that probabilistically…

数据结构与算法 · 计算机科学 2023-12-13 Anders Aamand , Justin Y. Chen , Huy Lê Nguyen , Sandeep Silwal , Ali Vakilian

We study streaming algorithms for the interval selection problem: finding a maximum cardinality subset of disjoint intervals on the line. A deterministic 2-approximation streaming algorithm for this problem is developed, together with an…

数据结构与算法 · 计算机科学 2015-03-20 Yuval Emek , Magnus M. Halldorsson , Adi Rosen

This paper considers the problem of cardinality estimation in data stream applications. We present a statistical analysis of probabilistic counting algorithms, focusing on two techniques that use pseudo-random variates to form…

统计计算 · 统计学 2012-11-20 Peter Clifford , Ioana A. Cosma

Sorting an array is a fundamental routine in machine learning, one that is used to compute rank-based statistics, cumulative distribution functions (CDFs), quantiles, or to select closest neighbors and labels. The sorting function is…

机器学习 · 计算机科学 2019-11-05 Marco Cuturi , Olivier Teboul , Jean-Philippe Vert

Since Rendle and Krichene argued that commonly used sampling-based evaluation metrics are "inconsistent" with respect to the global metrics (even in expectation), there have been a few studies on the sampling-based recommender system…

信息检索 · 计算机科学 2023-10-12 Dong Li , Ruoming Jin , Zhenming Liu , Bin Ren , Jing Gao , Zhi Liu

Determinantal point processes (DPPs) are well known models for diverse subset selection problems, including recommendation tasks, document summarization and image search. In this paper, we discuss a greedy deterministic adaptation of k-DPP.…

机器学习 · 计算机科学 2021-05-31 Joachim Schreurs , Michaël Fanuel , Johan A. K. Suykens

This paper is concerned with distributed computation of several commonly used centrality measures in complex networks. In particular, we propose deterministic algorithms, which converge in finite time, for the distributed computation of the…

系统与控制 · 计算机科学 2016-11-15 Keyou You , Roberto Tempo , Li Qiu