English
Related papers

Related papers: Streaming Algorithms for Support-Aware Histograms

200 papers

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré

For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least squares estimate in linear regression, where…

Computation · Statistics 2019-06-27 HaiYing Wang , Rong Zhu , Ping Ma

We propose a streaming algorithm for the binary classification of data based on crowdsourcing. The algorithm learns the competence of each labeller by comparing her labels to those of other labellers on the same tasks and uses this…

Machine Learning · Statistics 2016-02-24 Thomas Bonald , Richard Combes

The statistical problem of parameter estimation in partially observed hypoelliptic diffusion processes is naturally occurring in many applications. However, due to the noise structure, where the noise components of the different coordinates…

Methodology · Statistics 2018-11-13 Susanne Ditlevsen , Adeline Samson

We consider the task of estimating the entropy of $k$-ary distributions from samples in the streaming model, where space is limited. Our main contribution is an algorithm that requires $O\left(\frac{k \log…

Information Theory · Computer Science 2019-11-20 Jayadev Acharya , Sourbh Bhadane , Piotr Indyk , Ziteng Sun

We study how to verify specific frequency distributions when we observe a stream of $N$ data items taken from a universe of $n$ distinct items. We introduce the \emph{relative Fr\'echet distance} to compare two frequency functions in a…

Data Structures and Algorithms · Computer Science 2025-08-26 Claire Mathieu , Michel de Rougemont

Sparse regression has been a popular approach to perform variable selection and enhance the prediction accuracy and interpretability of the resulting statistical model. Existing approaches focus on offline regularized regression, while the…

Machine Learning · Statistics 2023-01-03 Shuoguang Yang , Yuhao Yan , Xiuneng Zhu , Qiang Sun

Devising intelligent agents able to live in an environment and learn by observing the surroundings is a longstanding goal of Artificial Intelligence. From a bare Machine Learning perspective, challenges arise when the agent is prevented…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Matteo Tiezzi , Simone Marullo , Lapo Faggi , Enrico Meloni , Alessandro Betti , Stefano Melacci

In this paper, we focus on lower bounds and algorithms for some basic geometric problems in the one-pass (insertion only) streaming model. The problems considered are grouped into three categories: (i) Klee's measure (ii) Convex body…

Computational Geometry · Computer Science 2018-03-20 Arijit Bishnu , Arijit Ghosh , Gopinath Mishra , Sandeep Sen

Online 3D reconstruction requires estimating camera pose and scene geometry under strict causal and bounded-memory constraints. Existing methods often suffer from drift, jitter, or collapse on long sequences. We trace these failures to a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Chong Cheng , Peilin Tao , Nanjie Yao , Guanzhi Ding , Xianda Chen , Yuansen Du , Xiaoyang Guo , Wei Yin , Weiqiang Ren , Qian Zhang , Zhengqing Chen , Hao Wang

We consider the classic Set Cover problem in the data stream model. For $n$ elements and $m$ sets ($m\geq n$) we give a $O(1/\delta)$-pass algorithm with a strongly sub-linear $\tilde{O}(mn^{\delta})$ space and logarithmic approximation…

Data Structures and Algorithms · Computer Science 2016-05-03 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi , Ali Vakilian

A pseudo-deterministic algorithm is a (randomized) algorithm which, when run multiple times on the same input, with high probability outputs the same result on all executions. Classic streaming algorithms, such as those for finding heavy…

Computational Complexity · Computer Science 2019-11-27 Shafi Goldwasser , Ofer Grossman , Sidhanth Mohanty , David P. Woodruff

We investigate one of the most basic problems in streaming algorithms: approximating the number of elements in the stream. In 1978, Morris famously gave a randomized algorithm achieving a constant-factor approximation error for streams of…

Data Structures and Algorithms · Computer Science 2024-10-08 Ofer Grossman , Meghal Gupta , Mark Sellke

This paper addresses a fundamental problem in random variate generation: given access to a random source that emits a stream of independent fair bits, what is the most accurate and entropy-efficient algorithm for sampling from a discrete…

Data Structures and Algorithms · Computer Science 2020-03-10 Feras A. Saad , Cameron E. Freer , Martin C. Rinard , Vikash K. Mansinghka

We study linear programming and general LP-type problems in several big data (streaming and distributed) models. We mainly focus on low dimensional problems in which the number of constraints is much larger than the number of variables. Low…

Data Structures and Algorithms · Computer Science 2019-03-14 Sepehr Assadi , Nikolai Karpov , Qin Zhang

The \emph{$\ell_2$ tracking problem} is the task of obtaining a streaming algorithm that, given access to a stream of items $a_1,a_2,a_3,\ldots$ from a universe $[n]$, outputs at each time $t$ an estimate to the $\ell_2$ norm of the…

Data Structures and Algorithms · Computer Science 2019-09-02 Chi-Ning Chou , Zhixian Lei , Preetum Nakkiran

Embedding networks into a fixed dimensional feature space, while preserving its essential structural properties is a fundamental task in graph analytics. These feature vectors (graph descriptors) are used to measure the pairwise similarity…

Databases · Computer Science 2020-02-20 Zohair Raza Hassan , Mudassir Shabbir , Imdadullah Khan , Waseem Abbas

Finding dense subgraphs is a fundamental problem with applications to community detection, clustering, and data mining. Our work focuses on finding approximate densest subgraphs in directed graphs in computational models for processing…

Data Structures and Algorithms · Computer Science 2025-09-29 Slobodan Mitrović , Theodore Pan , Mahdi Qaempanah , Mohammad Amin Raeisi

We present a new approach for finding matchings in dense graphs by building on Szemer\'edi's celebrated Regularity Lemma. This allows us to obtain non-trivial albeit slight improvements over longstanding bounds for matchings in streaming…

Data Structures and Algorithms · Computer Science 2022-07-20 Sepehr Assadi , Soheil Behnezhad , Sanjeev Khanna , Huan Li

To minimize data movement, state-of-the-art parallel sorting algorithms use techniques based on sampling and histogramming to partition keys prior to redistribution. Sampling enables partitioning to be done using a representative subset of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-30 Vipul Harsh , Laxmikant Kale , Edgar Solomonik