English
Related papers

Related papers: Estimating Entropy of Distributions in Constant Sp…

200 papers

This article studies the fundamental problem of using i.i.d. coin tosses from an entropy source to efficiently generate random variables $X_i \sim P_i$ $(i \ge 1)$, where $(P_1, P_2, \dots)$ is a random sequence of rational discrete…

Data Structures and Algorithms · Computer Science 2026-05-08 Thomas L. Draper , Feras A. Saad

In this paper, we study the problem of learning a mixture of Gaussians with streaming data: given a stream of $N$ points in $d$ dimensions generated by an unknown mixture of $k$ spherical Gaussians, the goal is to estimate the model…

Machine Learning · Computer Science 2017-07-11 Aditi Raghunathan , Ravishankar Krishnaswamy , Prateek Jain

Quantifying the complexity and irregularity of time series data is a primary pursuit across various data-scientific disciplines. Sample entropy (SampEn) is a widely adopted metric for this purpose, but its reliability is sensitive to the…

Applications · Statistics 2024-05-13 Zachary Blanks , Donald E. Brown

Entropy measures quantify the amount of information and correlation present in a quantum system. In practice, when the quantum state is unknown and only copies thereof are available, one must resort to the estimation of such entropy…

Quantum Physics · Physics 2024-03-27 Ziv Goldfeld , Dhrumil Patel , Sreejith Sreekumar , Mark M. Wilde

We give a nearly linear-time algorithm to approximately sample satisfying assignments in the random $k$-SAT model when the density of the formula scales exponentially with $k$. The best previously known sampling algorithm for the random…

Data Structures and Algorithms · Computer Science 2024-08-06 Zongchen Chen , Andreas Galanis , Leslie Ann Goldberg , Heng Guo , Andrés Herrera-Poyatos , Nitya Mani , Ankur Moitra

We present a near-optimal quantum algorithm, up to logarithmic factors, for estimating the Shannon entropy in the quantum probability oracle model. Our approach combines the singular value separation algorithm with quantum amplitude…

Quantum Physics · Physics 2026-02-03 Myeongjin Shin , Kabgyun Jeong

One of the main contributions of this paper is to illustrate how large deviation theory can be used to determine the equilibrium distribution of a basic droplet model that underlies a number of important models in material science and…

Probability · Mathematics 2015-09-11 Richard S. Ellis , Shlomo Ta'asan

Diffusion is a fundamental graph process, underpinning such phenomena as epidemic disease contagion and the spread of innovation by word-of-mouth. We address the algorithmic problem of finding a set of k initial seed nodes in a network so…

Data Structures and Algorithms · Computer Science 2016-06-23 Christian Borgs , Michael Brautbar , Jennifer Chayes , Brendan Lucier

We study the streaming complexity of $k$-counter approximate counting. In the $k$-counter approximate counting problem, we are given an input string in $[k]^n$, and we are required to approximate the number of each $j$'s ($j\in[k]$) in the…

Data Structures and Algorithms · Computer Science 2024-06-19 Yichuan Wang

The dispersion problem has received much attention recently in the distributed computing literature. In this problem, $k\leq n$ agents placed initially arbitrarily on the nodes of an $n$-node, $m$-edge anonymous graph of maximum degree…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-21 Ajay D. Kshemkalyani , Manish Kumar , Anisur Rahaman Molla , Gokarna Sharma

Clustering is an important technique for identifying structural information in large-scale data analysis, where the underlying dataset may be too large to store. In many applications, recent data can provide more accurate information and…

Data Structures and Algorithms · Computer Science 2023-11-02 David P. Woodruff , Peilin Zhong , Samson Zhou

In this paper we give an algorithm for streaming $k$-edit approximate pattern matching which uses space $\widetilde{O}(k^2)$ and time $\widetilde{O}(k^2)$ per arriving symbol. This improves substantially on the recent algorithm of…

Data Structures and Algorithms · Computer Science 2023-05-02 Sudatta Bhattacharya , Michal Koucký

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

The \emph{$\ell_2$ tracking problem} is the task of obtaining a streaming algorithm that, given access to a stream of items $a_1,a_2,a_3,\ldots$ from a universe $[n]$, outputs at each time $t$ an estimate to the $\ell_2$ norm of the…

Data Structures and Algorithms · Computer Science 2019-09-02 Chi-Ning Chou , Zhixian Lei , Preetum Nakkiran

Near-term quantum devices with limited qubits motivate the study of space-bounded quantum computation in the data stream model. We show that Shannon entropy estimation exhibits an exponential separation between quantum and classical space…

Quantum Physics · Physics 2026-04-21 Weijun Feng , Yongzhen Xu , Lvzhou Li , Gongde Guo , Song Lin

Estimating the entropy rate of discrete time series is a challenging problem with important applications in numerous areas including neuroscience, genomics, image processing and natural language processing. A number of approaches have been…

Methodology · Statistics 2023-03-22 Ioannis Papageorgiou , Ioannis Kontoyiannis

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

We study operator complexity on various time scales with emphasis on those much larger than the scrambling period. We use, for systems with a large but finite number of degrees of freedom, the notion of K-complexity employed in…

High Energy Physics - Theory · Physics 2020-01-08 J. L. F. Barbon , E. Rabinovici , R. Shir , R. Sinha

A technique introduced by Indyk and Woodruff [STOC 2005] has inspired several recent advances in data-stream algorithms. We show that a number of these results follow easily from the application of a single probabilistic method called…

Data Structures and Algorithms · Computer Science 2011-04-26 Alexandr Andoni , Robert Krauthgamer , Krzysztof Onak

This paper considers online optimization for a system that performs a sequence of back-to-back tasks. Each task can be processed in one of multiple processing modes that affect the duration of the task, the reward earned, and an additional…

Optimization and Control · Mathematics 2024-01-17 Michael J. Neely