English
Related papers

Related papers: Estimating Entropy of Distributions in Constant Sp…

200 papers

We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…

Statistics Theory · Mathematics 2025-07-24 Angelika Silbernagel , Christian Weiß

Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations - an inference task also known as source distribution estimation. This problem can be ill-posed, however, since…

Machine Learning · Computer Science 2024-12-02 Julius Vetter , Guy Moss , Cornelius Schröder , Richard Gao , Jakob H. Macke

We study the density estimation problem defined as follows: given $k$ distributions $p_1, \ldots, p_k$ over a discrete domain $[n]$, as well as a collection of samples chosen from a ``query'' distribution $q$ over $[n]$, output $p_i$ that…

Data Structures and Algorithms · Computer Science 2024-10-31 Anders Aamand , Alexandr Andoni , Justin Y. Chen , Piotr Indyk , Shyam Narayanan , Sandeep Silwal , Haike Xu

We consider online $k$-means clustering where each new point is assigned to the nearest cluster center, after which the algorithm may update its centers. The loss incurred is the sum of squared distances from new points to their assigned…

Machine Learning · Computer Science 2022-08-02 Robi Bhattacharjee , Jacob Imola , Michal Moshkovitz , Sanjoy Dasgupta

We generalise the results of Bhattacharya et al. (Journal of Computing Systems, 62(1):93-115, 2018) for the list-$k$-means problem defined as -- for a (unknown) partition $X_1, ..., X_k$ of the dataset $X \subseteq \mathbb{R}^d$, find a…

Data Structures and Algorithms · Computer Science 2020-02-20 Dishant Goyal , Ragesh Jaiswal , Amit Kumar

We investigate $k$-means clustering in the online no-substitution setting when the input arrives in \emph{arbitrary} order. In this setting, points arrive one after another, and the algorithm is required to instantly decide whether to take…

Data Structures and Algorithms · Computer Science 2023-01-19 Robi Bhattacharjee , Michal Moshkovitz

In Bayesian inference, we seek to compute information about random variables such as moments or quantiles on the basis of {available data} and prior information. When the distribution of random variables is {intractable}, Monte Carlo (MC)…

Statistics Theory · Mathematics 2021-04-06 Alec Koppel , Amrit Singh Bedi , Brian M. Sadler , Victor Elvira

This paper studies the complexity of estimating Renyi divergences of discrete distributions: $p$ observed from samples and the baseline distribution $q$ known \emph{a priori}. Extending the results of Acharya et al. (SODA'15) on estimating…

Information Theory · Computer Science 2017-02-09 Maciej Skorski

Statistical and machine-learning algorithms are frequently applied to high-dimensional data. In many of these applications data is scarce, and often much more costly than computation time. We provide the first sample-efficient…

Machine Learning · Computer Science 2014-02-20 Jayadev Acharya , Ashkan Jafarpour , Alon Orlitsky , Ananda Theertha Suresh

We characterize the streaming space complexity of every symmetric norm $l$ (a norm on $\mathbb{R}^n$ invariant under sign-flips and coordinate-permutations), by relating this space complexity to the measure-concentration characteristics of…

Data Structures and Algorithms · Computer Science 2017-06-27 Jaroslaw Blasiok , Vladimir Braverman , Stephen R. Chestnut , Robert Krauthgamer , Lin F. Yang

In this paper, we propose a novel framework that converts streaming algorithms for monotone submodular maximization into streaming algorithms for non-monotone submodular maximization. This reduction readily leads to the currently tightest…

Data Structures and Algorithms · Computer Science 2020-02-11 Ran Haba , Ehsan Kazemi , Moran Feldman , Amin Karbasi

Estimation of Shannon and R\'enyi entropies of unknown discrete distributions is a fundamental problem in statistical property testing and an active research topic in both theoretical computer science and information theory. Tight bounds on…

Quantum Physics · Physics 2023-07-19 Tongyang Li , Xiaodi Wu

We present a new streaming algorithm for the $k$-Mismatch problem, one of the most basic problems in pattern matching. Given a pattern and a text, the task is to find all substrings of the text that are at the Hamming distance at most $k$…

Data Structures and Algorithms · Computer Science 2019-04-24 Jakub Radoszewski , Tatiana Starikovskaya

We study the $k$-connectivity augmentation problem ($k$-CAP) in the single-pass streaming model. Given a $(k-1)$-edge connected graph $G=(V,E)$ that is stored in memory, and a stream of weighted edges $L$ with weights in $\{0,1,\dots,W\}$,…

Data Structures and Algorithms · Computer Science 2024-02-19 Ce Jin , Michael Kapralov , Sepideh Mahabadi , Ali Vakilian

Many latent-variable applications, including community detection, collaborative filtering, genomic analysis, and NLP, model data as generated by low-rank matrices. Yet despite considerable research, except for very special cases, the number…

Machine Learning · Computer Science 2020-10-02 Ayush Jain , Alon Orlitsky

We show a dichotomy result for $p$-pass streaming algorithms for all CSPs and for up to polynomially many passes. More precisely, we prove that for any arity parameter $k$, finite alphabet $\Sigma$, collection $\mathcal{F}$ of $k$-ary…

Computational Complexity · Computer Science 2026-04-03 Yumou Fei , Dor Minzer , Shuo Wang

We study the following distribution clustering problem: Given a hidden partition of $k$ distributions into two groups, such that the distributions within each group are the same, and the two distributions associated with the two clusters…

Data Structures and Algorithms · Computer Science 2025-12-10 Gunjan Kumar , Yash Pote , Jonathan Scarlett

Entropy is a fundamental property of both classical and quantum systems, spanning myriad theoretical and practical applications in physics and computer science. We study the problem of obtaining estimates to within a multiplicative factor…

Quantum Physics · Physics 2021-11-23 Tom Gur , Min-Hsiu Hsieh , Sathyawageeswar Subramanian

In the streaming model, the order of the stream can significantly affect the difficulty of a problem. A $t$-semirandom stream was introduced as an interpolation between random-order ($t=1$) and adversarial-order ($t=n$) streams where an…

Data Structures and Algorithms · Computer Science 2017-11-28 Harry Lang

This paper focuses on the problem of finding a distribution for an associated entropic vector in the entropy space nearest to a given, possibly non-entropic, target vector for random variables with a constraint on alphabet size. We show the…

Information Theory · Computer Science 2018-07-24 Sultan Alam , Satyajit Thakor , Syed Abbas
‹ Prev 1 3 4 5 6 7 10 Next ›