English
Related papers

Related papers: A simple sketching algorithm for entropy estimatio…

200 papers

Entropy estimation, due in part to its connection with mutual information, has seen considerable use in the study of time series data including causality detection and information flow. In many cases, the entropy is estimated using…

Statistics Theory · Mathematics 2019-08-06 Alexander L Young , David B Dunson

We consider the problem of sketching the $p$-th frequency moment of a vector, $p>2$, with multiplicative error at most $1\pm \epsilon$ and \emph{with high confidence} $1-\delta$. Despite the long sequence of work on this problem, tight…

Data Structures and Algorithms · Computer Science 2018-05-29 Sumit Ganguly , David P. Woodruff

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

This paper considers an information bottleneck problem with the objective of obtaining a most informative representation of a hidden feature subject to a R\'enyi entropy complexity constraint. The optimal bottleneck trade-off between…

Information Theory · Computer Science 2021-02-01 Jian-Jia Weng , Fady Alajaji , Tamás Linder

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

Entropy has been a common index to quantify the complexity of time series in a variety of fields. Here, we introduce increment entropy to measure the complexity of time series in which each increment is mapped into a word of two letters,…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Xiaofeng Liu , Aimin Jiang , Ning Xu , Jianru Xue

We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight…

Methodology · Statistics 2025-08-05 Pierluigi Amodio , Luigi Brugnano , Felice Iavernaro

Conventional information-theoretic quantities assume access to probability distributions. Estimating such distributions is not trivial. Here, we consider function-based formulations of cross entropy that sidesteps this a priori estimation…

Information Theory · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

We describe an approach to improving model fitting and model generalization that considers the entropy of distributions of modelling residuals. We use simple simulations to demonstrate the observational signatures of overfitting on ordered…

Methodology · Statistics 2019-08-05 Barnaby Rowe

We introduce a new computational model for data streams: asymptotically exact streaming algorithms. These algorithms have an approximation ratio that tends to one as the length of the stream goes to infinity while the memory used by the…

Data Structures and Algorithms · Computer Science 2014-08-11 Marc Heinrich , Alexander Munteanu , Christian Sohler

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

The R\'enyi-Shannon entropy associated to critical quantum spins chain with central charge $c=1$ is shown to have a phase transition at some value $n_c$ of the R\'enyi parameter $n$ which depends on the Luttinger parameter (or…

Strongly Correlated Electrons · Physics 2011-11-30 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

The matrix-based Renyi's \alpha-entropy functional and its multivariate extension were recently developed in terms of the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel Hilbert space (RKHS).…

Machine Learning · Computer Science 2020-01-27 Shujian Yu , Kristoffer Wickstrøm , Robert Jenssen , Jose C. Principe

We study the estimation of Tsallis entropy of a finite number of independent populations, each following an exponential distribution with the same scale parameter and distinct location parameters for $q>0$. We derive a Stein-type improved…

Statistics Theory · Mathematics 2024-01-18 Naveen Kumar , Ambesh Dixit , Vivek Vijay

We study the computation of the Petz-Augustin mean of order $\alpha \in (0,1) \cup (1,\infty)$, defined as the minimizer of a weighted sum of $n$ Petz-R\'enyi divergences of order $\alpha$ over the set of $d$-by-$d$ quantum states, where…

Quantum Physics · Physics 2025-07-17 Chun-Neng Chu , Wei-Fu Tseng , Yen-Huan Li

One of the most influential results in neural network theory is the universal approximation theorem [1, 2, 3] which states that continuous functions can be approximated to within arbitrary accuracy by single-hidden-layer feedforward neural…

Machine Learning · Computer Science 2021-12-16 Clemens Hutter , Recep Gül , Helmut Bölcskei

We investigate the performance of entropy estimation methods, based either on block entropies or compression approaches, in the case of bidimensional sequences. We introduce a validation dataset made of images produced by a large number of…

Data Analysis, Statistics and Probability · Physics 2022-07-07 F. N. M. de Sousa Filho , V. G. Pereira de Sá , E. Brigatti

Test-time adaptation aims to adapt to realistic environments in an online manner by learning during test time. Entropy minimization has emerged as a principal strategy for test-time adaptation due to its efficiency and adaptability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jisu Han , Jaemin Na , Wonjun Hwang

Entropy-type integral functionals of densities are widely used in mathematical statistics, information theory, and computer science. Examples include measures of closeness between distributions (e.g., density power divergence) and…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Oleg Seleznjev

The entropy of probability distribution defined by Shannon has several extensions. R\'enyi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum…

Mathematical Physics · Physics 2019-09-04 Farrukh Mukhamedov , Kyouhei Ohmura , Noboru Watanabe
‹ Prev 1 8 9 10 Next ›