English
Related papers

Related papers: A Very Efficient Scheme for Estimating Entropy of …

200 papers

The Basic Counting problem [1] is one of the most fundamental and critical streaming problems of sliding window queries over data streams. Given a stream of 0's and 1's, the purpose of this problem is to estimate the number of 1's in the…

Data Structures and Algorithms · Computer Science 2019-12-10 Shuhao Sun , Dagang Li

Entropically secure encryption is a way to encrypt a large plaintext with a small key and still have information-theoretic security, thus in a certain sense circumventing Shannon's result that perfect encryption requires the key to be at…

Quantum Physics · Physics 2025-07-01 Mehmet Huseyin Temel , Boris Skoric

A data sketch algorithm scans a big data set, collecting a small amount of data -- the sketch, which can be used to statistically infer properties of the big data set. Some data sketch algorithms take a fixed-size random sample of a big…

Machine Learning · Computer Science 2022-08-16 Eric Bax , John Donald

The entropy models have been recently adopted in many studies to evaluate the distribution of the shear stress in circular channels. However, the uncertainty in their predictions and their reliability remains an open question. We present a…

Quantifying the complexity and irregularity of time series data is a primary pursuit across various data-scientific disciplines. Sample entropy (SampEn) is a widely adopted metric for this purpose, but its reliability is sensitive to the…

Applications · Statistics 2024-05-13 Zachary Blanks , Donald E. Brown

In a world where more decisions are made using artificial intelligence, it is of utmost importance to ensure these decisions are well-grounded. Neural networks are the modern building blocks for artificial intelligence. Modern neural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohamad Al Shaar , Nils Ekström , Gustav Gille , Reza Rezvan , Ivan Wely

We propose a new method to combine adaptive processes with a class of entropy estimators for the case of streams of data. Starting from a first estimation obtained from a batch of initial data, model parameters are estimated at each step by…

Signal Processing · Electrical Eng. & Systems 2020-01-15 Mario Angelelli , Enrico Ciavolino , Paola Pasca

In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…

Machine Learning · Computer Science 2008-11-04 Stefan Jaeger

As an application of generalised statistical mechanics, it is studied a possible route toward a consistent generalised information theory in terms of a family of non-extensive, non-parametric entropies $H^\pm_D(P)$. Unlike other proposals…

Information Theory · Computer Science 2021-03-23 Jesús Fuentes , Octavio Obregón

Computing space-efficient summary, or \textit{a.k.a. sketches}, of large data, is a central problem in the streaming algorithm. Such sketches are used to answer \textit{post-hoc} queries in several data analytics tasks. The algorithm for…

Machine Learning · Computer Science 2022-03-07 Rameshwar Pratap , Bhisham Dev Verma , Raghav Kulkarni

Estimating frequency moments of data streams is a very well studied problem and tight bounds are known on the amount of space that is necessary and sufficient when the stream is adversarially ordered. Recently, motivated by various…

Data Structures and Algorithms · Computer Science 2008-08-19 Alexandr Andoni , Andrew McGregor , Krzysztof Onak , Rina Panigrahy

This paper considers the estimation of Shannon entropy for discrete distributions with countably infinite support. While minimax rates for finite-support distributions are established, infinite-support distributions present distinct…

Statistics Theory · Mathematics 2025-12-03 Octavio César Mesner

It was recently shown that estimating the Shannon entropy $H({\rm p})$ of a discrete $k$-symbol distribution ${\rm p}$ requires $\Theta(k/\log k)$ samples, a number that grows near-linearly in the support size. In many applications $H({\rm…

Information Theory · Computer Science 2016-03-11 Jayadev Acharya , Alon Orlitsky , Ananda Theertha Suresh , Himanshu Tyagi

We introduce a method for extracting meaningful entanglement measures of tensor network states in general dimensions. Current methods require the explicit reconstruction of the density matrix, which is highly demanding, or the contraction…

Strongly Correlated Electrons · Physics 2022-07-28 Noa Feldman , Augustine Kshetrimayum , Jens Eisert , Moshe Goldstein

We study an entropy measure for quantum systems that generalizes the von Neumann entropy as well as its classical counterpart, the Gibbs or Shannon entropy. The entropy measure is based on hypothesis testing and has an elegant formulation…

Quantum Physics · Physics 2014-02-19 F. Dupuis , L. Kraemer , P. Faist , J. M. Renes , R. Renner

In the analysis of any type of system, granting maximum information extraction from its data is non-trivial. Confidence in successful information extraction typically builds on prior knowledge of the studied system or on the user's…

Data Analysis, Statistics and Probability · Physics 2026-01-01 Matteo Becchi , Giovanni Maria Pavan

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

This work deals with the scattering entropy of quantum graphs in many different circumstances. We first consider the case of the Shannon entropy and then the R\'enyi and Tsallis entropies, which are more adequate to study distinct…

Quantum Physics · Physics 2024-07-30 Alison A. Silva , Fabiano M. Andrade , D. Bazeia

We consider a network model where the nodes are grouped into a number of clusters and propose a distributed dynamic frequency allocation algorithm that achieves performance close to that of a centralized optimal algorithm. Each cluster…

Networking and Internet Architecture · Computer Science 2008-03-14 Behtash Babadi , Vahid Tarokh

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk