English
Related papers

Related papers: Threshold-free estimation of entropy from a Pearso…

200 papers

We establish non-asymptotic efficiency guarantees for tensor decomposition-based inference in count data models. Under a Poisson framework, we consider two related goals: (i) parametric inference, the estimation of the full distributional…

Statistics Theory · Mathematics 2025-11-10 Oscar López , Arvind Prasadan , Carlos Llosa-Vite , Richard B. Lehoucq , Daniel M. Dunlavy

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

Entanglement entropy is an essential metric for characterizing quantum many-body systems, but its numerical evaluation for neural network representations of quantum states has so far been inefficient and demonstrated only for the restricted…

Quantum Physics · Physics 2020-12-21 Zhaoyou Wang , Emily J. Davis

Assuming that a threshold Ornstein-Uhlenbeck process is observed at discrete time instants, we propose generalized moment estimators to estimate the parameters. Our theoretical basis is the celebrated ergodic theorem. To use this theorem we…

Statistics Theory · Mathematics 2020-11-24 Yaozhong Hu , Yuejuan Xi

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

In a recent Letter [1] a framework for estimating entropy was introduced and applied to one-dimensional and two-dimensional systems. In this Comment we show that the method is not well suited for estimating entropy in bidimensional systems…

Statistical Mechanics · Physics 2022-07-15 E. Brigatti , F. N. M. de Sousa Filho

Traditional numerical methods for calculating matrix eigenvalues are prohibitively expensive for high-dimensional problems. Iterative random sparsification methods allow for the estimation of a single dominant eigenvalue at reduced cost by…

Numerical Analysis · Mathematics 2023-10-03 Samuel M. Greene , Robert J. Webber , Timothy C. Berkelbach , Jonathan Weare

We describe a method to determine the eigenvalue density of empirical covariance matrix in the presence of correlations between samples. This is a straightforward generalization of the method developed earlier by the authors for…

Statistical Mechanics · Physics 2008-12-02 Z. Burda , J. Jurkiewicz , B. Waclaw

We describe a method to computationally estimate the probability density function of a univariate random variable by applying the maximum entropy principle with some local conditions given by Gaussian functions. The estimation errors and…

Statistics Theory · Mathematics 2012-06-21 Mihail-Ioan Pop

I propose a new algorithm, a free energy Monte Carlo algorithm, for calculations where conventional Monte Carlo simulations struggle with ergodicity problems. The simplest version of the proposed algorithm allows for the determination of…

Condensed Matter · Physics 2007-05-23 M. J. Thill

We develop randomized matrix-free algorithms for estimating partial traces, a generalization of the trace arising in quantum physics and chemistry. Our algorithm improves on the typicality-based approach used in [T. Chen and Y-C. Cheng,…

Numerical Analysis · Mathematics 2024-12-02 Tyler Chen , Robert Chen , Kevin Li , Skai Nzeuton , Yilu Pan , Yixin Wang

A novel, non-trivial, probabilistic upper bound on the entropy of an unknown one-dimensional distribution, given the support of the distribution and a sample from that distribution, is presented. No knowledge beyond the support of the…

Information Theory · Computer Science 2007-07-13 Joseph DeStefano , Erik Learned-Miller

In nonlinear dynamics, and to a lesser extent in other fields, a widely used measure of complexity is the Permutation Entropy. But there is still no known method to determine the accuracy of this measure. There has been little research on…

Methodology · Statistics 2017-11-22 Francisco Traversaro , Francisco Redelico

We investigate the concept of orbital free entropy from the viewpoint of matrix liberation process. We will show that many basic questions around the definition of orbital free entropy are reduced to the question of full large deviation…

Operator Algebras · Mathematics 2021-07-01 Yoshimichi Ueda

The concentration of measure phenomenon may be summarized as follows: a function of many weakly dependent random variables that is not too sensitive to any of its individual arguments will tend to take values very close to its expectation.…

Probability · Mathematics 2016-11-18 Aryeh Kontorovich , Maxim Raginsky

We show that the same maximum entropy principle applied to recurrence microstates configures a new way to properly compute the time delay necessary to correctly sample a data set. The new method retrieves results obtained using traditional…

Data Analysis, Statistics and Probability · Physics 2020-10-08 Thiago Lima Prado , Vandertone Santos Machado , Gilberto Corso , Gustavo Zampier dos Santos Lima , Sergio Roberto Lopes

The principle of maximum entropy provides a useful method for inferring statistical mechanics models from observations in correlated systems, and is widely used in a variety of fields where accurate data are available. While the assumptions…

Neurons and Cognition · Quantitative Biology 2017-06-02 Ulisse Ferrari , Tomoyuki Obuchi , Thierry Mora

The estimation of information measures of continuous distributions based on samples is a fundamental problem in statistics and machine learning. In this paper, we analyze estimates of differential entropy in $K$-dimensional Euclidean space,…

Information Theory · Computer Science 2021-11-29 Georg Pichler , Pablo Piantanida , Günther Koliander

Quantum coherence is the most distinguished signature of quantum mechanics, also recognized to be an essential resource for many promising quantum technologies, playing a central role in phenomena related to quantum information science,…

Quantum Physics · Physics 2019-02-27 Bertúlio de Lima Bernardo

The purpose of this study was to investigate how the entropy of a neuron cell can be measured using membrane ion current signals, which were recorded from neurons in the mouse medial prefrontal cortex (mPFC). The sample entropy and the…

Neurons and Cognition · Quantitative Biology 2025-08-05 Mahmut Akilli