English
Related papers

Related papers: Entropy Estimation via Uniformization

200 papers

Statistical analysis of voluntary survey data is an important area of research in survey sampling. We consider a unified approach to voluntary survey data analysis under the assumption that the sampling mechanism is ignorable. Generalized…

Methodology · Statistics 2025-06-03 Yonghyun Kwon , Jae Kwang Kim , Yumou Qiu

Entropy and free-energy estimation are key in thermodynamic characterization of simulated systems ranging from spin models through polymers, colloids, protein structure, and drug-design. Current techniques suffer from being model specific,…

Statistical Mechanics · Physics 2019-10-30 Ram Avinery , Micha Kornreich , Roy Beck

The inefficiency of using an unbiased estimator in a Monte Carlo procedure can be quantified using an inefficiency constant, equal to the product of the variance of the estimator and its mean computational cost. We develop methods for…

Computation · Statistics 2016-01-08 Tomasz Badowski

Considering the increasing size of available data, the need for statistical methods that control the finite sample bias is growing. This is mainly due to the frequent settings where the number of variables is large and allowed to increase…

Statistics Theory · Mathematics 2018-10-12 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

Configurational entropy is an important factor in the free energy change of many macromolecular recognition and binding processes, and has been intensively studied. Despite great progresses that have been made, the global sampling remains…

Biological Physics · Physics 2012-12-04 Wenzhao Li , Kai Wang , Suyan Tian , Pu Tian

High-entropy alloys, which exist in the high-dimensional composition space, provide enormous unique opportunities for realizing unprecedented structural and functional properties. A fundamental challenge, however, lies in how to predict the…

Materials Science · Physics 2021-05-20 Jie Qi , Andrew M. Cheung , S. Joseph Poon

This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new…

Machine Learning · Computer Science 2018-05-23 Judy Hoffman , Mehryar Mohri , Ningshan Zhang

Numerous entropy-type characteristics (functionals) generalizing R\'enyi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and…

Statistics Theory · Mathematics 2011-03-28 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

Quantifying the complexity of large graphs requires measures that extend beyond predefined structural features and scale efficiently with graph size. This work adopts a generative perspective, modeling large networks as exchangeable graphs…

Information Theory · Computer Science 2025-03-14 Anda Skeja , Sofia C. Olhede

Given a sample of independent and identically distributed random variables, a novel nonparametric maximum entropy method is presented to estimate the underlying continuous univariate probability density function (pdf). Estimates are found…

Probability · Mathematics 2016-06-30 Jenny Farmer , Donald J. Jacobs

We propose a nonparametric estimator of multivariate joint entropy based on partitioned sample spacing (PSS). The method extends univariate spacing ideas to $\mathbb{R}^{d}$ by partitioning into localized cells and aggregating within-cell…

Statistics Theory · Mathematics 2025-12-02 Jungwoo Ho , Sangun Park , Soyeong Oh

We present an analytical-numerical method providing robust upper estimates for the topological entropy or, more generally, uniform volume growth exponents of differentiable mappings. By introducing varying metrics, we simplify the analysis…

Dynamical Systems · Mathematics 2025-03-17 Mikhail Anikushin , Andrey Romanov

Calculating the Shannon entropy for symbolic sequences has been widely considered in many fields. For descriptive statistical problems such as estimating the N-gram entropy of English language text, a common approach is to use as much data…

Information Theory · Computer Science 2018-05-24 Andrew D. Back , Daniel Angus , Janet Wiles

Conformal Prediction (CP) is a powerful framework for constructing prediction sets with guaranteed coverage. However, recent studies have shown that integrating confidence calibration with CP can lead to a degradation in efficiency. In this…

Machine Learning · Computer Science 2024-07-25 Rui Luo , Nicolo Colombo

Sample selection improves the efficiency and effectiveness of machine learning models by providing informative and representative samples. Typically, samples can be modeled as a sample graph, where nodes are samples and edges represent…

Machine Learning · Computer Science 2025-03-04 Tianchi Xie , Jiangning Zhu , Guozu Ma , Minzhi Lin , Wei Chen , Weikai Yang , Shixia Liu

We formulate the entropy of a quantized artificial neural network as a differentiable function that can be plugged as a regularization term into the cost function minimized by gradient descent. Our formulation scales efficiently beyond the…

Machine Learning · Computer Science 2021-07-13 Enzo Tartaglione , Stéphane Lathuilière , Attilio Fiandrotti , Marco Cagnazzo , Marco Grangetto

Reinforcement learning can learn amortised design policies for designing sequences of experiments. However, current amortised methods rely on estimators of expected information gain (EIG) that require an exponential number of samples on the…

Machine Learning · Computer Science 2024-02-06 Tom Blau , Iadine Chades , Amir Dezfouli , Daniel Steinberg , Edwin V. Bonilla

We propose a method to derive the stationary size distributions of a system, and the degree distributions of networks, using maximisation of the Gibbs-Shannon entropy. We apply this to a preferential attachment-type algorithm for systems of…

Physics and Society · Physics 2020-03-17 Cornelia Metzig , Caroline Colijn

In quantum information theory, von Neumann entropy plays an important role. The entropies can be obtained analytically only for a few states. In continuous variable system, even evaluating entropy numerically is not an easy task since the…

Quantum Physics · Physics 2015-05-13 Xiao-yu Chen

It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…

Statistical Mechanics · Physics 2009-10-26 V. V. Ryazanov