English
Related papers

Related papers: On the effectiveness of a binless entropy estimato…

200 papers

The size of the effect of the difference in two groups with respect to a variable of interest may be estimated by the classical Cohen's $d$. A recently proposed generalized estimator allows conditioning on further independent variables…

Methodology · Statistics 2023-09-06 Jürgen Groß , Annette Möller

Alternative definitions are given of basic concepts of generalized thermostatistics. In particular, generalizations of Shannon's entropy, of the Boltzmann-Gibbs distribution, and of relative entropy are considered. Particular choices made…

Statistical Mechanics · Physics 2007-05-23 Jan Naudts

Modelling the extremal dependence of bivariate variables is important in a wide variety of practical applications, including environmental planning, catastrophe modelling and hydrology. The majority of these approaches are based on the…

Methodology · Statistics 2024-06-27 C. J. R. Murphy-Barltrop , J. L. Wadsworth , E. F. Eastoe

This paper discusses infill asymptotics for logistic regression estimators for spatio-temporal point processes whose intensity functions are of log-linear form. We establish strong consistency and asymptotic normality for the parameters of…

Statistics Theory · Mathematics 2022-08-26 M. N. M. van Lieshout , C. Lu

This paper introduces an intuitive and easy-to-implement nonparametric density estimator based on local polynomial techniques. The estimator is fully boundary adaptive and automatic, but does not require pre-binning or any other…

Econometrics · Economics 2019-06-11 Matias D. Cattaneo , Michael Jansson , Xinwei Ma

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

Observational entropy -- a quantity that unifies Boltzmann's entropy, Gibbs' entropy, von Neumann's macroscopic entropy, and the diagonal entropy -- has recently been argued to play a key role in a modern formulation of statistical…

Quantum Physics · Physics 2026-03-24 Teruaki Nagasawa , Kohtaro Kato , Eyuri Wakakuwa , Francesco Buscemi

We present a complete framework for determining the asymptotic (or logarithmic) efficiency of estimators of large deviation probabilities and rate functions based on importance sampling. The framework relies on the idea that importance…

Statistical Mechanics · Physics 2021-10-26 Arnaud Guyader , Hugo Touchette

In modern experimental science, there is a common problem of estimating the coefficients of a linear regression in a context where the variables of interest cannot be observed simultaneously. When there is a categorical variable that is…

Methodology · Statistics 2025-03-10 Polina Arsenteva , Mohamed Amine Benadjaoud , Hervé Cardot

This paper introduces a class of k-nearest neighbor ($k$-NN) estimators called bipartite plug-in (BPI) estimators for estimating integrals of non-linear functions of a probability density, such as Shannon entropy and R\'enyi entropy. The…

Statistics Theory · Mathematics 2012-02-28 Kumar Sricharan , Raviv Raich , Alfred O. Hero

This paper introduces an interval state estimation method for discrete-time bounded Jacobian nonlinear systems allying Luenberger-like observer with zonotope set computation. First, a robust observer is designed to obtain bounded-error and…

Dynamical Systems · Mathematics 2025-09-22 Chi Xu , Zhenhua Wang , Nacim Meslem , Tarek Raissi , Yacine Chitour

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

In order to study as a whole a wide part of entropy measures, we introduce a two-parameter non-extensive entropic form with respect to the $h$-derivative, which generalizes the conventional Newton--Leibniz calculus. This new entropy,…

Statistical Mechanics · Physics 2023-06-14 Jin-Wen Kang , Ke-Ming Shen , Ben-Wei Zhang

The Boltzmann-Gibbs celebrated entropy $S_{BG}=-k\sum_ip_i \ln p_i$ is {\it concave} (with regard to all probability distributions $\{p_i\}$) and {\it stable} (under arbitrarily small deformations of any given probability distribution). It…

Statistical Mechanics · Physics 2015-06-24 A. M. C. Souza , C. Tsallis

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

Probability · Mathematics 2024-12-05 Pierre Monmarché , Katharina Schuh

We consider regression models with parametric (linear or nonlinear) regression function and allow responses to be ``missing at random.'' We assume that the errors have mean zero and are independent of the covariates. In order to estimate…

Statistics Theory · Mathematics 2009-08-24 Ursula U. Müller

In this article, we aim to define a Boolean entropy notion parallel to the framework of free entropy proposed by Voiculescu. Motivated by the work of Lenczewski and the work of C\'ebron & Gillers, we mainly investigated two random matrix…

Probability · Mathematics 2025-11-18 Kewei Pan

Ensuring model calibration is critical for reliable prediction, yet popular distribution-free methods such as histogram binning and isotonic regression offer only asymptotic guarantees. We introduce a unified framework for Venn and…

Machine Learning · Statistics 2025-07-17 Lars van der Laan , Ahmed Alaa

We revisit the Kolmogorov-Smirnov and Cram\'er-von Mises goodness-of-fit (GoF) tests and propose a generalisation to identically distributed, but dependent univariate random variables. We show that the dependence leads to a reduction of the…

Statistical Finance · Quantitative Finance 2011-09-06 Remy Chicheportiche , Jean-Philippe Bouchaud

We extend the Hanel and Thurner asymptotic analysis to both extensive and non-extensive entropies on the basis of a wide class of entropic forms. The procedure is known to be capable to classify multiple entropy measures in terms of their…

Statistical Mechanics · Physics 2020-02-21 Nana Cabo Bizet , Jesus Fuentes , Octavio Obregon