English
Related papers

Related papers: Evaluation of mutual information estimators on non…

200 papers

We investigate the sample complexity of mutual information and conditional mutual information testing. For conditional mutual information testing, given access to independent samples of a triple of random variables $(A, B, C)$ with unknown…

Data Structures and Algorithms · Computer Science 2025-06-05 Jan Seyfried , Sayantan Sen , Marco Tomamichel

This paper proposes a class of parametric multiple-index time series models that involve linear combinations of time trends, stationary variables and unit root processes as regressors. The inclusion of the three different types of time…

Econometrics · Economics 2021-11-04 Chaohua Dong , Jiti Gao , Bin Peng , Yundong Tu

A novel first-order moving-average model for analyzing time series observed at irregularly spaced intervals is introduced. Two definitions are presented, which are equivalent under Gaussianity. The first one relies on normally distributed…

Statistics Theory · Mathematics 2021-05-14 Cesar Ojeda , Wilfredo Palma , Susana Eyheramendy , Felipe Elorrieta

The quest for a quantitative characterization of community and modular structure of complex networks produced a variety of methods and algorithms to classify different networks. However, it is not clear if such methods provide consistent,…

Physics and Society · Physics 2016-01-08 Juan Ignacio Perotti , Claudio Juan Tessone , Guido Caldarelli

In modern experimental science, there is a common problem of estimating the coefficients of a linear regression in a context where the variables of interest cannot be observed simultaneously. When there is a categorical variable that is…

Methodology · Statistics 2025-03-10 Polina Arsenteva , Mohamed Amine Benadjaoud , Hervé Cardot

There is a long-standing debate in the statistical, epidemiological and econometric fields as to whether nonparametric estimation that uses data-adaptive methods, like machine learning algorithms in model fitting, confer any meaningful…

Methodology · Statistics 2022-12-21 Kara E. Rudolph , Nicholas Williams , Caleb H. Miles , Joseph Antonelli , Ivan Diaz

Monte Carlo simulations are methods for simulating statistical systems. The aim is to generate a representative ensemble of configurations to access thermodynamical quantities without the need to solve the system analytically or to perform…

Statistical Mechanics · Physics 2015-06-19 Jean-Charles Walter , Gerard Barkema

In this work, the issue of obtaining consistent parameter estimators for nonlinear regression models where the regressors are second-order modulus functions is explored. It is shown that consistent instrumental variable estimators can be…

Methodology · Statistics 2022-04-12 Fredrik Ljungberg , Martin Enqvist

This correspondence studies the basic problem of classifications - how to evaluate different classifiers. Although the conventional performance indexes, such as accuracy, are commonly used in classifier selection or evaluation,…

Machine Learning · Computer Science 2007-11-26 Yong Wang , Bao-Gang Hu

In this paper, we begin our discussion with some of the well-known methods available in the literature for the estimation of the parameters of a univariate/multivariate stable distribution. Based on the available methods, a new hybrid…

Computation · Statistics 2019-02-27 Aastha M. Sathe , Neelesh. S. Upadhye

In this paper we use a well know method in statistics, the $\delta$-method, to provide an asymptotic distribution for the Mutual Information, and construct and independence test based on it. Interesting connections are found with the…

Methodology · Statistics 2025-02-26 Marius Marinescu , Costel Balcau

Due to the potential benefits of parallelization, designing unbiased Monte Carlo estimators, primarily in the setting of randomized multilevel Monte Carlo, has recently become very popular in operations research and computational…

Computation · Statistics 2024-04-03 Guanyang Wang , Jose Blanchet , Peter W. Glynn

The best linear unbiased estimator (BLUE) is a popular statistical method adopted to combine multiple measurements of the same observable taking into account individual uncertainties and their correlation. The method is unbiased by…

Data Analysis, Statistics and Probability · Physics 2015-01-19 Luca Lista

This paper addresses the estimation of locally stationary long-range dependent processes, a methodology that allows the statistical analysis of time series data exhibiting both nonstationarity and strong dependency. A time-varying…

Statistics Theory · Mathematics 2010-11-12 Wilfredo Palma , Ricardo Olea

In statistical modeling of computer experiments sometimes prior information is available about the underlying function. For example, the physical system simulated by the computer code may be known to be monotone with respect to some or all…

Methodology · Statistics 2014-06-17 Shirin Golchi , Derek R. Bingham , Hugh Chipman , David A. Campbell

Mutual Information (MI) and Conditional Mutual Information (CMI) are multi-purpose tools from information theory that are able to naturally measure the statistical dependencies between random variables, thus they are usually of central…

Machine Learning · Computer Science 2022-11-22 Bao Duong , Thin Nguyen

We develop a quantum Monte Carlo procedure to compute the Renyi mutual information of an interacting quantum many-body system at non-zero temperature. Performing simulations on a spin-1/2 XXZ model, we observe that for a subregion of fixed…

Strongly Correlated Electrons · Physics 2010-09-21 Roger G. Melko , Ann B. Kallin , Matthew B. Hastings

Mutual coherence is a measure of similarity between two opinions. Although the notion comes from philosophy, it is essential for a wide range of technologies, e.g., the Wahl-O-Mat system. In Germany, this system helps voters to find…

Artificial Intelligence · Computer Science 2023-07-06 Gregor Betz , Vera Chekan , Tamara Mchedlidze

Sliced mutual information (SMI) is defined as an average of mutual information (MI) terms between one-dimensional random projections of the random variables. It serves as a surrogate measure of dependence to classic MI that preserves many…

Information Theory · Computer Science 2022-10-18 Ziv Goldfeld , Kristjan Greenewald , Theshani Nuradha , Galen Reeves

We explain in detail how to estimate mean values and assess statistical errors for arbitrary functions of elementary observables in Monte Carlo simulations. The method is to estimate and sum the relevant autocorrelation functions, which is…

High Energy Physics - Lattice · Physics 2009-09-29 Ulli Wolff