English
Related papers

Related papers: Estimating Feature-Label Dependence Using Gini Dis…

200 papers

A graph neural network transforms features in each vertex's neighborhood into a vector representation of the vertex. Afterward, each vertex's representation is used independently for predicting its label. This standard pipeline implicitly…

Machine Learning · Computer Science 2020-06-18 Junteng Jia , Austin R. Benson

Labeling cost is often expensive and is a fundamental limitation of supervised learning. In this paper, we study importance labeling problem, in which we are given many unlabeled data and select a limited number of data to be labeled from…

Machine Learning · Computer Science 2021-04-13 Tomoya Murata , Taiji Suzuki

We propose new statistical tests, in high-dimensional settings, for testing the independence of two random vectors and their conditional independence given a third random vector. The key idea is simple, i.e., we first transform each…

Methodology · Statistics 2026-01-28 Jinyuan Chang , Yue Du , Jing He , Qiwei Yao

The need to test whether two random vectors are independent has spawned a large number of competing measures of dependence. We are interested in nonparametric measures that are invariant under strictly increasing transformations, such as…

Statistics Theory · Mathematics 2017-08-21 Luca Weihs , Mathias Drton , Nicolai Meinshausen

We describe a novel non-parametric statistical hypothesis test of relative dependence between a source variable and two candidate target variables. Such a test enables us to determine whether one source variable is significantly more…

Machine Learning · Statistics 2015-05-28 Wacha Bounliphone , Arthur Gretton , Arthur Tenenhaus , Matthew Blaschko

Via an axiomatic approach, we characterize the family of n-th order Gini deviation, defined as the expected range over n independent draws from a distribution, to quantify joint dispersion across multiple observations. This family extends…

Mathematical Finance · Quantitative Finance 2025-09-16 Xia Han , Ruodu Wang , Qinyu Wu

Estimation of the conditional independence graph (CIG) of high-dimensional multivariate Gaussian time series from multi-attribute data is considered. Existing methods for graph estimation for such data are based on single-attribute models…

Machine Learning · Statistics 2025-12-09 Jitendra K. Tugnait

We consider Gini's mean difference statistic as an alternative to the empirical variance in the settings of finite populations where simple random samples are drawn without replacement. In particular, we discuss specific (in the finite…

Statistics Theory · Mathematics 2014-06-10 Andrius Čiginas , Dalius Pumputis

We propose two model-free, permutation-based tests of independence between a pair of random variables. The tests can be applied to samples from any bivariate distribution: continuous, discrete or mixture of those, with light tails or heavy…

Methodology · Statistics 2022-05-16 Jiří Dvořák , Tomáš Mrkvička

Spatial association measures for univariate static spatial data are widely used. When the data is in the form of a collection of spatial vectors with the same temporal domain of interest, we construct a measure of similarity between the…

Methodology · Statistics 2023-09-26 Divya Kappara , Arup Bose , Madhuchhanda Bhattacharjee

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

Multivariate time series data that capture the temporal evolution of interconnected systems are ubiquitous in diverse areas. Understanding the complex relationships and potential dependencies among co-observed variables is crucial for the…

Methodology · Statistics 2023-11-03 Zhaolu Liu , Robert L. Peach , Felix Laumann , Sara Vallejo Mengod , Mauricio Barahona

Measuring and quantifying dependencies between random variables (RV's) can give critical insights into a data-set. Typical questions are: `Do underlying relationships exist?', `Are some variables redundant?', and `Is some target variable…

Machine Learning · Statistics 2022-03-24 Guus Berkelmans , Joris Pries , Sandjai Bhulai , Rob van der Mei

This paper develops an intuitive concept of perfect dependence between two variables of which at least one has a nominal scale. Perfect dependence is attainable for all marginal distributions. It furthermore proposes a set of dependence…

Methodology · Statistics 2026-02-05 Jan-Lukas Wermuth

We develop semiparametrically efficient inference for kernel measures of noise heterogeneity in additive noise models. In many applications, the regression function is estimated using flexible machine learning methods. Downstream procedures…

Machine Learning · Statistics 2026-05-28 Jakub Wornbard , Zikai Shen , Dimitri Meunier , Arthur Gretton

The Gini index does not give a strictly consistent scoring rule in general. Therefore, maximizing the Gini index may lead to wrong decisions. The main issue is that the Gini index is a rank-based score that is not calibration-sensitive. We…

Machine Learning · Computer Science 2022-08-11 Mario V. Wüthrich

Distance covariance is a quantity to measure the dependence of two random vectors. We show that the original concept introduced and developed by Sz\'{e}kely, Rizzo and Bakirov can be embedded into a more general framework based on symmetric…

Probability · Mathematics 2018-10-24 Björn Böttcher , Martin Keller-Ressel , René L. Schilling

We propose an iterative scheme for feature-based positioning using a new weighted dissimilarity measure with the goal of reducing the impact of large errors among the measured or modeled features. The weights are computed from the…

Machine Learning · Computer Science 2019-05-31 Caifa Zhou , Andreas Wieser

The test of independence is a crucial component of modern data analysis. However, traditional methods often struggle with the complex dependency structures found in high-dimensional data. To overcome this challenge, we introduce a novel…

Methodology · Statistics 2024-09-13 Mingshuo Liu , Doudou Zhou , Hao Chen

For statistical inference on an infinite-dimensional Hilbert space $\H $ with no moment conditions we introduce a new class of energy distances on the space of probability measures on $\H$. The proposed distances consist of the integrated…

Statistics Theory · Mathematics 2024-03-19 Holger Dette , Jiajun Tang