English
Related papers

Related papers: Testing independence in the presence of missing da…

200 papers

Test of independence plays a fundamental role in many statistical techniques. Among the nonparametric approaches, the distance-based methods (such as the distance correlation based hypotheses testing for independence) have numerous…

Methodology · Statistics 2017-01-24 Cheng Huang , Xiaoming Huo

Variable screening has been a useful research area that deals with ultrahigh-dimensional data. When there exist both marginally and jointly dependent predictors to the response, existing methods such as conditional screening or iterative…

Methodology · Statistics 2023-07-10 Lei Fang , Qingcong Yuan , Xiangrong Yin , Chenglong Ye

We propose a two-sample test for high-dimensional means that requires neither distributional nor correlational assumptions, besides some weak conditions on the moments and tail properties of the elements in the random vectors. This…

Methodology · Statistics 2019-04-17 Kaijie Xue , Fang Yao

The aim of this thesis is to find a solution to the non-parametric independence problem in separable metric spaces. Suppose we are given finite collection of samples from an i.i.d. sequence of paired random elements, where each marginal has…

Statistics Theory · Mathematics 2017-06-13 Martin Emil Jakobsen

Distance correlation is a measure of dependence between two paired random vectors or matrices of arbitrary, not necessarily equal, dimensions. Unlike Pearson correlation, the population distance correlation coefficient is zero if and only…

Methodology · Statistics 2025-06-19 Kontemeniotis Nikolaos , Vargiakakis Rafail , Tsagris Michail

We propose a sequential, anytime-valid method to test the conditional independence of a response $Y$ and a predictor $X$ given a random vector $Z$. The proposed test is based on e-statistics and test martingales, which generalize likelihood…

Methodology · Statistics 2023-02-22 Peter Grünwald , Alexander Henzi , Tyron Lardy

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional…

Machine Learning · Statistics 2020-10-13 Daniel Chicharro , Michel Besserve , Stefano Panzeri

We propose a nonparametric test for serial independence that aggregates pairwise similarities of observations with lag-dependent weights. The resulting statistic is powerful to general forms of temporal dependence, including nonlinear and…

Methodology · Statistics 2025-09-09 Qihua Zhu , Mingshuo Liu , Yuefeng Han , Doudou Zhou

Hypothesis tests are a crucial statistical tool for data mining and are the workhorse of scientific research in many fields. Here we study differentially private tests of independence between a categorical and a continuous variable. We take…

Methodology · Statistics 2019-03-25 Simon Couch , Zeki Kazan , Kaiyan Shi , Andrew Bray , Adam Groce

We introduce a sufficient graphical model by applying the recently developed nonlinear sufficient dimension reduction techniques to the evaluation of conditional independence. The graphical model is nonparametric in nature, as it does not…

Machine Learning · Statistics 2023-07-11 Bing Li , Kyongwon Kim

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

We present an index of dependence that allows one to measure the joint or mutual dependence of a $d$-dimensional random vector with $d>2$. The index is based on a $d$-dimensional Kendall process. We further propose a standardized version of…

Statistics Theory · Mathematics 2020-12-24 Georgios Afendras , Marianthi Markatou , Albert Vexler

We propose new concepts in order to analyze and model the dependence structure between two time series. Our methods rely exclusively on the order structure of the data points. Hence, the methods are stable under monotone transformations of…

Statistics Theory · Mathematics 2015-02-02 Alexander Schnurr , Herold Dehling

This paper develops a novel nonparametric significance test based on a tailored nonparametric-type projected weighting function that exhibits appealing theoretical and numerical properties. We derive the asymptotic properties of the…

Econometrics · Economics 2026-02-18 Xiaojun Song , Jichao Yuan

Distinguishing causal connections from correlations is important in many scenarios. However, the presence of unobserved variables, such as the latent confounder, can introduce bias in conditional independence testing commonly employed in…

Methodology · Statistics 2024-05-03 Mingzhou Liu , Xinwei Sun , Yu Qiao , Yizhou Wang

Missing data can lead to inefficiencies and biases in analyses, in particular when data are missing not at random (MNAR). It is thus vital to understand and correctly identify the missing data mechanism. Recovering missing values through a…

Methodology · Statistics 2022-12-08 Jack Noonan , Adetola Adedamola Adediran , Robin Mitra , Stefanie Biedermann

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

Machine Learning · Statistics 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji

We propose a new multivariate dependency measure. It is obtained by considering a Gaussian kernel based distance between the copula transform of the given d-dimensional distribution and the uniform copula and then appropriately normalizing…

Statistics Theory · Mathematics 2019-11-12 Angshuman Roy , Alok Goswami , C. A. Murthy

A major challenge in estimating treatment effects in observational studies is the reliance on untestable conditions such as the assumption of no unmeasured confounding. In this work, we propose an algorithm that can falsify the assumption…

Methodology · Statistics 2025-06-03 Rickard K. A. Karlsson , Jesse H. Krijthe

This paper describes a novel approach to change-point detection when the observed high-dimensional data may have missing elements. The performance of classical methods for change-point detection typically scales poorly with the…

Machine Learning · Statistics 2015-06-11 Yao Xie , Jiaji Huang , Rebecca Willett