English
Related papers

Related papers: A Kernel Test for Three-Variable Interactions

200 papers

Spectral methods have greatly advanced the estimation of latent variable models, generating a sequence of novel and efficient algorithms with strong theoretical guarantees. However, current spectral algorithms are largely restricted to…

Machine Learning · Computer Science 2013-12-10 Le Song , Animashree Anandkumar , Bo Dai , Bo Xie

We propose an independence test for random variables valued into metric spaces by using a test statistic obtained from appropriately centering and rescaling the squared Hilbert-Schmidt norm of the usual empirical estimator of normalized…

Statistics Theory · Mathematics 2022-11-11 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet

We propose a new conditional dependence measure and a statistical test for conditional independence. The measure is based on the difference between analytic kernel embeddings of two well-suited distributions evaluated at a finite set of…

Machine Learning · Statistics 2022-06-17 Meyer Scetbon , Laurent Meunier , Yaniv Romano

It is well known that nonparametric regression estimation and inference procedures are subject to the curse of dimensionality. Moreover, model interpretability usually decreases with the data dimension. Therefore, model-free variable…

Methodology · Statistics 2025-05-22 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

Tree structured graphical models are powerful at expressing long range or hierarchical dependency among many variables, and have been widely applied in different areas of computer science and statistics. However, existing methods for…

Machine Learning · Statistics 2014-01-17 Le Song , Han Liu , Ankur Parikh , Eric Xing

We introduce kernel integrated $R^2$, a new measure of statistical dependence that combines the local normalization principle of the recently introduced integrated $R^2$ with the flexibility of reproducing kernel Hilbert spaces (RKHSs). The…

Machine Learning · Statistics 2026-02-27 Pouya Roudaki , Shakeel Gavioli-Akilagun , Florian Kalinke , Mona Azadkia , Zoltán Szabó

In this paper we are concerned with the learnability of nonlocal interaction kernels for first order systems modeling certain social interactions, from observations of realizations of their dynamics. This paper is the first of a series on…

Dynamical Systems · Mathematics 2016-02-17 Mattia Bongini , Massimo Fornasier , Markus Hansen , Mauro Maggioni

In this paper we aim at increasing the descriptive power of the covariance matrix, limited in capturing linear mutual dependencies between variables only. We present a rigorous and principled mathematical pipeline to recover the kernel…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Jacopo Cavazza , Andrea Zunino , Marco San Biagio , Vittorio Murino

In this paper, we present the general theory of embedding independence tests on Hilbert spaces that generalizes the concepts of distance covariance, distance multivariance and HSIC. This is done by defining new types of kernel on an $n$…

Functional Analysis · Mathematics 2024-11-14 Jean Carlo Guella

Kernel dependence measures yield accurate estimates of nonlinear relations between random variables, and they are also endorsed with solid theoretical properties and convergence rates. Besides, the empirical estimates are easy to compute in…

Machine Learning · Statistics 2016-11-03 Adrián Pérez-Suay , Gustau Camps-Valls

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

In Bayesian multilevel models, the data are structured in interconnected groups, and their posteriors borrow information from one another due to prior dependence between latent parameters. However, little is known about the behaviour of the…

Statistics Theory · Mathematics 2025-09-25 Marta Catalano , Hugo Lavenant , Francesco Mascari

We propose a kernel-based nonparametric test of relative goodness of fit, where the goal is to compare two models, both of which may have unobserved latent variables, such that the marginal distribution of the observed variables is…

Machine Learning · Statistics 2023-05-10 Heishiro Kanagawa , Wittawat Jitkrittum , Lester Mackey , Kenji Fukumizu , Arthur Gretton

In modern data analysis, nonparametric measures of discrepancies between random variables are particularly important. The subject is well-studied in the frequentist literature, while the development in the Bayesian setting is limited where…

Methodology · Statistics 2022-01-25 Qinyi Zhang , Veit Wild , Sarah Filippi , Seth Flaxman , Dino Sejdinovic

We consider the problem of conditional independence (CI) testing and adopt a kernel-based approach. Kernel-based CI tests embed variables in reproducing kernel Hilbert spaces, regress their embeddings on the conditioning variables, and test…

Machine Learning · Statistics 2026-04-07 Luca Bergen , Dino Sejdinovic , Vanessa Didelez

This paper proposes a new mutual independence test for a large number of high dimensional random vectors. The test statistic is based on the characteristic function of the empirical spectral distribution of the sample covariance matrix. The…

Statistics Theory · Mathematics 2012-05-31 G. M. Pan , J. Gao , Y. Yang , M. Guo

Kernel embeddings have emerged as a powerful tool for representing probability measures in a variety of statistical inference problems. By mapping probability measures into a reproducing kernel Hilbert space (RKHS), kernel embeddings enable…

Machine Learning · Statistics 2024-10-31 Dino Sejdinovic

Pairwise interactions between perturbations to a system can provide evidence for the causal dependencies of the underlying underlying mechanisms of a system. When observations are low dimensional, hand crafted measurements, detecting…

Machine Learning · Computer Science 2024-09-13 Zuheng , Xu , Moksh Jain , Ali Denton , Shawn Whitfield , Aniket Didolkar , Berton Earnshaw , Jason Hartford

We propose to investigate test statistics for testing homogeneity in reproducing kernel Hilbert spaces. Asymptotic null distributions under null hypothesis are derived, and consistency against fixed and local alternatives is assessed.…

Machine Learning · Statistics 2008-12-18 Zaid Harchaoui , Francis Bach , Eric Moulines

Our aim is to detect mechanistic interaction between the effects of two causal factors on a binary response, as an aid to identifying situations where the effects are mediated by a common mechanism. We propose a formalization of mechanistic…

Methodology · Statistics 2015-06-23 Carlo Berzuini , A. Philip Dawid