English
Related papers

Related papers: Kernel-based Partial Permutation Test for Detectin…

200 papers

It is well known that nonparametric regression estimation and inference procedures are subject to the curse of dimensionality. Moreover, model interpretability usually decreases with the data dimension. Therefore, model-free variable…

Methodology · Statistics 2025-05-22 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

We propose to investigate test statistics for testing homogeneity in reproducing kernel Hilbert spaces. Asymptotic null distributions under null hypothesis are derived, and consistency against fixed and local alternatives is assessed.…

Machine Learning · Statistics 2008-12-18 Zaid Harchaoui , Francis Bach , Eric Moulines

Kernel-based testing has revolutionized the field of non-parametric tests through the embedding of distributions in an RKHS. This strategy has proven to be powerful and flexible, yet its applicability has been limited to the standard…

Methodology · Statistics 2024-11-28 Anthony Ozier-Lafontaine , Polina Arsenteva , Franck Picard , Bertrand Michel

In modern data analysis, nonparametric measures of discrepancies between random variables are particularly important. The subject is well-studied in the frequentist literature, while the development in the Bayesian setting is limited where…

Methodology · Statistics 2022-01-25 Qinyi Zhang , Veit Wild , Sarah Filippi , Seth Flaxman , Dino Sejdinovic

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

This paper considers the partially functional linear model (PFLM) where all predictive features consist of a functional covariate and a high dimensional scalar vector. Over an infinite dimensional reproducing kernel Hilbert space, the…

Statistics Theory · Mathematics 2021-10-19 Shaogao Lv , Xin He , Junhui Wang

Testing whether a probability distribution is compatible with a given Bayesian network is a fundamental task in the field of causal inference, where Bayesian networks model causal relations. Here we consider the class of causal structures…

Machine Learning · Statistics 2020-09-04 Aditya Kela , Kai von Prillwitz , Johan Aberg , Rafael Chaves , David Gross

In this paper we introduce a kernel-based measure for detecting differences between two conditional distributions. Using the `kernel trick' and nearest-neighbor graphs, we propose a consistent estimate of this measure which can be computed…

Methodology · Statistics 2024-08-30 Anirban Chatterjee , Ziang Niu , Bhaswar B. Bhattacharya

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

Methodology · Statistics 2010-08-13 Gilles Blanchard , Nicole Kraemer

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

In this paper we suggest two statistical hypothesis tests for the regression function of binary classification based on conditional kernel mean embeddings. The regression function is a fundamental object in classification as it determines…

Machine Learning · Statistics 2022-06-22 Ambrus Tamás , Balázs Csanád Csáji

Vast literature on experimental design extends from Fisher and Snedecor to the modern day. When data lies beyond the assumption of univariate normality, nonparametric methods including rank based statistics and permutation tests are…

Statistics Theory · Mathematics 2022-05-30 Adam B Kashlak , Sergii Myroshnychenko , Susanna Spektor

We present in this work a new family of kernels to compare positive measures on arbitrary spaces $\Xcal$ endowed with a positive kernel $\kappa$, which translates naturally into kernels between histograms or clouds of points. We first cover…

Machine Learning · Statistics 2009-09-08 Marco Cuturi

Permutation-based partial-correlation tests guarantee finite-sample Type I error control under any fixed design and exchangeable noise, yet their power can collapse when the permutation-augmented design aligns too closely with the covariate…

Methodology · Statistics 2025-06-04 Tianyi Wang , Guanghui Wang , Zhaojun Wang , Changliang Zou

Over the last couple of decades, several copula based methods have been proposed in the literature to test for the independence among several random variables. But these existing tests are not invariant under monotone transformations of the…

Statistics Theory · Mathematics 2019-11-15 Angshuman Roy , Anil Ghosh , Alok Goswami , C. A. Murthy

In nonparametric regression analysis, errors are possibly correlated in practice, and neglecting error correlation can undermine most bandwidth selection methods. When no prior knowledge or parametric form of the correlation structure is…

Methodology · Statistics 2025-04-29 Sisheng Liu , Xiaoli Kong

We consider the problem of causal structure learning in the setting of heterogeneous populations, i.e., populations in which a single causal structure does not adequately represent all population members, as is common in biological and…

Machine Learning · Statistics 2022-02-21 Alex Markham , Richeek Das , Moritz Grosse-Wentrup

This article concerns testing for equality of distribution between groups. We focus on screening variables with shared distributional features such as common support, modes and patterns of skewness. We propose a Bayesian testing method…

Methodology · Statistics 2016-02-19 Eric F. Lock , David B. Dunson

Identifying how dependence relationships vary across different conditions plays a significant role in many scientific investigations. For example, it is important for the comparison of biological systems to see if relationships between…

Methodology · Statistics 2023-07-31 Hoseung Song , Michael C. Wu

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang