English
Related papers

Related papers: The Generalised Kernel Covariance Measure

200 papers

Many unsupervised kernel methods rely on the estimation of the kernel covariance operator (kernel CO) or kernel cross-covariance operator (kernel CCO). Both kernel CO and kernel CCO are sensitive to contaminated data, even when bounded…

Machine Learning · Statistics 2017-05-12 Md. Ashad Alam , Kenji Fukumizu , Yu-Ping Wang

We consider kernel based learning methods for regression and analyze what happens to the risk minimizer when new variables, statistically independent of input and target variables, are added to the set of input variables; this problem…

Disordered Systems and Neural Networks · Physics 2007-05-23 Nicola Ancona , Sebastiano Stramaglia

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

We study the problem of testing the null hypothesis that X and Y are conditionally independent given Z, where each of X, Y and Z may be functional random variables. This generalises testing the significance of X in a regression model of…

Statistics Theory · Mathematics 2023-09-27 Anton Rask Lundborg , Rajen D. Shah , Jonas Peters

Kernel-based methods are used in the context of Granger Causality to enable the identification of nonlinear causal relationships between time series variables. In this paper, we show that two state of the art kernel-based Granger Causality…

Machine Learning · Computer Science 2026-01-15 Fiona Murphy , Alessio Benavoli

In this paper, we propose a test for the equality of multiple distributions based on kernel mean embeddings. Our framework provides a flexible way to handle multivariate or even high-dimensional data by virtue of kernel methods and allows…

Statistics Theory · Mathematics 2020-06-08 Ilmun Kim

We propose several approaches for solving differential equations (DEs) with quantum kernel methods. We compose quantum models as weighted sums of kernel functions, where variables are encoded using feature maps and model derivatives are…

Quantum Physics · Physics 2023-04-12 Annie E. Paine , Vincent E. Elfving , Oleksandr Kyriienko

Distance covariance is a popular dependence measure for two random vectors $X$ and $Y$ of possibly different dimensions and types. Recent years have witnessed concentrated efforts in the literature to understand the distributional…

Statistics Theory · Mathematics 2024-08-05 Qiyang Han , Yandi Shen

The Generalized Additive Model (GAM) is a powerful tool and has been well studied. This model class helps to identify additive regression structure. Via available test procedures one may identify the regression structure even sharper if…

Methodology · Statistics 2020-09-11 Rong Liu , Wolfgang Karl Härdle

Discovering causal relationships from observational data is a fundamental yet challenging task. Invariant causal prediction (ICP, Peters et al., 2016) is a method for causal feature selection which requires data from heterogeneous settings…

Methodology · Statistics 2024-09-06 Lucas Kook , Sorawit Saengkyongam , Anton Rask Lundborg , Torsten Hothorn , Jonas Peters

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

Machine Learning · Statistics 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

The interpretation of complex high-dimensional data typically requires the use of dimensionality reduction techniques to extract explanatory low-dimensional representations. However, in many real-world problems these representations may not…

Machine Learning · Statistics 2019-06-25 Kaspar Märtens , Kieran R. Campbell , Christopher Yau

We address the problem of filling missing entries in a kernel Gram matrix, given a related full Gram matrix. We attack this problem from the viewpoint of regression, assuming that the two kernel matrices can be considered as explanatory…

Quantitative Methods · Quantitative Biology 2011-11-10 Yoshihiro Yamanishi , Jean-Philippe Vert

Conditional independence (CI) testing is frequently used in data analysis and machine learning for various scientific fields and it forms the basis of constraint-based causal discovery. Oftentimes, CI testing relies on strong, rather…

Methodology · Statistics 2023-06-21 Wiebke Günther , Urmi Ninad , jonas Wahl , Jakob Runge

We prove that kernel covariance embeddings lead to information-theoretically perfect separation of distinct continuous probability distributions. In statistical terms, we establish that testing for the \emph{equality} of two non-atomic…

Machine Learning · Statistics 2026-05-14 Leonardo V. Santoro , Kartik G. Waghmare , Victor M. Panaretos

We revisit the classical problem of comparing regression functions, a fundamental question in statistical inference with broad relevance to modern applications such as data integration, transfer learning, and causal inference. Existing…

Methodology · Statistics 2025-10-29 Jian Yan , Zhuoxi Li , Yang Ning , Yong Chen

Kernel-based testing has revolutionized the field of non-parametric tests through the embedding of distributions in an RKHS. This strategy has proven to be powerful and flexible, yet its applicability has been limited to the standard…

Methodology · Statistics 2024-11-28 Anthony Ozier-Lafontaine , Polina Arsenteva , Franck Picard , Bertrand Michel

The Gaussian Process Convolution Model (GPCM; Tobar et al., 2015a) is a model for signals with complex spectral structure. A significant limitation of the GPCM is that it assumes a rapidly decaying spectrum: it can only model smooth…

Machine Learning · Statistics 2022-04-15 Wessel P. Bruinsma , Martin Tegnér , Richard E. Turner

This article addresses the problem of testing the conditional independence of two generic random vectors $X$ and $Y$ given a third random vector $Z$, which plays an important role in statistical and machine learning applications. We propose…

Methodology · Statistics 2024-07-26 Yi Zhang , Linjun Huang , Yun Yang , Xiaofeng Shao

High-dimensional variable selection is an important issue in many scientific fields, such as genomics. In this paper, we develop a sure independence feature screening pro- cedure based on kernel canonical correlation analysis (KCCA-SIS, for…

Methodology · Statistics 2016-10-04 Tianqi Liu , Kuang-Yao Lee , Hongyu Zhao