English
Related papers

Related papers: The Generalised Kernel Covariance Measure

200 papers

We propose new reproducing kernel-based tests for model checking in conditional moment restriction models. By regressing estimated residuals on kernel functions via kernel ridge regression (KRR), we obtain a coefficient function in a…

Econometrics · Economics 2025-05-05 Yuhao Li

Depth measures are powerful tools for defining level sets in emerging, non--standard, and complex random objects such as high-dimensional multivariate data, functional data, and random graphs. Despite their favorable theoretical properties,…

In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect…

Artificial Intelligence · Computer Science 2025-06-11 Boyang Sun , Yu Yao , Xinshuai Dong , Zongfang Liu , Tongliang Liu , Yumou Qiu , Kun Zhang

I propose kernel ridge regression estimators for nonparametric dose response curves and semiparametric treatment effects in the setting where an analyst has access to a selected sample rather than a random sample; only for select…

Econometrics · Economics 2022-08-24 Rahul Singh

We investigate statistical properties for a broad class of modern kernel-based regression (KBR) methods. These kernel methods were developed during the last decade and are inspired by convex risk minimization in infinite-dimensional Hilbert…

Statistics Theory · Mathematics 2009-09-29 Andreas Christmann , Ingo Steinwart

A new non parametric approach to the problem of testing the independence of two random process is developed. The test statistic is the Hilbert Schmidt Independence Criterion (HSIC), which was used previously in testing independence for…

Machine Learning · Statistics 2014-06-18 Kacper Chwialkowski , Arthur Gretton

This paper provides a new theoretical lens for understanding the finite-sample performance of kernel-based specification tests, such as the Kernel Conditional Moment (KCM) test. Rather than introducing a fundamentally new test, we isolate…

Econometrics · Economics 2025-10-15 Cui Rui , Li Yuhao , Song Xiaojun

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

A statistical test of independence may be constructed using the Hilbert-Schmidt Independence Criterion (HSIC) as a test statistic. The HSIC is defined as the distance between the embedding of the joint distribution, and the embedding of the…

Machine Learning · Statistics 2015-01-27 Arthur Gretton

Considering a regression model, we address the question of testing the nullity of the regression function. The testing procedure is available when the variance of the observations is unknown and does not depend on any prior information on…

Statistics Theory · Mathematics 2019-04-08 Thi Thien Trang Bui

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

Identifying statistical dependence between the features and the label is a fundamental problem in supervised learning. This paper presents a framework for estimating dependence between numerical features and a categorical label using…

Machine Learning · Computer Science 2021-10-01 Silu Zhang , Xin Dang , Dao Nguyen , Dawn Wilkins , Yixin Chen

The K-sample testing problem involves determining whether K groups of data points are each drawn from the same distribution. Analysis of variance is arguably the most classical method to test mean differences, along with several recent…

Machine Learning · Statistics 2024-10-04 Sambit Panda , Cencheng Shen , Ronan Perry , Jelle Zorn , Antoine Lutz , Carey E. Priebe , Joshua T. Vogelstein

Testing the dependency between two random variables is an important inference problem in statistics since many statistical procedures rely on the assumption that the two samples are independent. To test whether two samples are independent,…

Methodology · Statistics 2023-01-04 Jin-Ting Zhang , Tianming Zhu

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

Covariate shift occurs prevalently in practice, where the input distributions of the source and target data are substantially different. Despite its practical importance in various learning problems, most of the existing methods only focus…

Machine Learning · Statistics 2023-10-20 Xingdong Feng , Xin He , Caixing Wang , Chao Wang , Jingnan Zhang

In this paper we deal with the problem of testing for the equality of $k$ probability distributions defined on $(\mathcal{X},\mathcal{B})$, where $\mathcal{X}$ is a metric space and $\mathcal{B}$ is the corresponding Borel $\sigma$-field.…

Statistics Theory · Mathematics 2018-12-04 Armando Sosthene Kali Balogoun , Guy Martial Nkiet , Carlos Ogouyandjou

We consider learning an unknown target function $f_*$ using kernel ridge regression (KRR) given i.i.d. data $(u_i,y_i)$, $i\leq n$, where $u_i \in U$ is a covariate vector and $y_i = f_* (u_i) +\varepsilon_i \in \mathbb{R}$. A recent string…

Machine Learning · Statistics 2024-03-15 Theodor Misiakiewicz , Basil Saeed

Independence testing plays a central role in statistical and causal inference from observational data. Standard independence tests assume that the data samples are independent and identically distributed (i.i.d.) but that assumption is…

Machine Learning · Statistics 2022-07-04 Ragib Ahsan , Zahra Fatemi , David Arbour , Elena Zheleva

Conditional independence (CI) testing is a fundamental and challenging task in modern statistics and machine learning. Many modern methods for CI testing rely on powerful supervised learning methods to learn regression functions or Bayes…

Machine Learning · Statistics 2023-10-31 Felipe Maia Polo , Yuekai Sun , Moulinath Banerjee