English
Related papers

Related papers: A general framework for the analysis of kernel-bas…

200 papers

We consider the prediction problem of a continuous-time stochastic process on an entire time-interval in terms of its recent past. The approach we adopt is based on functional kernel nonparametric regression estimation techniques where…

Statistics Theory · Mathematics 2007-06-13 Anestis Antoniadis , Efstathios Paparoditis , Theofanis Sapatinas

To adapt kernel two-sample and independence testing to complex structured data, aggregation of multiple kernels is frequently employed to boost testing power compared to single-kernel tests. However, we observe a phenomenon that directly…

Machine Learning · Computer Science 2025-10-14 Zhijian Zhou , Xunye Tian , Liuhua Peng , Chao Lei , Antonin Schrab , Danica J. Sutherland , Feng Liu

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

This survey is an introduction to positive definite kernels and the set of methods they have inspired in the machine learning literature, namely kernel methods. We first discuss some properties of positive definite kernels as well as…

Machine Learning · Statistics 2009-12-04 Marco Cuturi

Kernel methods are one of the mainstays of machine learning, but the problem of kernel learning remains challenging, with only a few heuristics and very little theory. This is of particular importance in methods based on estimation of…

Machine Learning · Statistics 2016-06-03 Seth Flaxman , Dino Sejdinovic , John P. Cunningham , Sarah Filippi

This article studies global testing of the slope function in functional linear regression model in the framework of reproducing kernel Hilbert space. We propose a new testing statistic based on smoothness regularization estimators. The…

Statistics Theory · Mathematics 2021-10-13 Jianjun Xu , Wenquan Cui

We propose kernel-type smoothed Kolmogorov-Smirnov and Cram\'{e}r-von Mises tests for data on general interval, using bijective transformations. Though not as severe as in the kernel density estimation, utilizing naive kernel method…

Methodology · Statistics 2020-05-29 Rizky Reza Fauzi , Yoshihiko Maesono

In this paper, we propose a test for the equality of multiple distributions based on kernel mean embeddings. Our framework provides a flexible way to handle multivariate or even high-dimensional data by virtue of kernel methods and allows…

Statistics Theory · Mathematics 2020-06-08 Ilmun Kim

This paper proposes a ridgeless kernel method for solving infinite-horizon, deterministic, continuous-time models in economic dynamics, formulated as systems of differential-algebraic equations with asymptotic boundary conditions (e.g.,…

General Economics · Economics 2025-10-30 Mahdi Ebrahimi Kahou , Jesse Perla , Geoff Pleiss

Regression tasks, notably in safety-critical domains, require proper uncertainty quantification, yet the literature remains largely classification-focused. In this light, we introduce a family of measures for total, aleatoric, and epistemic…

Machine Learning · Computer Science 2025-10-30 Christopher Bülte , Yusuf Sale , Gitta Kutyniok , Eyke Hüllermeier

We propose a method for feature selection that employs kernel-based measures of independence to find a subset of covariates that is maximally predictive of the response. Building on past work in kernel dimension reduction, we show how to…

Machine Learning · Statistics 2018-10-23 Jianbo Chen , Mitchell Stern , Martin J. Wainwright , Michael I. Jordan

The large-sample behavior of non-degenerate multivariate $U$-statistics of arbitrary degree is investigated under the assumption that their kernel depends on parameters that can be estimated consistently. Mild regularity conditions are…

Statistics Theory · Mathematics 2025-07-22 Alain Desgagné , Christian Genest , Frédéric Ouimet

How many training data are needed to learn a supervised task? It is often observed that the generalization error decreases as $n^{-\beta}$ where $n$ is the number of training examples and $\beta$ an exponent that depends on both data and…

Machine Learning · Statistics 2021-02-03 Stefano Spigler , Mario Geiger , Matthieu Wyart

We find the asymptotic distribution of the multi-dimensional multi-scale and kernel estimators for high-frequency financial data with microstructure. Sampling times are allowed to be asynchronous and endogenous. In the process, we show that…

Statistics Theory · Mathematics 2014-11-05 Markus Bibinger , Per A. Mykland

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

This paper introduces a novel statistical regression framework that allows the incorporation of consistency constraints. A linear and nonlinear (kernel-based) formulation are introduced, and both imply closed-form analytical solutions. The…

Methodology · Statistics 2020-12-10 Emiliano Díaz , Adrián Pérez-Suay , Valero Laparra , Gustau Camps-Valls

Graph-based methods pervade the inference toolkits of numerous disciplines including sociology, biology, neuroscience, physics, chemistry, and engineering. A challenging problem encountered in this context pertains to determining the…

Machine Learning · Computer Science 2018-09-25 Daniel Romero , Vassilis N. Ioannidis , Georgios B. Giannakis

We establish sufficient conditions for the asymptotic normality of kernel density estimators, applied to causal linear random fields. Our conditions on the coefficients of linear random fields are weaker than known results, although our…

Statistics Theory · Mathematics 2012-01-04 Yizao Wang , Michael Woodroofe

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Machine Learning · Computer Science 2020-03-03 Jen Ning Lim , Makoto Yamada , Wittawat Jitkrittum , Yoshikazu Terada , Shigeyuki Matsui , Hidetoshi Shimodaira

In $\mathbb R^d$, it is well-known that cumulants provide an alternative to moments that can achieve the same goals with numerous benefits such as lower variance estimators. In this paper we extend cumulants to reproducing kernel Hilbert…

Machine Learning · Statistics 2023-10-31 Patric Bonnier , Harald Oberhauser , Zoltán Szabó