English
Related papers

Related papers: Mesh-free error integration in arbitrary dimension…

200 papers

This article provides a practical introduction to kernel discrepancies, focusing on the Maximum Mean Discrepancy (MMD), the Hilbert-Schmidt Independence Criterion (HSIC), and the Kernel Stein Discrepancy (KSD). Various estimators for these…

Machine Learning · Statistics 2025-11-03 Antonin Schrab

As the size and richness of available datasets grow larger, the opportunities for solving increasingly challenging problems with algorithms learning directly from data grow at the same pace. Consequently, the capability of learning…

Machine Learning · Computer Science 2019-12-13 Raffaello Camoriano

As modern machine learning models continue to advance the computational frontier, it has become increasingly important to develop precise estimates for expected performance improvements under different model and data scaling regimes.…

Machine Learning · Computer Science 2023-06-13 Lechao Xiao , Hong Hu , Theodor Misiakiewicz , Yue M. Lu , Jeffrey Pennington

The Maximum Mean Discrepancy (MMD) is a cornerstone statistic for nonparametric two-sample testing, but its test power is dictated entirely by the chosen kernel. Because any fixed kernel inherently fails to distinguish certain…

Machine Learning · Statistics 2026-05-11 Yijin Ni , Xiaoming Huo

Kernel expansions are a topic of considerable interest in machine learning, also because of their relation to the so-called feature maps introduced in machine learning. Properties of the associated basis functions and weights (corresponding…

Machine Learning · Computer Science 2024-10-03 Mauro Bisiacco , Gianluigi Pillonetto

The radial basis function (RBF) and quasi Monte Carlo (QMC) methods are two very promising schemes to handle high-dimension problems with complex and moving boundary geometry due to the fact that they are independent of dimensionality and…

Numerical Analysis · Mathematics 2025-10-20 W. Chen , J. He

We study quasi-Monte Carlo (QMC) integration over the multi-dimensional unit cube in several weighted function spaces with different smoothness classes. We consider approximating the integral of a function by the median of several integral…

Numerical Analysis · Mathematics 2024-02-20 Takashi Goda , Kosuke Suzuki , Makoto Matsumoto

We perform a study on kernel regression for large-dimensional data (where the sample size $n$ is polynomially depending on the dimension $d$ of the samples, i.e., $n\asymp d^{\gamma}$ for some $\gamma >0$ ). We first build a general tool to…

Machine Learning · Statistics 2024-07-01 Weihao Lu , Haobo Zhang , Yicheng Li , Manyun Xu , Qian Lin

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

We study an optimal control problem under uncertainty, where the target function is the solution of an elliptic partial differential equation with random coefficients, steered by a control function. The robust formulation of the…

Numerical Analysis · Mathematics 2019-10-23 Philipp A. Guth , Vesa Kaarnioja , Frances Y. Kuo , Claudia Schillings , Ian H. Sloan

For two decades, reproducing kernels and their associated discrepancies have facilitated elegant theoretical analyses in the setting of quasi Monte Carlo. These same tools are now receiving interest in statistics and related fields, as…

Methodology · Statistics 2023-08-24 Chris. J. Oates

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Approximate Markov chain Monte Carlo (MCMC) offers the promise of more rapid sampling at the cost of more biased inference. Since standard MCMC diagnostics fail to detect these biases, researchers have developed computable Stein discrepancy…

Machine Learning · Statistics 2020-10-16 Jackson Gorham , Lester Mackey

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

A standard objective in computer experiments is to approximate the behaviour of an unknown function on a compact domain from a few evaluations inside the domain. When little is known about the function, space-filling design is advisable:…

Statistics Theory · Mathematics 2018-09-03 Luc Pronzato , Anatoly Zhigljavsky

Pixel-space full spectrum fitting exploiting non-linear $\chi^2$ minimization became a \emph{de facto} standard way of deriving internal kinematics from absorption line spectra of galaxies and star clusters. However, reliable estimation of…

Instrumentation and Methods for Astrophysics · Physics 2020-04-29 Igor V. Chilingarian , Kirill A. Grishin

Kernel-phase is a data analysis method based on a generalization of the notion of closure-phase invented in the context of interferometry, but that applies to well corrected diffraction dominated images produced by an arbitrary aperture.…

Instrumentation and Methods for Astrophysics · Physics 2020-04-22 Frantz Martinache , Alban Ceau , Romain Laugier , Jens Kammerer , Mamadou N'Diaye , David Mary , Nick Cvetojevic , Coline Lopez

Kernel interpolation, especially in the context of Gaussian process emulation, is a widely used technique in surrogate modelling, where the goal is to cheaply approximate an input-output map using a limited number of function evaluations.…

Numerical Analysis · Mathematics 2025-11-13 Elliot J. Addy , Jonas Latz , Aretha L. Teckentrup

Nonlinear kernels can be approximated using finite-dimensional feature maps for efficient risk minimization. Due to the inherent trade-off between the dimension of the (mapped) feature space and the approximation accuracy, the key problem…

Machine Learning · Computer Science 2018-10-10 Shahin Shahrampour , Vahid Tarokh

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi