English
Related papers

Related papers: New Bounds for Kernel Sums via Fast Spherical Embe…

200 papers

We are interested in the kernel of one-dimensional diffusion equations with continuous coefficients as evaluated by means of explicit discretization schemes of uniform step $h>0$ in the limit as $h\to0$. We consider both semidiscrete…

Numerical Analysis · Mathematics 2007-11-02 Claudio Albanese

It is well known that modern deep neural networks are powerful enough to memorize datasets even when the labels have been randomized. Recently, Vershynin (2020) settled a long standing question by Baum (1988), proving that \emph{deep…

Machine Learning · Computer Science 2021-06-16 Shashank Rajput , Kartik Sreenivasan , Dimitris Papailiopoulos , Amin Karbasi

This works extends the Random Embedding Bayesian Optimization approach by integrating a warping of the high dimensional subspace within the covariance kernel. The proposed warping, that relies on elementary geometric considerations, allows…

Optimization and Control · Mathematics 2015-03-19 Mickaël Binois , David Ginsbourger , Olivier Roustant

Given a set of points, clustering consists of finding a partition of a point set into $k$ clusters such that the center to which a point is assigned is as close as possible. Most commonly, centers are points themselves, which leads to the…

Machine Learning · Computer Science 2023-10-16 Maria Sofia Bucarelli , Matilde Fjeldsø Larsen , Chris Schwiegelshohn , Mads Bech Toftrup

A fundamental open question in self-supervised learning (SSL) is the explicit characterization of the optimal geometry of the learned representations. Recently, LeJEPA identified isotropic Gaussian embeddings as optimal for minimizing…

Machine Learning · Computer Science 2026-05-27 Léo Nicollier , Max Dunitz , Marc Pic , Pablo Musé , Enric Meinhardt-Llopis , Gabriele Facciolo

We propose and analyze a kernelized version of Q-learning. Although a kernel space is typically infinite-dimensional, extensive study has shown that generalization is only affected by the effective dimension of the data. We incorporate such…

Machine Learning · Computer Science 2022-04-25 Shuang Liu , Hao Su

Embedding probability distributions into reproducing kernel Hilbert spaces (RKHS) has enabled powerful nonparametric methods such as the maximum mean discrepancy (MMD), a statistical distance with strong theoretical and computational…

Machine Learning · Statistics 2025-05-28 Masha Naslidnyk , Siu Lun Chau , François-Xavier Briol , Krikamol Muandet

We provide an algorithm for properly learning mixtures of two single-dimensional Gaussians without any separability assumptions. Given $\tilde{O}(1/\varepsilon^2)$ samples from an unknown mixture, our algorithm outputs a mixture that is…

Data Structures and Algorithms · Computer Science 2014-05-20 Constantinos Daskalakis , Gautam Kamath

This work is concerned with the accuracy of Gaussian beam superpositions, which are asymptotically valid high frequency solutions to linear hyperbolic partial differential equations and the Schr\"odinger equation. We derive Sobolev and max…

Numerical Analysis · Mathematics 2015-11-02 Hailiang Liu , Olof Runborg , Nicolay M. Tanushev

We explore the boundaries of sine kernel universality for the eigenvalues of Gaussian perturbations of large deterministic Hermitian matrices. Equivalently, we study for deterministic initial data the time after which Dyson's Brownian…

Probability · Mathematics 2019-12-05 Tom Claeys , Thorsten Neuschel , Martin Venker

We consider channel coding for Gaussian channels with the recently introduced mean and variance cost constraints. Through matching converse and achievability bounds, we characterize the optimal first- and second-order performance. The main…

Information Theory · Computer Science 2025-09-15 Adeel Mahmood , Aaron B. Wagner

This paper studies the optimality of kernel methods in high-dimensional data clustering. Recent works have studied the large sample performance of kernel clustering in the high-dimensional regime, where Euclidean distance becomes less…

Machine Learning · Statistics 2019-12-03 Leena Chennuru Vankadara , Debarghya Ghoshdastidar

Let $P$ be a set of $n$ points in $\Re^2$. For a parameter $\varepsilon\in (0,1)$, a subset $C\subseteq P$ is an \emph{$\varepsilon$-kernel} of $P$ if the projection of the convex hull of $C$ approximates that of $P$ within…

Computational Geometry · Computer Science 2023-03-15 Pankaj K. Agarwal , Sariel Har-Peled

Kernel Stein discrepancies (KSDs) have emerged as a powerful tool for quantifying goodness-of-fit over the last decade, featuring numerous successful applications. To the best of our knowledge, all existing KSD estimators with known rate…

Machine Learning · Statistics 2026-03-31 Jose Cribeiro-Ramallo , Agnideep Aich , Florian Kalinke , Ashit Baran Aich , Zoltán Szabó

In recent years, kernel density estimation has been exploited by computer scientists to model machine learning problems. The kernel density estimation based approaches are of interest due to the low time complexity of either O(n) or…

Machine Learning · Statistics 2007-10-16 Yen-Jen Oyang , Darby Tien-Hao Chang , Yu-Yen Ou , Hao-Geng Hung , Chih-Peng Wu , Chien-Yu Chen

We prove an optimal 4G Theorem for the Gaussian kernel. We also propose a new general method of estimating Schroedinger perturbations of transition densities, and give applications to the Gaussian kernel.

Analysis of PDEs · Mathematics 2014-03-27 Krzysztof Bogdan , Karol Szczypkowski

This paper studies Kernel Density Estimation for a high-dimensional distribution $\rho(x)$. Traditional approaches have focused on the limit of large number of data points $n$ and fixed dimension $d$. We analyze instead the regime where…

Machine Learning · Computer Science 2024-10-21 Giulio Biroli , Marc Mézard

Kernel density estimation and kernel regression are powerful but computationally expensive techniques: a direct evaluation of kernel density estimates at $M$ evaluation points given $N$ input sample points requires a quadratic…

Computation · Statistics 2020-02-18 Nicolas Langrené , Xavier Warin

In this paper, first we consider the uniform complex time heat kernel estimates of $e^{-z(-\Delta)^{\frac{\alpha}{2}}}$ for $\alpha>0, z\in \mathbb{C}^+$. When $\frac{\alpha}{2}$ is not an integer, generally the heat kernel doest not have…

Classical Analysis and ODEs · Mathematics 2022-09-28 Shiliang Zhao , Quan Zheng

We consider smoothed versions of geometric range spaces, so an element of the ground set (e.g. a point) can be contained in a range with a non-binary value in $[0,1]$. Similar notions have been considered for kernels; we extend them to more…

Computational Geometry · Computer Science 2015-11-02 Jeff M. Phillips , Yan Zheng