English
Related papers

Related papers: The GaussianSketch for Almost Relative Error Kerne…

200 papers

We present and study approximate notions of dimensional and margin complexity, which correspond to the minimal dimension or norm of an embedding required to approximate, rather then exactly represent, a given hypothesis class. We show that…

Machine Learning · Computer Science 2020-03-10 Pritish Kamath , Omar Montasser , Nathan Srebro

Randomized sketches of a tensor product of $p$ vectors follow a tradeoff between statistical efficiency and computational acceleration. Commonly used approaches avoid computing the high-dimensional tensor product explicitly, resulting in a…

Machine Learning · Statistics 2023-05-02 Jonas Wacker , Ruben Ohana , Maurizio Filippone

This work addresses the problem of simulating Gaussian random fields that are continuously indexed over a class of metric graphs, termed graphs with Euclidean edges, being more general and flexible than linear networks. We introduce three…

Statistics Theory · Mathematics 2024-04-29 Alfredo Alegría , Xavier Emery , Tobia Filosi , Emilio Porcu

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subspace embedding, and…

Data Structures and Algorithms · Computer Science 2017-12-29 Huaian Diao , Zhao Song , Wen Sun , David P. Woodruff

In all state-of-the-art sketching and coreset techniques for clustering, as well as in the best known fixed-parameter tractable approximation algorithms, randomness plays a key role. For the classic $k$-median and $k$-means problems, there…

Data Structures and Algorithms · Computer Science 2023-10-09 Vincent Cohen-Addad , David Saulpic , Chris Schwiegelshohn

This work studies the spectral convergence of graph Laplacian to the Laplace-Beltrami operator when the graph affinity matrix is constructed from $N$ random samples on a $d$-dimensional manifold embedded in a possibly high dimensional…

Statistics Theory · Mathematics 2025-09-16 Xiuyuan Cheng , Nan Wu

Bayesian optimization with Gaussian process as surrogate model has been successfully applied to analog circuit synthesis. In the traditional Gaussian process regression model, the kernel functions are defined explicitly. The computational…

Machine Learning · Computer Science 2019-12-03 Shuhan Zhang , Wenlong Lyu , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated…

Machine Learning · Statistics 2025-01-23 Takashi Furuya , Hiroyuki Kusumoto , Koichi Taniguchi , Naoya Kanno , Kazuma Suetake

We study randomized sketching methods for approximately solving least-squares problem with a general convex constraint. The quality of a least-squares approximation can be assessed in different ways: either in terms of the value of the…

Optimization and Control · Mathematics 2014-11-04 Mert Pilanci , Martin J. Wainwright

Despite the increasing importance of stochastic processes on linear networks and graphs, current literature on multivariate (vector-valued) Gaussian random fields on metric graphs is elusive. This paper challenges several aspects related to…

Statistics Theory · Mathematics 2025-01-20 Tobia Filosi , Emilio Porcu , Xavier Emery , Claudio Agostinelli , Alfredo Alegrìa

The total variation distance is a metric of central importance in statistics and probability theory. However, somewhat surprisingly, questions about computing it algorithmically appear not to have been systematically studied until very…

Data Structures and Algorithms · Computer Science 2025-03-17 Arnab Bhattacharyya , Weiming Feng , Piyush Srivastava

Non-asymptotic bounds for Gaussian and bootstrap approximation have recently attracted significant interest in high-dimensional statistics. This paper studies Berry-Esseen bounds for such approximations with respect to the multivariate…

Statistics Theory · Mathematics 2022-02-08 Miles E. Lopes

In this paper, we study error bounds for {\em Bayesian quadrature} (BQ), with an emphasis on noisy settings, randomized algorithms, and average-case performance measures. We seek to approximate the integral of functions in a {\em…

Machine Learning · Statistics 2023-02-13 Xu Cai , Chi Thanh Lam , Jonathan Scarlett

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

Statistics Theory · Mathematics 2022-07-20 Wenjia Wang , Bing-Yi Jing

The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely-wide neural networks trained under least squares loss by gradient descent. Recent works also report that NTK regression can outperform finitely-wide neural networks…

Machine Learning · Computer Science 2021-12-09 Amir Zandieh , Insu Han , Haim Avron , Neta Shoham , Chaewon Kim , Jinwoo Shin

This paper is concerned with the analysis of the kernel-based algorithm for gain function approximation in the feedback particle filter. The exact gain function is the solution of a Poisson equation involving a probability-weighted…

Numerical Analysis · Mathematics 2016-12-19 Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

$ \newcommand{\kalg}{{k_{\mathrm{alg}}}} \newcommand{\kopt}{{k_{\mathrm{opt}}}} \newcommand{\algset}{{T}} \renewcommand{\Re}{\mathbb{R}} \newcommand{\eps}{\varepsilon} \newcommand{\pth}[2][\!]{#1\left({#2}\right)} \newcommand{\npoints}{n}…

Computational Geometry · Computer Science 2017-07-04 Avrim Blum , Sariel Har-Peled , Benjamin Raichel

In nonparametric regression, it is common for the inputs to fall in a restricted subset of Euclidean space. Typical kernel-based methods that do not take into account the intrinsic geometry of the domain across which observations are…

Methodology · Statistics 2021-11-04 David B Dunson , Hau-Tieng Wu , Nan Wu

We show that geometric inference of a point cloud can be calculated by examining its kernel density estimate with a Gaussian kernel. This allows one to consider kernel density estimates, which are robust to spatial noise, subsampling, and…

Computational Geometry · Computer Science 2015-03-27 Jeff M. Phillips , Bei Wang , Yan Zheng

Topological data analysis (TDA) is an emerging mathematical concept for characterizing shapes in complex data. In TDA, persistence diagrams are widely recognized as a useful descriptor of data, and can distinguish robust and noisy…

Algebraic Topology · Mathematics 2016-04-27 Genki Kusano , Kenji Fukumizu , Yasuaki Hiraoka