English
Related papers

Related papers: Geometric Inference on Kernel Density Estimates

200 papers

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

Given a point set $P\subset \mathbb{R}^d$, the kernel density estimate of $P$ is defined as \[ \overline{\mathcal{G}}_P(x) = \frac{1}{\left|P\right|}\sum_{p\in P}e^{-\left\lVert x-p \right\rVert^2} \] for any $x\in\mathbb{R}^d$. We study…

Data Structures and Algorithms · Computer Science 2022-02-22 Wai Ming Tai

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

This paper proposes a lossless point cloud (PC) geometry compression method that uses neural networks to estimate the probability distribution of voxel occupancy. First, to take into account the PC sparsity, our method adaptively partitions…

Image and Video Processing · Electrical Eng. & Systems 2021-07-02 Dat Thanh Nguyen , Maurice Quach , Giuseppe Valenzise , Pierre Duhamel

Image acquisition and segmentation are likely to introduce noise. Further image processing such as image registration and parameterization can introduce additional noise. It is thus imperative to reduce noise measurements and boost signal.…

Methodology · Statistics 2021-11-30 Moo K. Chung

We use a deep neural network to detect and place region-of-interest boxes around ultracold atom clouds in absorption and fluorescence images---with the ability to identify and bound multiple clouds within a single image. The neural network…

Quantum Gases · Physics 2021-08-03 Lucas R. Hofer , Milan Krstajić , Péter Juhász , Anna L. Marchant , Robert P. Smith

Persistent homology has been widely used to study the topology of point clouds in $\mathbb{R}^n$. Standard approaches are very sensitive to outliers, and their computational complexity depends badly on the number of data points. In this…

Algebraic Topology · Mathematics 2022-11-29 Pepijn Roos Hoefgeest , Lucas Slot

To speed up Gaussian process inference, a number of fast kernel matrix-vector multiplication (MVM) approximation algorithms have been proposed over the years. In this paper, we establish an exact fast kernel MVM algorithm based on exact…

Machine Learning · Statistics 2025-08-05 Nicolas Langrené , Xavier Warin , Pierre Gruet

We introduce algorithms for robustly computing intrinsic coordinates on point clouds. Our approach relies on generating many candidate coordinates by subsampling the data and varying hyperparameters of the embedding algorithm (e.g.,…

Machine Learning · Statistics 2024-08-05 Andrew J. Blumberg , Mathieu Carriere , Jun Hou Fung , Michael A. Mandell

Preprocessing a 2D image often produces a noisy cloud of interest points. We study the problem of counting holes in unorganized clouds in the plane. The holes in a given cloud are quantified by the topological persistence of their boundary…

Computational Geometry · Computer Science 2016-11-18 Vitaliy Kurlin

Positive semi-definite kernels are used to induce pseudo-metrics, or ``distances'', between measures. We write these as an expected quadratic variation of, or expected inner product between, a random field and the difference of measures.…

Probability · Mathematics 2025-05-30 Ian Langmore

This article derives an accurate, explicit, and numerically stable approximation to the kernel quadrature weights in one dimension and on tensor product grids when the kernel and integration measure are Gaussian. The approximation is based…

Numerical Analysis · Mathematics 2019-05-03 Toni Karvonen , Simo Särkkä

Traditional Bayesian approaches for model uncertainty quantification rely on notoriously difficult processes of marginalization over each network parameter to estimate its probability density function (PDF). Our hypothesis is that internal…

Machine Learning · Computer Science 2021-03-03 Rishabh Singh , Jose C. Principe

In recent years, we have witnessed the presence of point cloud data in many aspects of our life, from immersive media, autonomous driving to healthcare, although at the cost of a tremendous amount of data. In this paper, we present an…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Dat Thanh Nguyen , Andre Kaup

Constructing a similarity graph from a set $X$ of data points in $\mathbb{R}^d$ is the first step of many modern clustering algorithms. However, typical constructions of a similarity graph have high time complexity, and a quadratic space…

Data Structures and Algorithms · Computer Science 2023-10-24 Peter Macgregor , He Sun

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present…

Machine Learning · Statistics 2019-06-10 Taylor Killian , Justin Goodwin , Olivia Brown , Sung-Hyun Son

This work proposes a framework LGKDE that learns kernel density estimation for graphs. The key challenge in graph density estimation lies in effectively capturing both structural patterns and semantic variations while maintaining…

Machine Learning · Computer Science 2026-05-27 Xudong Wang , Ziheng Sun , Chris Ding , Jicong Fan

Photovoltaic systems are sensitive to cloud shadow projection, which needs to be forecasted to reduce the noise impacting the intra-hour forecast of global solar irradiance. We present a comparison between different kernel discriminative…

Image and Video Processing · Electrical Eng. & Systems 2021-11-29 Guillermo Terrén-Serrano , Manel Martínez-Ramón