English
Related papers

Related papers: A Quasi-Monte Carlo Data Structure for Smooth Kern…

200 papers

In this paper we revisit the kernel density estimation problem: given a kernel $K(x, y)$ and a dataset of $n$ points in high dimensional Euclidean space, prepare a data structure that can quickly output, given a query $q$, a…

Data Structures and Algorithms · Computer Science 2020-11-16 Moses Charikar , Michael Kapralov , Navid Nouri , Paris Siminelakis

Kernel density estimation (KDE) is one of the most widely used nonparametric density estimation methods. The fact that it is a memory-based method, i.e., it uses the entire training data set for prediction, makes it unsuitable for most…

Machine Learning · Computer Science 2022-08-08 Joseph A. Gallego , Juan F. Osorio , Fabio A. González

This paper studies the use of kernel density estimation (KDE) for linear algebraic tasks involving the kernel matrix of a collection of $n$ data points in $\mathbb R^d$. In particular, we improve upon existing algorithms for computing the…

Data Structures and Algorithms · Computer Science 2026-03-05 Rikhav Shah , Sandeep Silwal , Haike Xu

We establish a deterministic and stochastic spherical quasi-interpolation framework featuring scaled zonal kernels derived from radial basis functions on the ambient Euclidean space. The method incorporates both quasi-Monte Carlo and Monte…

Numerical Analysis · Mathematics 2025-10-15 Zhengjie Sun , Mengyuan Lv , Xingping Sun

In the kernel density estimation (KDE) problem, we are given a set $X$ of data points in $\mathbb{R}^d$, a kernel function $k: \mathbb{R}^d \times \mathbb{R}^d \rightarrow \mathbb{R}$, and a query point $\mathbf{q} \in \mathbb{R}^d$, and…

Data Structures and Algorithms · Computer Science 2025-07-03 Steinar Laenen , Peter Macgregor , He Sun

Given a set of points $P\subset \mathbb{R}^{d}$ and a kernel $k$, the Kernel Density Estimate at a point $x\in\mathbb{R}^{d}$ is defined as $\mathrm{KDE}_{P}(x)=\frac{1}{|P|}\sum_{y\in P} k(x,y)$. We study the problem of designing a data…

Data Structures and Algorithms · Computer Science 2018-09-03 Moses Charikar , Paris Siminelakis

Kernel density estimation (KDE) stands out as a challenging task in machine learning. The problem is defined in the following way: given a kernel function $f(x,y)$ and a set of points $\{x_1, x_2, \cdots, x_n \} \subset \mathbb{R}^d$, we…

Machine Learning · Computer Science 2024-02-15 Jiehao Liang , Zhao Song , Zhaozhuo Xu , Junze Yin , Danyang Zhuo

In batch Kernel Density Estimation (KDE) for a kernel function $f$, we are given as input $2n$ points $x^{(1)}, \cdots, x^{(n)}, y^{(1)}, \cdots, y^{(n)}$ in dimension $m$, as well as a vector $v \in \mathbb{R}^n$. These inputs implicitly…

Data Structures and Algorithms · Computer Science 2024-07-03 Josh Alman , Yunfeng Guan

While robust parameter estimation has been well studied in parametric density estimation, there has been little investigation into robust density estimation in the nonparametric setting. We present a robust version of the popular kernel…

Machine Learning · Statistics 2014-11-18 Robert A. Vandermeulen , Clayton D. Scott

We study the problem of space and time efficient evaluation of a nonparametric estimator that approximates an unknown density. In the regime where consistent estimation is possible, we use a piecewise multivariate polynomial interpolation…

Statistics Theory · Mathematics 2020-11-11 Paxton Turner , Jingbo Liu , Philippe Rigollet

Markov Chain Monte Carlo approach is frequently used within Bayesian framework to sample the target posterior distribution. Its efficiency strongly depends on the proposal used to build the chain. The best jump proposal is the one that…

Instrumentation and Methods for Astrophysics · Physics 2023-02-01 Mikel Falxa , Stanislav Babak , Maude Le Jeune

The estimation of probability density functions is a fundamental problem in science and engineering. However, common methods such as kernel density estimation (KDE) have been demonstrated to lack robustness, while more complex methods have…

Machine Learning · Computer Science 2025-06-30 Anna Mészáros , Julian F. Schumann , Javier Alonso-Mora , Arkady Zgonnikov , Jens Kober

This article provides a high-level overview of some recent works on the application of quasi-Monte Carlo (QMC) methods to PDEs with random coefficients. It is based on an in-depth survey of a similar title by the same authors, with an…

Numerical Analysis · Mathematics 2017-10-31 Frances Y. Kuo , Dirk Nuyens

We propose a method for nonparametric density estimation that exhibits robustness to contamination of the training sample. This method achieves robustness by combining a traditional kernel density estimator (KDE) with ideas from classical…

Machine Learning · Statistics 2011-09-07 JooSeuk Kim , Clayton D. Scott

Numerical data imputation algorithms replace missing values by estimates to leverage incomplete data sets. Current imputation methods seek to minimize the error between the unobserved ground truth and the imputed values. But this strategy…

Machine Learning · Statistics 2023-07-11 Florian Lalande , Kenji Doya

Monte Carlo radiation transport simulations have clearly contributed to improve the design of nuclear systems. When performing in-beam or shielding simulations a complexity arises due to the fact that particles must be tracked to regions…

Instrumentation and Detectors · Physics 2022-03-15 N. S. Schmidt , O. I. Abbate , Z. M. Prieto , J. I. Robledo , J. I. Márquez Damián , A. A. Márquez , J. Dawidowski

We consider the problem of improving the efficiency of randomized Fourier feature maps to accelerate training and testing speed of kernel methods on large datasets. These approximate feature maps arise as Monte Carlo approximations to…

Machine Learning · Statistics 2015-08-11 Haim Avron , Vikas Sindhwani , Jiyan Yang , Michael Mahoney

We study fast algorithms for computing fundamental properties of a positive semidefinite kernel matrix $K \in \mathbb{R}^{n \times n}$ corresponding to $n$ points $x_1,\ldots,x_n \in \mathbb{R}^d$. In particular, we consider estimating the…

Data Structures and Algorithms · Computer Science 2021-06-21 Arturs Backurs , Piotr Indyk , Cameron Musco , Tal Wagner

In recent years, kernel density estimation has been exploited by computer scientists to model machine learning problems. The kernel density estimation based approaches are of interest due to the low time complexity of either O(n) or…

Machine Learning · Statistics 2007-10-16 Yen-Jen Oyang , Darby Tien-Hao Chang , Yu-Yen Ou , Hao-Geng Hung , Chih-Peng Wu , Chien-Yu Chen

Approximate Markov chain Monte Carlo (MCMC) offers the promise of more rapid sampling at the cost of more biased inference. Since standard MCMC diagnostics fail to detect these biases, researchers have developed computable Stein discrepancy…

Machine Learning · Statistics 2020-10-16 Jackson Gorham , Lester Mackey
‹ Prev 1 2 3 10 Next ›