English
Related papers

Related papers: Near-Linear Time Local Polynomial Nonparametric Es…

200 papers

We study the problem of space and time efficient evaluation of a nonparametric estimator that approximates an unknown density. In the regime where consistent estimation is possible, we use a piecewise multivariate polynomial interpolation…

Statistics Theory · Mathematics 2020-11-11 Paxton Turner , Jingbo Liu , Philippe Rigollet

This paper studies the use of kernel density estimation (KDE) for linear algebraic tasks involving the kernel matrix of a collection of $n$ data points in $\mathbb R^d$. In particular, we improve upon existing algorithms for computing the…

Data Structures and Algorithms · Computer Science 2026-03-05 Rikhav Shah , Sandeep Silwal , Haike Xu

We estimate the density and its derivatives using a local polynomial approximation to the logarithm of an unknown density $f$. The estimator is guaranteed to be nonnegative and achieves the same optimal rate of convergence in the interior…

Econometrics · Economics 2020-06-03 Joris Pinkse , Karl Schurter

It is shown that any linear estimator that satisfies the moment conditions up to order $p$ is equivalent to a local polynomial regression of order $p$ with some non-negative weight function if and only if the kernel has at most $p$ sign…

Methodology · Statistics 2019-12-03 Alexander Sidorenko , Kurt S. Riedel

We consider the kernel partial least squares algorithm for non-parametric regression with stationary dependent data. Probabilistic convergence rates of the kernel partial least squares estimator to the true regression function are…

Statistics Theory · Mathematics 2017-06-13 Marco Singer , Tatyana Krivobokova , Axel Munk

We introduce a data-based approach to estimating key quantities which arise in the study of nonlinear control systems and random nonlinear dynamical systems. Our approach hinges on the observation that much of the existing linear theory may…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

We introduce ParK, a new large-scale solver for kernel ridge regression. Our approach combines partitioning with random projections and iterative optimization to reduce space and time complexity while provably maintaining the same…

Machine Learning · Statistics 2022-10-18 Luigi Carratino , Stefano Vigogna , Daniele Calandriello , Lorenzo Rosasco

Linear regression is a fundamental modeling tool in statistics and related fields. In this paper, we study an important variant of linear regression in which the predictor-response pairs are partially mismatched. We use an optimization…

Optimization and Control · Mathematics 2022-11-01 Rahul Mazumder , Haoyue Wang

Statistical analysis is increasingly confronted with complex data from metric spaces. Petersen and M\"uller (2019) established a general paradigm of Fr\'echet regression with complex metric space valued responses and Euclidean predictors.…

Machine Learning · Statistics 2025-02-10 Rui Qiu , Zhou Yu , Ruoqing Zhu

This paper deals with the nonparametric density estimation of the regression error term assuming its independence with the covariate. The difference between the feasible estimator which uses the estimated residuals and the unfeasible one…

Statistics Theory · Mathematics 2010-10-05 Rawane Samb

Tree structured graphical models are powerful at expressing long range or hierarchical dependency among many variables, and have been widely applied in different areas of computer science and statistics. However, existing methods for…

Machine Learning · Statistics 2014-01-17 Le Song , Han Liu , Ankur Parikh , Eric Xing

We develop a novel asymptotic theory for local polynomial extremum estimators of time-varying parameters in a broad class of nonlinear time series models. We show the proposed estimators are consistent and follow normal distributions in…

Econometrics · Economics 2025-07-25 Dennis Kristensen , Young Jun Lee

Density estimation in high-dimensional settings is an important and challenging statistical problem.Traditional methods based on kernel smoothing are inefficient in high dimensions due to the difficulties in specifying appropriate…

Machine Learning · Statistics 2026-05-14 Ruitong Zhang , Ke Deng

Kernel density estimation is a popular method for estimating unseen probability distributions. However, the convergence of these classical estimators to the true density slows down in high dimensions. Moreover, they do not define meaningful…

Statistics Theory · Mathematics 2025-05-30 Jack Kendrick

In this paper, we develop a new and effective approach to nonparametric quantile regression that accommodates ultrahigh-dimensional data arising from spatio-temporal processes. This approach proves advantageous in staving off computational…

Methodology · Statistics 2024-05-27 Soudeep Deb , Claudia Neves , Subhrajyoty Roy

Kernel approximation via nonlinear random feature maps is widely used in speeding up kernel machines. There are two main challenges for the conventional kernel approximation methods. First, before performing kernel approximation, a good…

Machine Learning · Statistics 2015-03-16 Felix X. Yu , Sanjiv Kumar , Henry Rowley , Shih-Fu Chang

Existing works on "black-box" model interpretation use local-linear approximations to explain the predictions made for each data instance in terms of the importance assigned to the different features for arriving at the prediction. These…

Machine Learning · Computer Science 2019-08-28 Kartik Ahuja , William Zame , Mihaela van der Schaar

The generation of curves and surfaces from given data is a well-known problem in Computer-Aided Design that can be approached using subdivision schemes. They are powerful tools that allow obtaining new data from the initial one by means of…

Numerical Analysis · Mathematics 2024-12-03 Sergio López-Ureña , Dionisio F. Yáñez

Tree kernels have been proposed to be used in many areas as the automatic learning of natural language applications. In this paper, we propose a new linear time algorithm based on the concept of weighted tree automata for SubTree kernel…

Computation and Language · Computer Science 2023-02-03 Ludovic Mignot , Faissal Ouardi , Djelloul Ziadi

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang