English
Related papers

Related papers: Nadaraya-Watson kernel smoothing as a random energ…

200 papers

A variance reduction technique in nonparametric smoothing is proposed: at each point of estimation, form a linear combination of a preliminary estimator evaluated at nearby points with the coefficients specified so that the asymptotic bias…

Statistics Theory · Mathematics 2007-08-22 Ming-Yen Cheng , Liang Peng , Jyh-Shyang Wu

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest…

Machine Learning · Computer Science 2021-01-15 Danica J. Sutherland , Liang Xiong , Barnabás Póczos , Jeff Schneider

The discrete kernel method was developed to estimate count data distributions, distinguishing discrete associated kernels based on their asymptotic behaviour. This study investigates the class of discrete asymmetric kernels and their…

Methodology · Statistics 2017-02-07 Tristan Senga Kiessé

Understanding the spectral properties of kernels offers a principled perspective on generalization and representation quality. While deep models achieve state-of-the-art accuracy in molecular property prediction, kernel methods remain…

Machine Learning · Computer Science 2025-10-17 Asma Jamali , Tin Sum Cheng , Rodrigo A. Vargas-Hernández

Flexible estimation of the mean outcome under a treatment regimen (i.e., value function) is the key step toward personalized medicine. We define our target parameter as a conditional value function given a set of baseline covariates which…

Statistics Theory · Mathematics 2023-09-29 Ashkan Ertefaie , Luke Duttweiler , Brent A. Johnson , Mark J. van der Laan

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

Covariate shift in regression problems and the associated distribution mismatch between training and test data is a commonly encountered phenomenon in machine learning. In this paper, we extend recent results on nonparametric convergence…

Statistics Theory · Mathematics 2024-05-28 Lukas Trottner

Spherical radial-basis-based kernel interpolation abounds in image sciences including geophysical image reconstruction, climate trends description and image rendering due to its excellent spatial localization property and perfect…

Machine Learning · Computer Science 2024-01-17 Xiaotong Liu , Jinxin Wang , Di Wang , Shao-Bo Lin

Nonparametric mean function regression with repeated measurements serves as a cornerstone for many statistical branches, such as longitudinal/panel/functional data analysis. In this work, we investigate this problem using fully connected…

Statistics Theory · Mathematics 2025-02-27 Shunxing Yan , Fang Yao , Hang Zhou

We study estimation and testing in the Poisson regression model with noisy high dimensional covariates, which has wide applications in analyzing noisy big data. Correcting for the estimation bias due to the covariate noise leads to a…

Statistics Theory · Mathematics 2023-01-03 Fei Jiang , Yeqing Zhou , Jianxuan Liu , Yanyuan Ma

Dataset bias has attracted increasing attention recently for its detrimental effect on the generalization ability of fine-tuned models. The current mainstream solution is designing an additional shallow model to pre-identify biased…

Computation and Language · Computer Science 2022-10-17 Songyang Gao , Shihan Dou , Qi Zhang , Xuanjing Huang

This paper presents an end-to-end differentiable algorithm for robust and detail-preserving surface normal estimation on unstructured point-clouds. We utilize graph neural networks to iteratively parameterize an adaptive anisotropic kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Jan Eric Lenssen , Christian Osendorfer , Jonathan Masci

Many signal processing and machine learning applications are built from evaluating a kernel on pairs of signals, e.g. to assess the similarity of an incoming query to a database of known signals. This nonlinear evaluation can be simplified…

Signal Processing · Electrical Eng. & Systems 2021-03-16 Vincent Schellekens , Laurent Jacques

In this paper we develop a data-driven smoothing technique for high-dimensional and non-linear panel data models. We allow for individual specific (non-linear) functions and estimation with econometric or machine learning methods by using…

Methodology · Statistics 2020-01-06 Xi Chen , Ye Luo , Martin Spindler

We propose a pointwise inference algorithm for high-dimensional linear models with time-varying coefficients. The method is based on a novel combination of the nonparametric kernel smoothing technique and a Lasso bias-corrected ridge…

Methodology · Statistics 2017-03-17 Xiaohui Chen , Yifeng He

The aim of this article is to propose a novel kernel estimator of the baseline function in a general high-dimensional Cox model, for which we derive non-asymptotic rates of convergence. To construct our estimator, we first estimate the…

Applications · Statistics 2015-07-07 Agathe Guilloux , Sarah Lemler , Marie-Luce Taupin

Network data are becoming increasingly available, and so there is a need to develop suitable methodology for statistical analysis. Networks can be represented as graph Laplacian matrices, which are a type of manifold-valued data. Our main…

Methodology · Statistics 2020-10-02 Katie E. Severn , Ian L. Dryden , Simon P. Preston

We consider nonparametric estimation of a regression curve when the data are observed with multiplicative distortion which depends on an observed confounding variable. We suggest several estimators, ranging from a relatively simple one that…

Statistics Theory · Mathematics 2016-01-13 Aurore Delaigle , Peter Hall , Wen-Xin Zhou

Let $v$ be a vector field in a bounded open set $G\subset {\mathbb {R}}^d$. Suppose that $v$ is observed with a random noise at random points $X_i, i=1,...,n,$ that are independent and uniformly distributed in $G.$ The problem is to…

Statistics Theory · Mathematics 2009-09-29 Vladimir Koltchinskii , Lyudmila Sakhanenko , Songhe Cai

Effective learning of asymmetric and local features in images and other data observed on multi-dimensional grids is a challenging objective critical for a wide range of image processing applications involving biomedical and natural images.…

Methodology · Statistics 2022-10-06 Meng Li , Li Ma