English
Related papers

Related papers: Local linear smoothing for regression surfaces on …

200 papers

We adress the problem of Laplace deconvolution with random noise in a regression framework. The time set is not considered to be fixed, but grows with the number of observation points. Moreover, the convolution kernel is unknown, and…

Statistics Theory · Mathematics 2013-04-05 Thomas Vareschi

We develop and analyze a principled approach to kernel ridge regression under covariate shift. The goal is to learn a regression function with small mean squared error over a target distribution, based on unlabeled data from there and…

Methodology · Statistics 2025-07-25 Kaizheng Wang

We study nonparametric regression and classification for path-valued data. We introduce a functional Nadaraya-Watson estimator that combines the signature transform from rough path theory with local kernel regression. The signature…

Machine Learning · Statistics 2025-10-21 Christian Bayer , Davit Gogolashvili , Luca Pelizzari

In longitudinal study, it is common that response and covariate are not measured at the same time, which complicates the analysis to a large extent. In this paper, we take into account the estimation of generalized varying coefficient model…

Methodology · Statistics 2022-06-10 Rou Zhong , Chunming Zhang , Jingxiao Zhang

We study the nodal curves of low energy Dirichlet eigenfunctions in generalized curvilinear quadrilaterals. The techniques can be seen as a generalization of the tools developed by Grieser-Jerison in a series of works on convex planar…

Analysis of PDEs · Mathematics 2019-05-03 Thomas Beck , Yaiza Canzani , Jeremy L. Marzuola

Modern deep neural networks require a tremendous amount of data to train, often needing hundreds or thousands of labeled examples to learn an effective representation. For these networks to work with less data, more structure must be built…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Reuben Feinman , Brenden M. Lake

In this paper a new smooth backfitting estimate is proposed for additive regression models. The estimate has the simple structure of Nadaraya--Watson smooth backfitting but at the same time achieves the oracle property of local linear…

Statistics Theory · Mathematics 2007-06-13 Enno Mammen , Byeong U. Park

This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regression, spline…

Statistics Theory · Mathematics 2011-09-15 Sylvain Arlot , Francis Bach

Convolutional Neural Networks (CNN) and the locally connected layer are limited in capturing the importance and relations of different local receptive fields, which are often crucial for tasks such as face verification, visual question…

Machine Learning · Computer Science 2017-11-23 Liang Pang , Yanyan Lan , Jun Xu , Jiafeng Guo , Xueqi Cheng

Consistent weighted least square estimators are proposed for a wide class of nonparametric regression models with random regression function, where this real-valued random function of $k$ arguments is assumed to be continuous with…

Statistics Theory · Mathematics 2023-07-04 Yu. Yu. Linke , I. S. Borisov , P. S. Ruzankin

Discrete kernel smoothing is now gaining importance in nonparametric statistics. In this paper, we investigate some asymptotic properties of the normalized discrete associated-kernel estimator of a probability mass function. We show, under…

Statistics Theory · Mathematics 2025-02-11 Youssef Esstafa , Célestin C. Kokonendji , Sobom M. Somé

We propose new optimal estimators for the Lipschitz frontier of a set of points. They are defined as kernel estimators being sufficiently regular, covering all the points and whose associated support is of smallest surface. The estimators…

Methodology · Statistics 2011-03-31 Stéphane Girard , Anatoli Iouditski , Alexander Nazin

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

Optimization and Control · Mathematics 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to exibly combine individual regression estimators $r_1, \ldots, r_M$ using a weighted average where the weights are dened based on…

Statistics Theory · Mathematics 2023-10-03 Sothea Has

We develop a minimax rate analysis to describe the reason that deep neural networks (DNNs) perform better than other standard methods. For nonparametric regression problems, it is well known that many standard methods attain the minimax…

Machine Learning · Statistics 2022-02-09 Masaaki Imaizumi , Kenji Fukumizu

In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relative to an active…

Optimization and Control · Mathematics 2015-03-11 Jingwei Liang , Jalal Fadili , Gabriel Peyré

Feature removal from computational geometries, or defeaturing, is an integral part of industrial simulation pipelines. Defeaturing simplifies the otherwise costly or even impossible meshing process, speeds up the simulation, and lowers its…

Numerical Analysis · Mathematics 2025-08-20 Philipp Weder , Annalisa Buffa

For solving a wide class of nonconvex and nonsmooth problems, we propose a proximal linearized iteratively reweighted least squares (PL-IRLS) algorithm. We first approximate the original problem by smoothing methods, and second write the…

Optimization and Control · Mathematics 2016-11-02 Hui Zhang , Tao Sun , Lizhi Cheng

Local polynomial regression struggles with several challenges when dealing with sparse data. The difficulty in capturing local features of the underlying function can lead to a potential misrepresentation of the true relationship.…

Methodology · Statistics 2025-05-02 Chunlei Ge , W. John Braun