English
Related papers

Related papers: More efficient approximation of smoothing splines …

200 papers

The order of smoothness chosen in nonparametric estimation problems is critical. This choice balances the tradeoff between model parsimony and data overfitting. The most common approach used in this context is cross-validation. However,…

Methodology · Statistics 2015-10-13 Daniel Taylor-Rodriguez , Sujit Ghosh

Almost sure bounds are established on the uniform error of smoothing spline estimators in nonparametric regression with random designs. Some results of Einmahl and Mason (2005) are used to derive uniform error bounds for the approximation…

Statistics Theory · Mathematics 2007-06-13 P. P. B. Eggermont , V. N. LaRiccia

We consider a spatial functional linear regression, where a scalar response is related to a square integrable spatial functional process. We use a smoothing spline estimator for the functional slope parameter and establish a finite sample…

Statistics Theory · Mathematics 2019-08-07 Stéphane Bouka , Sophie Dabo-Niang , Guy Martial Nkiet

Nonlinear (systems of) ordinary differential equations (ODEs) are common tools in the analysis of complex one-dimensional dynamic systems. In this paper we propose a smoothing approach regularized by a quasilinearized ODE-based penalty in…

Methodology · Statistics 2014-04-30 Gianluca Frasso , Jonathan Jaeger , Philippe Lambert

Probability estimation is essential for every statistical data compression algorithm. In practice probability estimation should be adaptive, recent observations should receive a higher weight than older observations. We present a…

Information Theory · Computer Science 2015-01-12 Christopher Mattern

Using a deterministic framework allows us to estimate a function with the purpose of interpolating data in spatial statistics. Radial basis functions are commonly used for scattered data interpolation in a d-dimensional space, however,…

Computation · Statistics 2024-04-03 Joaquin Cavieres , Michael Karkulik

We introduce a new method for solving nonlinear continuous optimization problems with chance constraints. Our method is based on a reformulation of the probabilistic constraint as a quantile function. The quantile function is approximated…

Optimization and Control · Mathematics 2020-03-17 Alejandra Peña-Ordieres , James R. Luedtke , Andreas Wächter

The non-parametric estimation of average causal effects in observational studies often relies on controlling for confounding covariates through smoothing regression methods such as kernel, splines or local polynomial regression. Such…

Methodology · Statistics 2017-10-20 Jenny Häggström , Xavier de Luna

We consider the classical makespan minimization scheduling problem where $n$ jobs must be scheduled on $m$ identical machines. Using weighted random sampling, we developed two sublinear time approximation schemes: one for the case where $n$…

Data Structures and Algorithms · Computer Science 2026-05-05 Bin Fu , Yumei Huo , Hairong Zhao

We study generalized additive partial linear models, proposing the use of polynomial spline smoothing for estimation of nonparametric functions, and deriving quasi-likelihood based estimators for the linear parameters. We establish…

Statistics Theory · Mathematics 2011-12-13 Li Wang , Xiang Liu , Hua Liang , Raymond J. Carroll

We extend nonparametric regression smoothing splines to a context where there is endogeneity and instrumental variables are available. Unlike popular existing estimators, the resulting estimator is one-step and relies on a unique…

Econometrics · Economics 2024-12-10 Jad Beyhum , Elia Lapenta , Pascal Lavergne

We propose a fast bivariate smoothing approach for symmetric surfaces that has a wide range of applications. We show how it can be applied to estimate the covariance function in longitudinal data as well as multiple additive covariances in…

Computation · Statistics 2016-09-23 Jona Cederbaum , Fabian Scheipl , Sonja Greven

We consider the problem of estimating an unknown function f* and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f* except that it is smooth in the sense that it has square integrable…

Machine Learning · Statistics 2024-05-17 Eunji Lim

There has been substantial recent work on methods for estimating the slope function in linear regression for functional data analysis. However, as in the case of more conventional finite-dimensional regression, much of the practical…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Peter Hall

Observational data are often accompanied by natural structural indices, such as time stamps or geographic locations, which are meaningful to prediction tasks but are often discarded. We leverage semantically meaningful indexing data while…

Machine Learning · Computer Science 2020-03-16 Esther Rolf , Michael I. Jordan , Benjamin Recht

Spline basis exploration via Bayesian model selection is a widely employed strategy for determining the optimal set of basis terms in nonparametric regression. However, despite its widespread use, this approach often encounters performance…

Methodology · Statistics 2025-04-09 Sunwoo Lim , Sihyeon Pyeon , Seonghyun Jeong

Fine stratification survey is useful in many applications as its point estimator is unbiased, but the variance estimator under the design cannot be easily obtained, particularly when the sample size per stratum is as small as one unit. One…

Methodology · Statistics 2026-03-05 Sepideh Mosaferi , Shonosuke Sugasawa

In the context of functional data analysis, probability density functions as non-negative functions are characterized by specific properties of scale invariance and relative scale which enable to represent them with the unit integral…

Numerical Analysis · Mathematics 2019-12-19 Jitka Machalova , Renata Talska , Karel Hron , Ales Gaba

Approximating functions by a linear span of truncated basis sets is a standard procedure for the numerical solution of differential and integral equations. Commonly used concepts of approximation methods are well-posed and convergent, by…

Numerical Analysis · Mathematics 2022-12-14 Yahya Saleh , Armin Iske , Andrey Yachmenev , Jochen Küpper

We propose a variational method to solve all three estimation problems for nonlinear stochastic dynamical systems: prediction, filtering, and smoothing. Our new approach is based upon a proper choice of cost function, termed the {\it…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Gregory L. Eyink