English
Related papers

Related papers: Local Asymptotics of P-splines

200 papers

We revisit the additive model learning literature and adapt a penalized spline formulation due to Eilers and Marx, to train additive classifiers efficiently. We also propose two new embeddings based two classes of orthogonal basis with…

Computer Vision and Pattern Recognition · Computer Science 2011-10-06 Subhransu Maji

We provide improved error bounds for kernel-based numerical differentiation in terms of growth functions when kernels are of a finite smoothness, such as polyharmonic splines, thin plate splines or Wendland kernels. In contrast to existing…

Numerical Analysis · Mathematics 2025-12-24 Oleg Davydov

This paper develops tests for inequality constraints of nonparametric regression functions. The test statistics involve a one-sided version of $L_p$-type functionals of kernel estimators $(1 \leq p < \infty)$. Drawing on the approach of…

Statistics Theory · Mathematics 2023-08-28 Sokbae Lee , Kyungchul Song , Yoon-Jae Whang

Limit distributions for the greatest convex minorant and its derivative are considered for a general class of stochastic processes including partial sum processes and empirical processes, for independent, weakly dependent and long range…

Statistics Theory · Mathematics 2016-08-16 D. Anevski , O. Hössjer

We prove an exponential estimate for the asymptotics of Bergman kernels of a positive line bundle under hypotheses of bounded geometry. We give further Bergman kernel proofs of complex geometry results, such as separation of points,…

Differential Geometry · Mathematics 2015-09-09 Xiaonan Ma , George Marinescu

We study trend filtering, a recently proposed tool of Kim et al. [SIAM Rev. 51 (2009) 339-360] for nonparametric regression. The trend filtering estimate is defined as the minimizer of a penalized least squares criterion, in which the…

Statistics Theory · Mathematics 2014-03-24 Ryan J. Tibshirani

We study the asymptotics for sparse exponential random graph models where the parameters may depend on the number of vertices of the graph. We obtain exact estimates for the mean and variance of the limiting probability distribution and the…

Probability · Mathematics 2017-04-19 Mei Yin , Lingjiong Zhu

Let K be a convex set in R d and let K $\lambda$ be the convex hull of a homogeneous Poisson point process P $\lambda$ of intensity $\lambda$ on K. When K is a simple polytope, we establish scaling limits as $\lambda$ $\rightarrow$ $\infty$…

Probability · Mathematics 2016-02-22 Pierre Calka , J. E. Yukich

This paper presents a new approach to selecting knots at the same time as estimating the B-spline regression model. Such simultaneous selection of knots and model is not trivial, but our strategy can make it possible by employing a…

Optimization and Control · Mathematics 2023-04-06 Shotaro Yagishita , Jun-ya Gotoh

We consider the asymptotic distribution of a cell in a 2 x ... x 2 contingency table as the fixed marginal totals tend to infinity. The asymptotic order of the cell variance is derived and a useful diagnostic is given for determining…

Statistics Theory · Mathematics 2018-04-17 Quan Zhou

We establish the asymptotic theory in quantile autoregression when the model parameter is specified with respect to moderate deviations from the unit boundary of the form (1 + c / k) with a convergence sequence that diverges at a rate…

Econometrics · Economics 2023-08-22 Christis Katsouris

In this note we consider the finite-dimensional parameter estimation problem associated to inverse problems. In such scenarios, one seeks to maximize the marginal likelihood associated to a Bayesian model. This latter model is connected to…

Numerical Analysis · Mathematics 2025-04-10 Ajay Jasra , Abylay Zhumekenov

Optimization with nonnegative orthogonality constraints has wide applications in machine learning and data sciences. It is NP-hard due to some combinatorial properties of the constraints. We first propose an equivalent optimization…

Optimization and Control · Mathematics 2021-01-01 Bo Jiang , Xiang Meng , Zaiwen Wen , Xiaojun Chen

We construct uniform and point-wise asymptotic confidence sets for the single edge in an otherwise smooth image function which are based on rotated differences of two one-sided kernel estimators. Using methods from M-estimation, we show…

Statistics Theory · Mathematics 2019-03-26 Viktor Bengs , Matthias Eulert , Hajo Holzmann

Classical mathematical statistics deals with models that are parametrized by a Euclidean, i.e. finite dimensional, parameter. Quite often such models have been and still are chosen in practical situations for their mathematical simplicity…

Statistics Theory · Mathematics 2023-12-25 Chris A. J. Klaassen

Constrained machine learning enables fairness-aware training, physics-informed neural networks, and integration of symbolic domain knowledge into statistical models. Despite its practical importance, no general method exists for the…

Machine Learning · Computer Science 2026-05-20 Adam Bosák , Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček

We consider the problem of simultaneous variable selection and estimation in additive, partially linear models for longitudinal/clustered data. We propose an estimation procedure via polynomial splines to estimate the nonparametric…

Statistics Theory · Mathematics 2013-02-04 Shujie Ma , Qiongxia Song , Li Wang

We consider the problem of finding, for a given quadratic measure of non-uniformity of a set of $N$ points (such as $L_2$ star-discrepancy or diaphony), the asymptotic distribution of this discrepancy for truly random points in the limit…

Computational Physics · Physics 2009-10-30 Andre van Hameren , Ronald Kleiss , Jiri Hoogland

This paper presents a learning-based method to solve the traditional parameterization and knot placement problems in B-spline approximation. Different from conventional heuristic methods or recent AI-based methods, the proposed method does…

Computational Engineering, Finance, and Science · Computer Science 2024-06-17 Qiang Zou , Lizhen Zhu

Popular regularizers with non-differentiable penalties, such as Lasso, Elastic Net, Generalized Lasso, or SLOPE, reduce the dimension of the parameter space by inducing sparsity or clustering in the estimators' coordinates. In this paper,…

Statistics Theory · Mathematics 2025-01-03 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan , Michał Kos