English
Related papers

Related papers: General P-Splines for Non-Uniform B-Splines

200 papers

We study a set of regularization methods for high-dimensional linear regression models. These penalized estimators have the square root of the residual sum of squared errors as loss function, and any weakly decomposable norm as penalty…

Statistics Theory · Mathematics 2016-06-28 Benjamin Stucky , Sara van de Geer

A new penalty-free neural network method, PFNN-2, is presented for solving partial differential equations, which is a subsequent improvement of our previously proposed PFNN method [1]. PFNN-2 inherits all advantages of PFNN in handling the…

Numerical Analysis · Mathematics 2022-05-03 Hailong Sheng , Chao Yang

We study generalized additive partial linear models, proposing the use of polynomial spline smoothing for estimation of nonparametric functions, and deriving quasi-likelihood based estimators for the linear parameters. We establish…

Statistics Theory · Mathematics 2011-12-13 Li Wang , Xiang Liu , Hua Liang , Raymond J. Carroll

In this paper we develop and study adaptive empirical Bayesian smoothing splines. These are smoothing splines with both smoothing parameter and penalty order determined via the empirical Bayes method from the marginal likelihood of the…

Statistics Theory · Mathematics 2015-11-18 Paulo Serra , Tatyana Krivobokova

Detecting slender, overlapping structures remains a challenge in computational microscopy. While recent coordinate-based approaches improve detection, they often produce less accurate splines than pixel-based methods. We introduce a…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Frans Zdyb , Albert Alonso , Julius B. Kirkegaard

Physics-informed machine learning offers a promising framework for solving complex partial differential equations (PDEs) by integrating observational data with governing physical laws. However, learning PDEs with varying parameters and…

Machine Learning · Computer Science 2026-03-17 Zhuoyuan Wang , Raffaele Romagnoli , Saviz Mowlavi , Yorie Nakahira

We consider the problem of approximating smoothing spline estimators in a nonparametric regression model. When applied to a sample of size $n$, the smoothing spline estimator can be expressed as a linear combination of $n$ basis functions,…

Computation · Statistics 2020-03-25 Cheng Meng , Xinlian Zhang , Jingyi Zhang , Wenxuan Zhong , Ping Ma

In this paper we develop flexible Krylov methods for efficiently computing regularized solutions to large-scale linear inverse problems with an $\ell_2$ fit-to-data term and an $\ell_p$ penalization term, for $p\geq 1$. First we approximate…

Numerical Analysis · Mathematics 2018-06-19 Julianne Chung , Silvia Gazzola

Many scientific fields and applications require compact representations of multivariate functions. For this problem, decoupling methods are powerful techniques for representing the multivariate functions as a combination of linear…

Systems and Control · Electrical Eng. & Systems 2025-04-07 Joppe De Jonghe , Mariya Ishteva

Quantile regression has received increased attention in the statistics community in recent years. This article adapts an auxiliary variable method, commonly used in Bayesian variable selection for mean regression models, to the fitting of…

Methodology · Statistics 2012-02-28 J. -L. Dortet-Bernadet , Y. Fan

We study a new simple quadrature rule based on integrating a $C^1$ quadratic spline quasi-interpolant on a bounded interval. We give nodes and weights for uniform and non-uniform partitions. We also give error estimates for smooth functions…

Numerical Analysis · Mathematics 2007-05-23 Paul Sablonniere

The identification of predictive biomarkers from a large scale of covariates for subgroup analysis has attracted fundamental attention in medical research. In this article, we propose a generalized penalized regression method with a novel…

Methodology · Statistics 2019-04-29 Chong Ma , Wenxuan Deng , Shuangge Ma , Ray Liu , Kevin Galinsky

The marriage of recurrent neural networks and neural ordinary differential networks (ODE-RNN) is effective in modeling irregularly-observed sequences. While ODE produces the smooth hidden states between observation intervals, the RNN will…

Machine Learning · Computer Science 2020-10-06 Jing Shi , Jing Bi , Yingru Liu , Chenliang Xu

In this article we develop a general theory of exact parametric penalty functions for constrained optimization problems. The main advantage of the method of parametric penalty functions is the fact that a parametric penalty function can be…

Optimization and Control · Mathematics 2018-07-17 M. V. Dolgopolik

In this article we develop function-based a posteriori error estimators for the solution of linear second order elliptic problems considering hierarchical spline spaces for the Galerkin discretization. We prove a global upper bound for the…

Numerical Analysis · Mathematics 2016-11-24 Annalisa Buffa , Eduardo M. Garau

Generalized Linear Bandits (GLBs) are powerful extensions to the Linear Bandit (LB) setting, broadening the benefits of reward parametrization beyond linearity. In this paper we study GLBs in non-stationary environments, characterized by a…

Machine Learning · Computer Science 2021-03-11 Louis Faury , Yoan Russac , Marc Abeille , Clément Calauzènes

In this paper we propose a model selection approach to fit a regression model using splines with a variable number of knots. We introduce a penalized criterion to estimate the number and the position of the knots where to anchor the splines…

Methodology · Statistics 2021-07-28 Alex Rodrigo dos S. Sousa , Magno T. F. Severino , Florencia G. Leonardi

We present a generalized formulation for reweighted least squares approximations. The goal of this article is twofold: firstly, to prove that the solution of such problem can be expressed as a convex combination of certain interpolants when…

Motivated by recent work involving the analysis of leveraging spatial correlations in sparsified mean estimation, we present a novel procedure for constructing covariance estimator. The proposed Random-knots (Random-knots-Spatial) and…

Methodology · Statistics 2025-11-25 Sijie Zheng , Fandong Meng , Jie Zhou

We propose a new sparsity-smoothness penalty for high-dimensional generalized additive models. The combination of sparsity and smoothness is crucial for mathematical theory as well as performance for finite-sample data. We present a…

Machine Learning · Statistics 2009-11-18 Lukas Meier , Sara van de Geer , Peter Bühlmann