English
Related papers

Related papers: Inference for penalized spline regression: Improvi…

200 papers

In this paper, we propose a new semiparametric regression estimator by using a hybrid technique of a parametric approach and a nonparametric penalized spline method. The overall shape of the true regression function is captured by the…

Statistics Theory · Mathematics 2012-02-17 Takuma Yoshida , Kanta Naito

We proposed a new penalized method in this paper to solve sparse Poisson Regression problems. Being different from $\ell_1$ penalized log-likelihood estimation, our new method can be viewed as penalized weighted score function method. We…

Statistics Theory · Mathematics 2017-03-14 Jinzhu Jia , Fang Xie , Lihu Xu

This article combines various methods of analysis to draw a comprehensive picture of penalty approximations to the value, hedge ratio, and optimal exercise strategy of American options. While convergence of the penalised solution for…

Computational Finance · Quantitative Finance 2013-05-21 Sam Howison , Christoph Reisinger , Jan Hendrik Witte

This paper investigates the effects of smoothed bootstrap iterations on coverage probabilities of smoothed bootstrap and bootstrap-t confidence intervals for population quantiles, and establishes the optimal kernel bandwidths at various…

Statistics Theory · Mathematics 2007-06-13 Yvonne H. S. Ho , Stephen M. S. Lee

Covariance regression offers an effective way to model the large covariance matrix with the auxiliary similarity matrices. In this work, we propose a sparse covariance regression (SCR) approach to handle the potentially high-dimensional…

Methodology · Statistics 2024-10-17 Yuan Gao , Zhiyuan Zhang , Zhanrui Cai , Xuening Zhu , Tao Zou , Hansheng Wang

Conformal prediction (CP) is a distribution-free method to construct reliable prediction intervals that has gained significant attention in recent years. Despite its success and various proposed extensions, a significant practical feature…

Statistics Theory · Mathematics 2026-02-02 Louis Allain , Sébastien Da Veiga , Brian Staber

We consider the problem of sparse estimation in a factor analysis model. A traditional estimation procedure in use is the following two-step approach: the model is estimated by maximum likelihood method and then a rotation technique is…

Methodology · Statistics 2013-03-18 Kei Hirose , Michio Yamamoto

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

We introduce a new empirical Bayes approach for large-scale multiple linear regression. Our approach combines two key ideas: (i) the use of flexible "adaptive shrinkage" priors, which approximate the nonparametric family of scale mixture of…

Methodology · Statistics 2024-06-13 Youngseok Kim , Wei Wang , Peter Carbonetto , Matthew Stephens

We extend the work of Hahn and Carvalho (2015) and develop a doubly-regularized sparse regression estimator by synthesizing Bayesian regularization with penalized least squares within a decision-theoretic framework. In contrast to existing…

Methodology · Statistics 2025-02-04 Aihua Li , Surya T. Tokdar , Jason Xu

We investigate the signal reconstruction performance of sparse linear regression in the presence of noise when piecewise continuous nonconvex penalties are used. Among such penalties, we focus on the SCAD penalty. The contributions of this…

Machine Learning · Statistics 2020-01-08 Tomoyuki Obuchi , Ayaka Sakata

In this paper we introduce a new method for automatically selecting knots in spline regression. The approach consists in setting a large number of initial knots and fitting the spline regression through a penalized likelihood procedure…

Applications · Statistics 2025-05-20 Vivien Goepp , Olivier Bouaziz , Grégory Nuel

We propose a new penalized method for variable selection and estimation that explicitly incorporates the correlation patterns among predictors. This method is based on a combination of the minimax concave penalty and Laplacian quadratic…

Statistics Theory · Mathematics 2011-12-16 Jian Huang , Shuangge Ma , Hongzhe Li , Cun-Hui Zhang

We propose a Multi-step Screening Procedure (MSP) for the recovery of sparse linear models in high-dimensional data. This method is based on a repeated small penalty strategy that quickly converges to an estimate within a few iterations.…

Methodology · Statistics 2019-12-13 Yuehan Yang , Ji Zhu , Edward I. George

In the past decades, the growing amount of network data has lead to many novel statistical models. In this paper we consider so called geometric networks. Typical examples are road networks or other infrastructure networks. But also the…

Methodology · Statistics 2020-02-25 Marc Schneble , Göran Kauermann

Bayesian inference is often implemented using approximations, which can yield interval estimates that are too narrow, not fully capturing the uncertainty in the posterior distribution. We address the question of how to adjust these…

Methodology · Statistics 2026-03-23 Tiffany Cai , Philip Greengard , Ben Goodrich , Andrew Gelman

Calibration weighting has been widely used to correct selection biases in non-probability sampling, missing data, and causal inference. The main idea is to calibrate the biased sample to the benchmark by adjusting the subject weights.…

Methodology · Statistics 2023-05-30 Chenyin Gao , Shu Yang , Jae Kwang Kim

Here we propose a novel searching scheme for a tuning parameter in high-dimensional penalized regression methods to address variable selection and modeling when sample sizes are limited compared to the data dimensions. Our method is…

Quantitative Methods · Quantitative Biology 2020-02-11 Tao Jiang , Stephanie J. London , Mi Kyeong Lee , Josyf C. Mychaleckyj , Alison A. Motsinger-Reif

Consider the {$\ell_{\alpha}$} regularized linear regression, also termed Bridge regression. For $\alpha\in (0,1)$, Bridge regression enjoys several statistical properties of interest such as sparsity and near-unbiasedness of the estimates…

Methodology · Statistics 2023-10-10 Jorge Loría , Anindya Bhadra

This work studies the multi-task functional linear regression models where both the covariates and the unknown regression coefficients (called slope functions) are curves. For slope function estimation, we employ penalized splines to…

Statistics Theory · Mathematics 2023-08-02 Shiyuan He , Hanxuan Ye , Kejun He