English
Related papers

Related papers: Asymptotics for penalized additive B-spline regres…

200 papers

Additive models are popular in high--dimensional regression problems because of flexibility in model building and optimality in additive function estimation. Moreover, they do not suffer from the so-called {\it curse of dimensionality}…

Methodology · Statistics 2008-06-04 Juhyun Park , Burkhardt Seifert

A nonparametric and locally adaptive Bayesian estimator is proposed for estimating a binary regression. Flexibility is obtained by modeling the binary regression as a mixture of probit regressions with the argument of each probit regression…

Methodology · Statistics 2007-09-25 Sally Wood , Robert Kohn , Remy Cottet , Wenxin Jiang , Martin Tanner

Regression splines are largely used to investigate and predict data behavior, attracting the interest of mathematicians for their beautiful numerical properties, and of statisticians for their versatility with respect to the applications.…

Methodology · Statistics 2025-01-09 Rosanna Campagna , Serena Crisci , Gabriele Santin , Gerardo Toraldo , Marco Viola

We study the asymptotic behavior of the least squares estimators of the unknown parameters of bifurcating autoregressive processes. Under very weak assumptions on the driven noise of the process, namely conditional pair-wise independence…

Probability · Mathematics 2009-06-29 Bernard Bercu , Benoite de Saporta , Anne Gegout-Petit

Regularized system identification is the major advance in system identification in the last decade. Although many promising results have been achieved, it is far from complete and there are still many key problems to be solved. One of them…

Systems and Control · Electrical Eng. & Systems 2023-04-05 Yue Ju , Biqiang Mu , Lennart Ljung , Tianshi Chen

This paper discusses a nonparametric regression model that naturally generalizes neural network models. The model is based on a finite number of one-dimensional transformations and can be estimated with a one-dimensional rate of…

Statistics Theory · Mathematics 2008-12-18 Joel L. Horowitz , Enno Mammen

Although approximate Bayesian computation (ABC) has become a popular technique for performing parameter estimation when the likelihood functions are analytically intractable there has not as yet been a complete investigation of the…

Statistics Theory · Mathematics 2011-05-19 Thomas A. Dean , Sumeetpal S. Singh

A new statistical procedure, based on a modified spline basis, is proposed to identify the linear components in the panel data model with fixed effects. Under some mild assumptions, the proposed procedure is shown to consistently estimate…

Econometrics · Economics 2019-11-21 Ruiqi Liu , Ben Boukai , Zuofeng Shang

This paper is about optimal estimation of the additive components of a nonparametric, additive isotone regression model. It is shown that asymptotically up to first order, each additive component can be estimated as well as it could be by a…

Statistics Theory · Mathematics 2007-09-12 Enno Mammen , Kyusang Yu

Many standard estimators, when applied to adaptively collected data, fail to be asymptotically normal, thereby complicating the construction of confidence intervals. We address this challenge in a semi-parametric context: estimating the…

Statistics Theory · Mathematics 2025-03-04 Licong Lin , Koulik Khamaru , Martin J. Wainwright

Rerandomization is an effective treatment allocation procedure to control for baseline covariate imbalance. For estimating the average treatment effect, rerandomization has been previously shown to improve the precision of the unadjusted…

Methodology · Statistics 2026-05-18 Bingkai Wang , Fan Li

Discrete but ordered covariates are quite common in applied statistics, and some regularized fitting procedures have been proposed for proper handling of ordinal predictors in statistical modeling. In this study, we show how quadratic…

Methodology · Statistics 2022-04-25 Jan Gertheiss , Fabian Scheipl , Tina Lauer , Harald Ehrhardt

In this paper we develop and study adaptive empirical Bayesian smoothing splines. These are smoothing splines with both smoothing parameter and penalty order determined via the empirical Bayes method from the marginal likelihood of the…

Statistics Theory · Mathematics 2015-11-18 Paulo Serra , Tatyana Krivobokova

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

Machine Learning · Statistics 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler

Motivated by value function estimation in reinforcement learning, we study statistical linear inverse problems, i.e., problems where the coefficients of a linear system to be solved are observed in noise. We consider penalized estimators,…

Machine Learning · Computer Science 2012-07-03 Bernardo Avila Pires , Csaba Szepesvari

Linear thresholding models postulate that the conditional distribution of a response variable in terms of covariates differs on the two sides of a (typically unknown) hyperplane in the covariate space. A key goal in such models is to learn…

Statistics Theory · Mathematics 2021-10-01 Debarghya Mukherjee , Moulinath Banerjee , Debasri Mukherjee , Ya'acov Ritov

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

Machine Learning · Statistics 2020-04-20 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

This article investigates the asymptotic distribution of penalized estimators with non-differentiable penalties designed to recover low-dimensional pattern structures. Patterns play a central role in estimation, as they reveal the…

Statistics Theory · Mathematics 2025-11-18 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan

This paper develops asymptotic theory for estimation of parameters in regression models for binomial response time series where serial dependence is present through a latent process. Use of generalized linear model (GLM) estimating…

Statistics Theory · Mathematics 2016-06-06 W. T. M. Dunsmuir , J. Y. He
‹ Prev 1 3 4 5 6 7 10 Next ›