English
Related papers

Related papers: Sequential Model Selection Method for Nonparametri…

200 papers

We consider non parametric estimation problem for stochastic tomography regression model, i.e. we consider the estimation problem of function of multivariate variables (image) observed through its Radon transformation calculated with the…

Statistics Theory · Mathematics 2018-11-22 Dominique Fourdrinier , Sergey Pergamenshchikov

We constuct a sequential adaptive procedure for estimating the autoregressive function at a given point in nonparametric autoregression models with Gaussian noise. We make use of the sequential kernel estimators. The optimal adaptive…

Statistics Theory · Mathematics 2010-11-12 Ouerdia Arkoun

An adaptive nonparametric estimation procedure is constructed for the estimation problem of heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (an oracle…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

An adaptive nonparametric estimation procedure is constructed for heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (oracle inequality) is obtained

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov

In this paper we investigate the problem of designing experiments for series estimators in nonparametric regression models with correlated observations. We use projection based estimators to derive an explicit solution of the best linear…

Statistics Theory · Mathematics 2018-12-14 Holger Dette , Maria Konstantinou , Kirsten Schorning

We develop a new model selection method for the adaptive robust efficient nonparametric signal estimation observed with impulse noise which is defined by the general non Gaussian L\'evy processes. On the basis of the developed method, we…

Statistics Theory · Mathematics 2018-11-27 Slim Beltaief , Oleg Chernoyarov , Serguei Pergamenchtchikov

This paper considers the problem of estimating a periodic function in a continuous time regression model with a general square integrable semimartingale noise. A model selection adaptive procedure is proposed. Sharp non-asymptotic oracle…

Statistics Theory · Mathematics 2009-09-18 Victor Konev , Serguei Pergamenchtchikov

In the regression model $Y = b(X) +\sigma(X)\varepsilon$, where $X$ has a density $f$, this paper deals with an oracle inequality for an estimator of $bf$, involving a kernel in the sense of Lerasle et al. (2016), selected via the PCO…

Statistics Theory · Mathematics 2021-06-07 Hélène Halconruy , Nicolas Marie

No matter the nature of the response and/or explanatory variables in a regression model, some basic issues such as the existence of an effect of the predictor on the response, or the assessment of a common shape across groups of…

Applications · Statistics 2020-09-01 María Alonso-Pena , Jose Ameijeiras-Alonso , Rosa M. Crujeiras

The complexity of semiparametric models poses new challenges to statistical inference and model selection that frequently arise from real applications. In this work, we propose new estimation and variable selection procedures for the…

Statistics Theory · Mathematics 2011-03-09 Bo Kai , Runze Li , Hui Zou

We present algorithms for nonparametric regression in settings where the data are obtained sequentially. While traditional estimators select bandwidths that depend upon the sample size, for sequential data the effective sample size is…

Methodology · Statistics 2012-07-03 Haijie Gu , John Lafferty

Kernel ridge regression (KRR) is a widely used nonparametric method due to its strong theoretical guarantees and computational convenience. However, standard KRR does not distinguish between linear and nonlinear components in the signal,…

Statistics Theory · Mathematics 2026-05-13 Xin Bing , Chao Wang

In this paper, we propose a variable selection method for general nonparametric kernel-based estimation. The proposed method consists of two-stage estimation: (1) construct a consistent estimator of the target function, (2) approximate the…

Machine Learning · Statistics 2018-12-05 Kota Matsui , Wataru Kumagai , Kenta Kanamori , Mitsuaki Nishikimi , Takafumi Kanamori

A key challenge in probabilistic regression is ensuring that predictive distributions accurately reflect true empirical uncertainty. Minimizing overall prediction error often encourages models to prioritize informativeness over calibration,…

Machine Learning · Statistics 2026-02-17 Ádám Jung , Domokos M. Kelen , András A. Benczúr

We construct efficient robust truncated sequential estimators for the pointwise estimation problem in nonparametric autoregression models with smooth coefficients. For Gaussian models we propose an adaptive procedure based on the…

Statistics Theory · Mathematics 2013-04-18 Ouerdia Arkoun , Serguei Pergamenchtchikov

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

In this paper, we consider a partial deconvolution kernel estimator for nonparametric regression when some covariates are measured with error while others are observed without error. We focus on a general and realistic setting in which the…

Statistics Theory · Mathematics 2026-01-29 Baba Thiam
‹ Prev 1 2 3 10 Next ›