English
Related papers

Related papers: Improved robust model selection methods for the Le…

200 papers

We consider non-parametric estimation problems in the presence of dependent data, notably non-parametric regression with random design and non-parametric density estimation. The proposed estimation procedure is based on a dimension…

Statistics Theory · Mathematics 2016-02-02 Nicolas Asin , Jan Johannes

This paper deals with the nonparametric estimation in heteroscedastic regression $ Y_i=f(X_i)+\xi_i, \: i=1,...,n $, with incomplete information, i.e. each real random variable $ \xi_i $ has a density $ g_{i} $ which is unknown to the…

Statistics Theory · Mathematics 2011-05-10 Michaël Chichignoud

The article considers vector parameter estimators in statistical models generated by Levy processes. An improved one step estimator is presented that can be used for improving any other estimator. Combined numerical methods for optimization…

Methodology · Statistics 2021-03-15 D. O. Ivanenko , R. V. Pogorielov

An additive model-assisted nonparametric method is investigated to estimate the finite population totals of massive survey data with the aid of auxiliary information. A class of estimators is proposed to improve the precision of the well…

Methodology · Statistics 2019-03-19 Li Wang , Suojin Wang

We look into the nonparametric regression estimation with additive and multiplicative noise and construct adaptive thresholding estimators based on Laguerre series. The proposed approach achieves asymptotically near-optimal convergence…

Statistics Theory · Mathematics 2020-12-23 Rida Benhaddou

Despite decades of research and recent progress in adaptive control and reinforcement learning, there remains a fundamental lack of understanding in designing controllers that provide robustness to inherent non-asymptotic uncertainties…

Machine Learning · Computer Science 2021-08-13 Benjamin Gravell , Tyler Summers

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild

In the first part of this work, we develop a novel scheme for solving nonparametric regression problems. That is the approximation of possibly low regular and noised functions from the knowledge of their approximate values given at some…

Statistics Theory · Mathematics 2021-10-27 Asma Ben Saber , Abderrazek Karoui

This paper proposes a nonlinear estimator for the robust reconstruction of process and sensor faults for a class of uncertain nonlinear systems. The proposed fault estimation method augments the system dynamics with an ultra-local (in time)…

Systems and Control · Electrical Eng. & Systems 2024-06-11 Farhad Ghanipoor , Carlos Murguia , Peyman Mohajerin Esfahani , Nathan van de Wouw

We consider the problem of automatic variable selection in a linear model with asymmetric or heavy-tailed errors when the number of explanatory variables diverges with the sample size. For this high-dimensional model, the penalized least…

Statistics Theory · Mathematics 2018-12-10 Gabriela Ciuperca

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

Statistics Theory · Mathematics 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

We propose a nonparametric method for detecting nonlinear causal relationship within a set of multidimensional discrete time series, by using sparse additive models (SpAMs). We show that, when the input to the SpAM is a $\beta$-mixing time…

Machine Learning · Statistics 2018-04-27 Yingxiang Yang , Adams Wei Yu , Zhaoran Wang , Tuo Zhao

Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables,…

Methodology · Statistics 2011-01-04 Xia Cui , Heng Peng , Songqiao Wen , Lixing Zhu

This paper proposes a recursive interval-valued estimation framework for identifying the parameters of linearly parameterized systems which may be slowly time-varying. It is assumed that the model error (which may consist in measurement…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Laurent Bako , Seydi Ndiaye , Eric Blanco

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

We constuct a sequential adaptive procedure for estimating the autoregressive function at a given point in nonparametric autoregression models with Gaussian noise. We make use of the sequential kernel estimators. The optimal adaptive…

Statistics Theory · Mathematics 2010-11-12 Ouerdia Arkoun

Inverse probability weighted estimators are the oldest and potentially most commonly used class of procedures for the estimation of causal effects. By adjusting for selection biases via a weighting mechanism, these procedures estimate an…

Methodology · Statistics 2021-07-06 Ashkan Ertefaie , Nima S. Hejazi , Mark J. van der Laan

Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have…

Methodology · Statistics 2023-04-07 Matias Salibian-Barrera

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz