English
Related papers

Related papers: M-estimation of linear models with dependent error…

200 papers

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

Methodology · Statistics 2016-10-23 P. Vellaisamy

We consider unregularized robust M-estimators for linear models under Gaussian design and heavy-tailed noise, in the proportional asymptotics regime where the sample size n and the number of features p are both increasing such that $p/n \to…

Statistics Theory · Mathematics 2025-01-29 Pierre C. Bellec , Takuya Koriyama

In this paper, the estimation of parameters in the harmonic regression with cyclically dependent errors is addressed. Asymptotic properties of the least-squares estimates are analyzed by simulation experiments. By numerical simulation, we…

The problem of detecting change points in the parameters of a linear regression model with errors and covariates exhibiting heteroscedasticity is considered. Asymptotic results for weighted functionals of the cumulative sum (CUSUM)…

Econometrics · Economics 2025-10-28 Lajos Horvath , Gregory Rice , Yuqian Zhao

In this paper, we develop new multiscale methods to test qualitative hypotheses about the regression function m in a nonparametric regression model with fixed design points and time series errors. In time series applications, m represents a…

Statistics Theory · Mathematics 2019-03-05 Marina Khismatullina , Michael Vogt

M-estimation, aka empirical risk minimization, is at the heart of statistics and machine learning: Classification, regression, location estimation, etc. Asymptotic theory is well understood when the loss satisfies some smoothness…

Statistics Theory · Mathematics 2025-12-16 Victor-Emmanuel Brunel

We consider a complex-valued linear mixture model, under discrete weakly stationary processes. We recover latent components of interest, which have undergone a linear mixing. We study asymptotic properties of a classical unmixing estimator,…

Statistics Theory · Mathematics 2020-03-12 Niko Lietzén , Lauri Viitasaari , Pauliina Ilmonen

This paper proposes a class of parametric multiple-index time series models that involve linear combinations of time trends, stationary variables and unit root processes as regressors. The inclusion of the three different types of time…

Econometrics · Economics 2021-11-04 Chaohua Dong , Jiti Gao , Bin Peng , Yundong Tu

This work concerns the estimation of multidimensional nonlinear regression models using multilayer perceptrons (MLPs). The main problem with such models is that we need to know the covariance matrix of the noise to get an optimal estimator.…

Statistics Theory · Mathematics 2008-02-22 Joseph Rynkiewicz

We consider a finite mixture model with varying mixing probabilities. Linear regression models are assumed for observed variables with coefficients depending on the mixture component the observed subject belongs to. A modification of the…

Probability · Mathematics 2016-01-07 Daryna Liubashenko , Rostyslav Maiboroda

We consider a linear mixed-effects model with a clustered structure, where the parameters are estimated using maximum likelihood (ML) based on possibly unbalanced data. Inference with this model is typically done based on asymptotic theory,…

Statistics Theory · Mathematics 2021-03-30 Chih-Hao Chang , Hsin-Cheng Huang , Ching-Kang Ing

In this paper, we prove maximal inequalities and study the functional central limit theorem for the partial sums of linear processes generated by dependent innovations. Due to the general weights, these processes can exhibit long-range…

Statistics Theory · Mathematics 2011-03-21 Jérôme Dedecker , Florence Merlevède , Magda Peligrad

This paper is concerned with a semiparametric partially linear regression model with unknown regression coefficients, an unknown nonparametric function for the non-linear component, and unobservable Gaussian distributed random errors. We…

Statistics Theory · Mathematics 2016-08-16 Irène Gannaz

We study asymptotic behavior of one-step $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent $M$-estimators. These…

Statistics Theory · Mathematics 2016-04-12 Yu. Yu. Linke

We focus on semiparametric regression that has played a central role in statistics, and exploit the powerful learning ability of deep neural networks (DNNs) while enabling statistical inference on parameters of interest that offers…

Statistics Theory · Mathematics 2025-04-29 Shunxing Yan , Ziyuan Chen , Fang Yao

We study the large sample properties of sparse M-estimators in the presence of pseudo-observations. Our framework covers a broad class of semi-parametric copula models, for which the marginal distributions are unknown and replaced by their…

Statistics Theory · Mathematics 2023-06-01 Jean-David Fermanian , Benjamin Poignard

Linear regression is a frequently used tool in statistics, however, its validity and interpretability relies on strong model assumptions. While robust estimates of the coefficients' covariance extend the validity of hypothesis tests and…

Methodology · Statistics 2015-04-23 Werner Brannath , Martin Scharpenberg

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

Methodology · Statistics 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

We consider the fundamental problem of matching a template to a signal. We do so by M-estimation, which encompasses procedures that are robust to gross errors (i.e., outliers). Using standard results from empirical process theory, we derive…

Statistics Theory · Mathematics 2020-09-10 Ery Arias-Castro , Lin Zheng

This study explores the estimation of parameters in a matrix-valued linear regression model, where the $T$ responses $(Y_t)_{t=1}^T \in \mathbb{R}^{n \times p}$ and predictors $(X_t)_{t=1}^T \in \mathbb{R}^{m \times q}$ satisfy the…

Statistics Theory · Mathematics 2025-12-08 Nayel Bettache