English
Related papers

Related papers: Consistency of M estimates for separable nonlinear…

200 papers

We consider regression models with parametric (linear or nonlinear) regression function and allow responses to be ``missing at random.'' We assume that the errors have mean zero and are independent of the covariates. In order to estimate…

Statistics Theory · Mathematics 2009-08-24 Ursula U. Müller

Finding separable certificates of stability is important for tractability of analysis methods for large-scale networked systems. In this paper we consider the question of when a nonlinear system which is contracting, i.e. all solutions are…

Systems and Control · Computer Science 2017-04-11 Ian R. Manchester , Jean-Jacques E. Slotine

Partition-wise models offer a flexible approach for modeling complex and multidimensional data that are capable of producing interpretable results. They are based on partitioning the observed data into regions, each of which is modeled with…

Methodology · Statistics 2017-06-07 Rex C. Y. Cheung , Alexander Aue , Thomas C. M. Lee

We deal with the equivariant estimation of scatter and location for p-dimensional data, giving emphasis to scatter. It it important that the estimators possess both a high efficiency for normal data and a high resistance to outliers, that…

Statistics Theory · Mathematics 2015-08-17 Ricardo A. Maronna , Victor J. Yohai

This paper presents a tractable sufficient condition for the consistency of maximum likelihood estimators (MLEs) in partially observed diffusion models, stated in terms of stationary distribution of the associated fully observed diffusion,…

Statistics Theory · Mathematics 2024-12-10 Sergey Nadtochiy , Yuan Yin

Model uncertainty is a central challenge in statistical models for binary outcomes such as logistic regression, arising when it is unclear which predictors should be included in the model. Many methods have been proposed to address this…

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

We propose a novel estimator for the number of components (denoted by $M$) in a K-variate non-parametric finite mixture model, where the analyst has repeated observations of $K\geq2$ variables that are independent given a finitely supported…

Methodology · Statistics 2020-07-07 Caleb Kwon , Eric Mbakop

We consider unregularized robust M-estimators for linear models under Gaussian design and heavy-tailed noise, in the proportional asymptotics regime where the sample size n and the number of features p are both increasing such that $p/n \to…

Statistics Theory · Mathematics 2025-01-29 Pierre C. Bellec , Takuya Koriyama

Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on…

Econometrics · Economics 2022-11-16 Qizhao Chen , Vasilis Syrgkanis , Morgane Austern

Segmented regression models offer model flexibility and interpretability as compared to the global parametric and the nonparametric models, and yet are challenging in both estimation and inference. We consider a four-regime segmented model…

Methodology · Statistics 2024-10-08 Han Yan , Song Xi Chen

The paper considers the problem of robust estimating a periodic function in a continuous time regression model with dependent disturbances given by a general square integrable semimartingale with unknown distribution. An example of such a…

Statistics Theory · Mathematics 2010-10-20 Victor Konev , Serguei Pergamenchtchikov

We consider a general nonparametric regression model called the compound model. It includes, as special cases, sparse additive regression and nonparametric (or linear) regression with many covariates but possibly a small number of relevant…

Statistics Theory · Mathematics 2013-01-04 Arnak Dalalyan , Yuri Ingster , Alexandre Tsybakov

Generalized linear models are a popular tool in applied statistics, with their maximum likelihood estimators enjoying asymptotic Gaussianity and efficiency. As all models are wrong, it is desirable to understand these estimators' behaviours…

Methodology · Statistics 2024-12-10 Elliot H. Young , Rajen D. Shah

In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods…

Statistics Theory · Mathematics 2009-08-14 Xia Cui , Wensheng Guo , Lu Lin , Lixing Zhu

Maximum pseudolikelihood (MPL) estimators are useful alternatives to maximum likelihood (ML) estimators when likelihood functions are more difficult to manipulate than their marginal and conditional components. Furthermore, MPL estimators…

Methodology · Statistics 2017-08-30 Hien D. Nguyen

To explain the decision of any model, we extend the notion of probabilistic Sufficient Explanations (P-SE). For each instance, this approach selects the minimal subset of features that is sufficient to yield the same prediction with high…

Machine Learning · Statistics 2022-10-17 Salim I. Amoukou , Nicolas J. B Brunel

Consider the regression problem where the response $Y\in\mathbb{R}$ and the covariate $X\in\mathbb{R}^d$ for $d\geq 1$ are \textit{unmatched}. Under this scenario, we do not have access to pairs of observations from the distribution of $(X,…

Statistics Theory · Mathematics 2023-09-19 Mona Azadkia , Fadoua Balabdaoui

We present large sample results for partitioning-based least squares nonparametric regression, a popular method for approximating conditional expectation functions in statistics, econometrics, and machine learning. First, we obtain a…

Statistics Theory · Mathematics 2020-07-20 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng

The inflated beta regression model is widely used for modeling continuous proportions with values at the boundaries. Maximum likelihood estimation for these models is well-known for its sensitivity to outliers, which can severely distort…

Methodology · Statistics 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes de Paula Ferrari