English
Related papers

Related papers: The Robustness of Estimator Composition

200 papers

The study of mixture models constitutes a large domain of research in statistics. In the first part of this work, we present phi-divergences and the existing methods which produce robust estimators. We are more particularly interested in…

Methodology · Statistics 2016-11-28 Diaa Al Mohamad

Advances in computing power enable more widespread use of the mode, which is a natural measure of central tendency since, as the most probable value, it is not influenced by the tails in the distribution. The properties of the half-sample…

Statistics Theory · Mathematics 2007-06-13 David R. Bickel , Rudolf Fruehwirth

The paper proposes some robust estimators of the finite population mean. Such estimators are particularly suitable in the presence of some outlying observations. Included as special cases of our general result are robust versions of the…

Statistics Theory · Mathematics 2008-12-18 Malay Ghosh

Additive regression models have a long history in multivariate nonparametric regression. They provide a model in which each regression function depends only on a single explanatory variable allowing to obtain estimators at the optimal…

Methodology · Statistics 2015-09-16 Graciela Boente , Alejandra Martinez

There has been increasing interest in recent years in the development of approaches to estimate causal effects when the number of potential confounders is prohibitively large. This growth in interest has led to a number of potential…

Methodology · Statistics 2020-02-05 Joseph Antonelli , Matthew Cefalu

ML-estimation based on mixtures of Normal distributions is a widely used tool for cluster analysis. However, a single outlier can make the parameter estimation of at least one of the mixture components break down. Among others, the…

Statistics Theory · Mathematics 2007-06-13 Christian Hennig

Robust estimators of location and dispersion are often used in the elliptical model to obtain an uncontaminated and highly representative subsample by trimming the data outside an ellipsoid based in the associated Mahalanobis distance. Here…

Statistics Theory · Mathematics 2016-08-14 Juan A. Cuesta-Albertos , Carlos Matrán , Agustín Mayo-Iscar

As the issue of robustness in AI systems becomes vital, statistical learning techniques that are reliable even in presence of partly contaminated data have to be developed. Preference data, in the form of (complete) rankings in the simplest…

Machine Learning · Computer Science 2023-03-24 Morgane Goibert , Clément Calauzènes , Ekhine Irurozki , Stéphan Clémençon

We introduce a metric for evaluating the robustness of a classifier, with particular attention to adversarial perturbations, in terms of expected functionality with respect to possible adversarial perturbations. A classifier is assumed to…

Machine Learning · Computer Science 2023-09-19 Ryan McCoppin , Colin Dawson , Sean M. Kennedy , Leslie M. Blaha

Robustness analyzes the impact of small perturbations in the semantics of a model. This allows to model hardware imprecision and therefore it has been applied to determine implementability of timed automata. In a recent paper, we extend…

Software Engineering · Computer Science 2012-07-19 Louis-Marie Traonouez

Users of program analyses expect that results change predictably in response to changes in their programs, but many analyses fail to provide such robustness. This paper introduces a theoretical framework that provides a unified language to…

Programming Languages · Computer Science 2026-04-14 Zachary Kincaid , Shaowei Zhu

This paper concerns the robust regression model when the number of predictors and the number of observations grow in a similar rate. Theory for M-estimators in this regime has been recently developed by several authors [El Karoui et al.,…

Statistics Theory · Mathematics 2016-04-06 Daniel Nevo , Ya'acov Ritov

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

Weighting estimators based on propensity scores are widely used for causal estimation in a variety of contexts, such as observational studies, marginal structural models and interference. They enjoy appealing theoretical properties such as…

Methodology · Statistics 2021-10-06 Linbo Wang , Yuexia Zhang , Thomas S. Richardson , Xiao-Hua Zhou

Robust methods, though ubiquitous in practice, are yet to be fully understood in the context of regularized estimation and high dimensions. Even simple questions become challenging very quickly. For example, classical statistical theory…

Statistics Theory · Mathematics 2023-11-10 Jing Zhou , Gerda Claeskens , Jelena Bradic

We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the…

Methodology · Statistics 2021-08-10 Karl Oskar Ekvall

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

Methodology · Statistics 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

Composite indicators are widely used to score or classify units evaluated on multiple criteria. Their construction typically involves aggregating criteria evaluations, a common practice in Multiple Criteria Decision Aiding (MCDA). Beyond…

Machine Learning · Computer Science 2026-03-04 Salvatore Corrente , Salvatore Greco , Roman Słowiński , Silvano Zappalà

We consider a two-component mixture model with one known component. We develop methods for estimating the mixing proportion and the unknown distribution nonparametrically, given i.i.d.~data from the mixture model, using ideas from shape…

Methodology · Statistics 2015-11-10 Rohit Kumar Patra , Bodhisattva Sen

We present an effective framework for improving the breakdown point of robust regression algorithms. Robust regression has attracted widespread attention due to the ubiquity of outliers, which significantly affect the estimation results.…

Machine Learning · Computer Science 2023-05-23 Zheyi Fan , Szu Hui Ng , Qingpei Hu