English
Related papers

Related papers: Robust estimation for small domains in business su…

200 papers

Mendelian randomization (MR) has been a popular method in genetic epidemiology to estimate the effect of an exposure on an outcome using genetic variants as instrumental variables (IV), with two-sample summary-data MR being the most…

Methodology · Statistics 2021-06-08 Sheng Wang , Hyunseung Kang

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

Most high-dimensional estimation and prediction methods propose to minimize a cost function (empirical risk) that is written as a sum of losses associated to each data point. In this paper we focus on the case of non-convex losses, which is…

Machine Learning · Statistics 2017-01-17 Song Mei , Yu Bai , Andrea Montanari

In certain situations that shall be undoubtedly more and more common in the Big Data era, the datasets available are so massive that computing statistics over the full sample is hardly feasible, if not unfeasible. A natural approach in this…

Machine Learning · Statistics 2015-01-12 Stéphan Clémençon , Patrice Bertail , Emilie Chautru , Guillaume Papa

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

Machine Learning · Statistics 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

M-quantile random-effects regression represents an interesting approach for modelling multilevel data when the interest of researchers is focused on the conditional quantiles. When data are based on complex survey designs, sampling weights…

Statistics Theory · Mathematics 2018-02-23 Francesco Schirripa Spagnolo , Nicola Salvati , Antonella D'Agostino , Ides Nicaise

Ordinary least-squares (OLS) estimators for a linear model are very sensitive to unusual values in the design space or outliers among y values. Even one single atypical value may have a large effect on the parameter estimates. This article…

Methodology · Statistics 2014-04-28 Chun Yu , Weixin Yao , Xue Bai

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

In this paper we study simulation-based methods for estimating gradients in stochastic networks. We derive a new method of calculating weak derivative estimator using importance sampling transform, and our method has less computational cost…

Methodology · Statistics 2023-03-28 Cheng Jie , Michael C Fu

Survey sampling is concerned with the estimation of finite population parameters. In practice, survey data suffer from item nonresponse, which is commonly handled through imputation, i.e., replacing missing values with predicted values. As…

Methodology · Statistics 2026-03-06 Ziming An , Mehdi Dagdoug , David Haziza

We describe the shrinking neighborhood approach of Robust Statistics, which applies to general smoothly parametrized models, especially, exponential families. Equal generality is achieved by object oriented implementation of the optimally…

Methodology · Statistics 2010-08-04 Matthias Kohl , Peter Ruckdeschel , Helmut Rieder

Through the lense of multilevel model (MLM) specification and regularization, this is a connect-the-dots introductory summary of Small Area Estimation, e.g. small group prediction informed by a complex sampling design. While a comprehensive…

Methodology · Statistics 2018-05-23 Michael Tzen

The robust estimator presented in this paper processes each structure independently. The scales of the structures are estimated adaptively and no threshold is involved in spite of different objective functions. The user has to specify only…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Xiang Yang , Peter Meer

The Seemingly Unrelated Regressions (SUR) model is a wide used estimation procedure in econometrics, insurance and finance, where very often, the regression model contains more than one equation. Unknown parameters, regression coefficients…

Methodology · Statistics 2021-07-05 Giovanni Saraceno , Fatemah Alqallaf , Claudio Agostinelli

We introduce a theoretical and practical framework for efficient importance sampling of mini-batch samples for gradient estimation from single and multiple probability distributions. To handle noisy gradients, our framework dynamically…

Machine Learning · Computer Science 2025-01-29 Corentin Salaün , Xingchang Huang , Iliyan Georgiev , Niloy J. Mitra , Gurprit Singh

The smooth bootstrap for estimating copula functionals in small samples is investigated. It can be used both to gauge the distribution of the estimator in question and to augment the data. Issues arising from kernel density and distribution…

Computation · Statistics 2022-03-28 Maximilian Coblenz , Oliver Grothe , Klaus Herrmann , Marius Hofert

Multilevel regression and poststratification (MRP) is a popular method for addressing selection bias in subgroup estimation, with broad applications across fields from social sciences to public health. In this paper, we examine the…

Methodology · Statistics 2023-03-06 Yajuan Si

Instrumental variables are commonly used to estimate effects of a treatment afflicted by unmeasured confounding, and in practice instruments are often continuous (e.g., measures of distance, or treatment preference). However, available…

Methodology · Statistics 2018-07-05 Edward H. Kennedy , Scott A. Lorch , Dylan S. Small

The application of state-of-the-art spatial econometric models requires that the information about the spatial coordinates of statistical units is completely accurate, which is usually the case in the context of areal data. With…

Methodology · Statistics 2019-09-06 Giuseppe Arbia , Maria Michela Dickson , Giuseppe Espa , Diego Giuliani , Flavio Santi

Many cases exist in which a black-box function $f$ with high evaluation cost depends on two types of variables $\bm x$ and $\bm w$, where $\bm x$ is a controllable \emph{design} variable and $\bm w$ are uncontrollable \emph{environmental}…

Machine Learning · Statistics 2021-02-09 Yu Inatsu , Shogo Iwazaki , Ichiro Takeuchi