English
Related papers

Related papers: A universal robustification procedure

200 papers

Important advances have recently been achieved in developing procedures yielding uniformly valid inference for a low dimensional causal parameter when high-dimensional nuisance models must be estimated. In this paper, we review the…

Statistics Theory · Mathematics 2025-09-08 Niloofar Moosavi , Jenny Häggström , Xavier de Luna

A perturbative description of Large Scale Structure is a cornerstone of our understanding of the observed distribution of matter in the universe. Renormalization is an essential and defining step to make this description physical and…

High Energy Physics - Theory · Physics 2016-06-08 Ali Akbar Abolhasani , Mehrdad Mirbabayi , Enrico Pajer

In this paper, we study a multidimensional risk model with a common renewal process and in the presence of a constant interest force. The claim sizes are independent and identically distributed random vectors, with the distribution of…

Probability · Mathematics 2025-10-24 Dimitrios G. Konstantinides , Jiajun Liu , Charalampos D. Passalidis

We study asymptotic behavior of one-step $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent $M$-estimators. These…

Statistics Theory · Mathematics 2016-04-12 Yu. Yu. Linke

We study asymptotic behavior of one-step weighted $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent weighted…

Statistics Theory · Mathematics 2015-07-07 Yu. Yu. Linke

Robust Bayesian models are appealing alternatives to standard models, providing protection from data that contains outliers or other departures from the model assumptions. Historically, robust models were mostly developed on a case-by-case…

Machine Learning · Statistics 2016-09-08 Chong Wang , David M. Blei

Although complete randomization ensures covariate balance on average, the chance for observing significant differences between treatment and control covariate distributions increases with many covariates. Rerandomization discards…

Statistics Theory · Mathematics 2017-08-15 Xinran Li , Peng Ding , Donald B. Rubin

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

Modern data analysis depends increasingly on estimating models via flexible high-dimensional or nonparametric machine learning methods, where the identification of structural parameters is often challenging and untestable. In linear…

Statistics Theory · Mathematics 2026-01-21 Andrii Babii , Jean-Pierre Florens

Naive approaches to amortized inference in probabilistic programs with unbounded loops can produce estimators with infinite variance. This is particularly true of importance sampling inference in programs that explicitly include rejection…

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

Machine Learning · Statistics 2020-04-20 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

We provide a theoretical framework for a wide class of generalized posteriors that can be viewed as the natural Bayesian posterior counterpart of the class of M-estimators in the frequentist world. We call the members of this class…

Statistics Theory · Mathematics 2025-10-03 Juraj Marusic , Marco Avella Medina , Cynthia Rush

Data assimilation is the process to fuse information from priors, observations of nature, and numerical models, in order to obtain best estimates of the parameters or state of a physical system of interest. Presence of large errors in some…

Numerical Analysis · Mathematics 2015-11-06 Vishwas Rao , Adrian Sandu , Michael Ng , Elias Nino-Ruiz

In statistical analysis, quantifying uncertainties through measures such as entropy, extropy, varentropy, and varextropy is of fundamental importance for understanding distribution functions. This paper investigates several properties of…

Statistics Theory · Mathematics 2025-01-28 Santosh Kumar Chaudhary , Nitin Gupta

Univariate and multivariate normal probability distributions are widely used when modeling decisions under uncertainty. Computing the performance of such models requires integrating these distributions over specific domains, which can vary…

Machine Learning · Statistics 2024-07-31 Abhranil Das , Wilson S Geisler

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev

Randomized experiments have become important tools in empirical research. In a completely randomized treatment-control experiment, the simple difference in means of the outcome is unbiased for the average treatment effect, and covariate…

Statistics Theory · Mathematics 2021-01-01 Lihua Lei , Peng Ding

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative.…

Statistics Theory · Mathematics 2011-01-06 Bert van Es

We propose a robust and scalable procedure for general optimization and inference problems on manifolds leveraging the classical idea of `median-of-means' estimation. This is motivated by ubiquitous examples and applications in modern data…

Methodology · Statistics 2020-06-16 Lizhen Lin , Drew Lazar , Bayan Sarpabayeva , David B. Dunson