English
Related papers

Related papers: Limiting the Shrinkage for the Exceptional by Obje…

200 papers

The marginal likelihood or evidence in Bayesian statistics contains an intrinsic penalty for larger model sizes and is a fundamental quantity in Bayesian model comparison. Over the past two decades, there has been steadily increasing…

Statistics Theory · Mathematics 2020-08-12 Anirban Bhattacharya , Debdeep Pati , Sean Plummer

The cross-entropy method (CE) developed by R. Rubinstein is an elegant practical principle for simulating rare events. The method approximates the probability of the rare event by means of a family of probabilistic models. The method has…

Optimization and Control · Mathematics 2007-06-13 Frederic Dambreville

We study a class of binary treatment choice problems with partial identification through the lens of robust (multiple prior) Bayesian analysis. We use a convenient set of prior distributions to derive ex-ante and ex-post robust Bayes…

In causal inference confounding may be controlled either through regression adjustment in an outcome model, or through propensity score adjustment or inverse probability of treatment weighting, or both. The latter approaches, which are…

Methodology · Statistics 2017-01-17 Olli Saarela , Léo R. Belzile , David A. Stephens

Bounding causal effects analytically, rather than numerically, is appealing for its interpretability and conceptual clarity. Existing sharp methods rely on optimization-based approaches such as the Balke-Pearl framework, whose computational…

Methodology · Statistics 2026-04-15 Arefe Boushehrian , Mohammad Reza Badri , Sina Akbari , Negar Kiyavash

Parameter estimates for associated genetic variants, report ed in the initial discovery samples, are often grossly inflated compared to the values observed in the follow-up replication samples. This type of bias is a consequence of the…

Applications · Statistics 2011-04-15 Lizhen Xu , Radu V. Craiu , Lei Sun

Including prior information about model parameters is a fundamental step of any Bayesian statistical analysis. It is viewed positively by some as it allows, among others, to quantitatively incorporate expert opinion about model parameters.…

Methodology · Statistics 2023-08-22 Philippe Gagnon

We consider a multi-armed bandit problem motivated by situations where only the extreme values, as opposed to expected values in the classical bandit setting, are of interest. We propose distribution free algorithms using robust statistics…

Machine Learning · Statistics 2021-09-10 Sujay Bhatt , Ping Li , Gennady Samorodnitsky

We consider the problem of robust polynomial regression, where one receives samples $(x_i, y_i)$ that are usually within $\sigma$ of a polynomial $y = p(x)$, but have a $\rho$ chance of being arbitrary adversarial outliers. Previously, it…

Data Structures and Algorithms · Computer Science 2017-08-11 Daniel Kane , Sushrut Karmalkar , Eric Price

We study the problem of estimating the mean of a distribution in high dimensions when either the samples are adversarially corrupted or the distribution is heavy-tailed. Recent developments in robust statistics have established efficient…

Data Structures and Algorithms · Computer Science 2021-01-20 Samuel B. Hopkins , Jerry Li , Fred Zhang

Robust Bayesian models are appealing alternatives to standard models, providing protection from data that contains outliers or other departures from the model assumptions. Historically, robust models were mostly developed on a case-by-case…

Machine Learning · Statistics 2016-09-08 Chong Wang , David M. Blei

As an effective nonparametric method, empirical likelihood (EL) is appealing in combining estimating equations flexibly and adaptively for incorporating data information. To select important variables and estimating equations in the sparse…

Methodology · Statistics 2021-07-02 Jiaqi Li , Liya Fu

An efficient algorithm is proposed for Bayesian model calibration, which is commonly used to estimate the model parameters of non-linear, computationally expensive models using measurement data. The approach is based on Bayesian statistics:…

Numerical Analysis · Mathematics 2019-11-06 L. M. M. van den Bos , B. Sanderse , W. A. A. M. Bierbooms , G. J. W. van Bussel

Inference over tails is performed by applying only the results of extreme value theory. Whilst such theory is well defined and flexible enough in the univariate case, multivariate inferential methods often require the imposition of…

Methodology · Statistics 2017-08-11 Manuele Leonelli , Dani Gamerman

Discrete supervised learning problems such as classification are often tackled by introducing a continuous surrogate problem akin to regression. Bounding the original error, between estimate and solution, by the surrogate error endows…

Machine Learning · Statistics 2021-07-16 Vivien Cabannes , Alessandro Rudi , Francis Bach

Thompson Sampling is one of the oldest heuristics for multi-armed bandit problems. It is a randomized algorithm based on Bayesian ideas, and has recently generated significant interest after several studies demonstrated it to have better…

Machine Learning · Computer Science 2012-09-18 Shipra Agrawal , Navin Goyal

In clinical trials, studies often present longitudinal data or clustered data. These studies are commonly analyzed using linear mixed models (LMMs), usually considering Gaussian assumptions for random effect and error terms. Recently,…

Methodology · Statistics 2021-09-28 Fernanda L. Schumacher , Larissa A. Matos , Celso R. B. Cabral

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

This article introduces a general class of heavy-tailed autoregressions for modeling integer-valued time series with outliers. The proposed specification is based on a heavy-tailed mixture of negative binomial distributions that features an…

Statistics Theory · Mathematics 2019-09-09 Paolo Gorgi

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson