English
Related papers

Related papers: Bayesian Robustness to Outliers in Linear Regressi…

200 papers

Complex simulator-based models are now routinely used to perform inference across the sciences and engineering, but existing inference methods are often unable to account for outliers and other extreme values in data which occur due to…

Machine Learning · Statistics 2026-02-18 Ayush Bharti , Charita Dellaporta , Yuga Hikida , François-Xavier Briol

Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice.…

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, useful broad structural judgements may be elicited from…

Methodology · Statistics 2024-04-30 Jack Jewson , Jim Q. Smith , Chris Holmes

Linear regression estimators are known to be sensitive to outliers, and one alternative to obtain a robust and efficient estimator of the regression parameter is to model the error with Student's $t$ distribution. In this article, we…

Methodology · Statistics 2026-03-19 Amanda Ng , Shangkai Zhu , Archer Gong Zhang , Nancy Reid

We present a new Bayesian approach to model-robust linear regression that leads to uncertainty estimates with the same robustness properties as the Huber--White sandwich estimator. The sandwich estimator is known to provide asymptotically…

Applications · Statistics 2011-01-10 Adam A. Szpiro , Kenneth M. Rice , Thomas Lumley

Models of discrete-valued outcomes are easily misspecified if the data exhibit zero-inflation, overdispersion or contamination. Without additional knowledge about the existence and nature of this misspecification, model inference and…

Methodology · Statistics 2020-10-27 Jeremias Knoblauch , Lara Vomfell

We develop a new robust geographically weighted regression method in the presence of outliers. We embed the standard geographically weighted regression in robust objective function based on $\gamma$-divergence. A novel feature of the…

Methodology · Statistics 2021-10-15 Shonosuke Sugasawa , Daisuke Murakami

We derive an exact and efficient Bayesian regression algorithm for piecewise constant functions of unknown segment number, boundary location, and levels. It works for any noise and segment level prior, e.g. Cauchy which can handle outliers.…

Statistics Theory · Mathematics 2007-06-13 Marcus Hutter

Bai (2010) and Bai et al. (2012) proposed robust mixture regression method based on the M regression estimation. However, the M-estimators are robust against the outliers in response variables, but they are not robust against the outliers…

Statistics Theory · Mathematics 2015-11-24 Fatma Zehra Doğru , Olcay Arslan

In the realm of supervised learning, Bayesian learning has shown robust predictive capabilities under input and parameter perturbations. Inspired by these findings, we demonstrate the robustness properties of Bayesian learning in the…

Machine Learning · Computer Science 2022-05-17 Nardos Ayele Ashenafi , Wankun Sirichotiyakul , Aykut C. Satici

We study the problem of robustly estimating the posterior distribution for the setting where observed data can be contaminated with potentially adversarial outliers. We propose Rob-ULA, a robust variant of the Unadjusted Langevin Algorithm…

Machine Learning · Statistics 2019-07-30 Kush Bhatia , Yi-An Ma , Anca D. Dragan , Peter L. Bartlett , Michael I. Jordan

Gaussian process regression (GPR) model is well-known to be susceptible to outliers. Robust process regression models based on t-process or other heavy-tailed processes have been developed to address the problem. However, due to the nature…

Methodology · Statistics 2017-07-10 Wang Zhanfeng , Noh Maengseok , Lee Youngjo , Shi Jianqing

This paper concerns the robust regression model when the number of predictors and the number of observations grow in a similar rate. Theory for M-estimators in this regime has been recently developed by several authors [El Karoui et al.,…

Statistics Theory · Mathematics 2016-04-06 Daniel Nevo , Ya'acov Ritov

This article considers a robust hierarchical Bayesian approach to deal with random effects of small area means when some of these effects assume extreme values, resulting in outliers. In presence of outliers, the standard Fay-Herriot model,…

Methodology · Statistics 2015-10-26 Adrijo Chakraborty , Gauri Sankar Datta , Abhyuday Mandal

Empirical Bayes small area estimation based on the well-known Fay-Herriot model may produce unreliable estimates when outlying areas exist. Existing robust methods against outliers or model misspecification are generally inefficient when…

Methodology · Statistics 2022-06-28 Daisuke Kurisu , Takuya Ishihara , Shonosuke Sugasawa

Gaussian graphical model is one of the powerful tools to analyze conditional independence between two variables for multivariate Gaussian-distributed observations. When the dimension of data is moderate or high, penalized likelihood methods…

Methodology · Statistics 2025-01-24 Takahiro Onizuka , Shintaro Hashimoto

In different fields of applications including, but not limited to, behavioral, environmental, medical sciences and econometrics, the use of panel data regression models has become increasingly popular as a general framework for making…

Methodology · Statistics 2020-05-15 Beste Hamiye Beyaztas , Soutir Bandyopadhyay

Bayesian methods have proven themselves to be successful across a wide range of scientific problems and have many well-documented advantages over competing methods. However, these methods run into difficulties for two major and prevalent…

Methodology · Statistics 2022-07-29 John R. Lewis , Steven N. MacEachern , Yoonkyung Lee

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

Regression is the workhorse of statistics, and is often faced with real data that contain outliers. When these are casewise outliers, that is, cases that are entirely wrong or belong to a different population, the issue can be remedied by…

Methodology · Statistics 2026-03-06 Jakob Raymaekers , Peter J. Rousseeuw