English
Related papers

Related papers: Robust inference using density-powered Stein opera…

200 papers

Training deep directed graphical models with many hidden variables and performing inference remains a major challenge. Helmholtz machines and deep belief networks are such models, and the wake-sleep algorithm has been proposed to train…

Machine Learning · Computer Science 2016-02-22 Jörg Bornschein , Yoshua Bengio

We introduce $\textit{Stein transport}$, a novel methodology for Bayesian inference designed to efficiently push an ensemble of particles along a predefined curve of tempered probability distributions. The driving vector field is chosen…

Machine Learning · Statistics 2024-12-02 Nikolas Nüsken

Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, these models do not…

Machine Learning · Computer Science 2023-02-23 Tristan Cinquin , Tammo Rukat , Philipp Schmidt , Martin Wistuba , Artur Bekasov

Doubly robust estimators have gained popularity in the field of causal inference due to their ability to provide consistent point estimates when either an outcome or exposure model is correctly specified. However, for nonrandomized…

We develop a theoretical foundation for robust model comparison in a class of non-ergodic continuous volatility regression models contaminated by finite-activity jumps. Using the density-power weighting and the H\"{o}lder(-inequality)-based…

Statistics Theory · Mathematics 2026-04-01 Shoichi Eguchi , Hiroki Masuda

Robustness is of central importance in machine learning and has given rise to the fields of domain generalization and invariant learning, which are concerned with improving performance on a test distribution distinct from but related to the…

Machine Learning · Computer Science 2020-12-03 Robert Adragna , Elliot Creager , David Madras , Richard Zemel

Gradient boosting from the field of statistical learning is widely known as a powerful framework for estimation and selection of predictor effects in various regression models by adapting concepts from classification theory. Current…

Methodology · Statistics 2020-11-03 Colin Griesbach , Benjamin Säfken , Elisabeth Waldmann

Robustness of deep learning models is a property that has recently gained increasing attention. We explore a notion of robustness for generative adversarial models that is pertinent to their internal interactive structure, and show that,…

Machine Learning · Computer Science 2019-10-11 Zhi Xu , Chengtao Li , Stefanie Jegelka

We establish distributional estimates for noncommutative martingales, in the sense of decreasing rearrangements of the spectra of unbounded operators, which generalises the study of distributions of random variables. Our results include…

Functional Analysis · Mathematics 2021-03-17 Yong Jiao , Fedor Sukochev , Lian Wu , Dmitriy Zanin

Relative error estimation has been recently used in regression analysis. A crucial issue of the existing relative error estimation procedures is that they are sensitive to outliers. To address this issue, we employ the $\gamma$-likelihood…

Methodology · Statistics 2018-10-17 Kei Hirose , Hiroki Masuda

For many inference problems in statistics and econometrics, the unknown parameter is identified by a set of moment conditions. A generic method of solving moment conditions is the Generalized Method of Moments (GMM). However, classical GMM…

Machine Learning · Statistics 2021-10-18 Dhruv Rohatgi , Vasilis Syrgkanis

We propose a distributionally robust logistic regression model with an unfairness penalty that prevents discrimination with respect to sensitive attributes such as gender or ethnicity. This model is equivalent to a tractable convex…

Machine Learning · Computer Science 2020-07-21 Bahar Taskesen , Viet Anh Nguyen , Daniel Kuhn , Jose Blanchet

A robust estimator is proposed for the parameters that characterize the linear regression problem. It is based on the notion of shrinkages, often used in Finance and previously studied for outlier detection in multivariate data. A thorough…

Methodology · Statistics 2020-02-07 Elisa Cabana , Rosa E. Lillo , Henry Laniado

The presence of outlying observations may adversely affect statistical testing procedures that result in unstable test statistics and unreliable inferences depending on the distortion in parameter estimates. In spite of the fact that the…

Methodology · Statistics 2021-04-19 Beste Hamiye Beyaztas , Soutir Bandyopadhyay , Abhijit Mandal

Gaussian process regression (GPR) model is well-known to be susceptible to outliers. Robust process regression models based on t-process or other heavy-tailed processes have been developed to address the problem. However, due to the nature…

Methodology · Statistics 2017-07-10 Wang Zhanfeng , Noh Maengseok , Lee Youngjo , Shi Jianqing

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

In this work, we derive a $\gamma$-robust a posteriori error estimator for finite element approximations of the Allen-Cahn equation with variable non-degenerate mobility. The estimator utilizes spectral estimates for the linearized steady…

Numerical Analysis · Mathematics 2024-03-15 Aaron Brunk , Jan Giesselmann , Maria Lukacova-Medvidova

Beta regression models are employed to model continuous response variables in the unit interval, like rates, percentages, or proportions. Their applications rise in several areas, such as medicine, environment research, finance, and natural…

Methodology · Statistics 2026-05-15 Yuri S. Maluf , Silvia L. P. Ferrari , Francisco F. Queiroz

The Gaussian process (GP) regression can be severely biased when the data are contaminated by outliers. This paper presents a new robust GP regression algorithm that iteratively trims the most extreme data points. While the new algorithm…

Machine Learning · Computer Science 2021-06-15 Zhao-Zhou Li , Lu Li , Zhengyi Shao

Complex time series models such as (the sum of) ARMA$(p,q)$ models with additional noise, random walks, rounding errors and/or drifts are increasingly used for data analysis in fields such as biology, ecology, engineering and economics…

Methodology · Statistics 2020-01-14 Stéphane Guerrier , Roberto Molinari , Maria-Pia Victoria-Feser , Haotian Xu