English
Related papers

Related papers: Robust inference using density-powered Stein opera…

200 papers

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

Statistics Theory · Mathematics 2023-05-05 Pierre Alquier , Mathieu Gerber

In this paper, we consider the situation in which the observations follow an isotonic generalized partly linear model. Under this model, the mean of the responses is modelled, through a link function, linearly on some covariates and…

Statistics Theory · Mathematics 2018-11-30 Graciela Boente , Daniela Rodriguez , Pablo Vena

Stein's identity is a fundamental tool in machine learning with applications in generative models, stochastic optimization, and other problems involving gradients of expectations under Gaussian distributions. Less attention has been paid to…

We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in view of the equality of opportunity criterion. We use a type-$\infty$ Wasserstein ambiguity set centered at…

Machine Learning · Computer Science 2021-07-13 Yijie Wang , Viet Anh Nguyen , Grani A. Hanasusanto

The problem of estimating the shift (or, equivalently, the center of symmetry) of an unknown symmetric and periodic function $f$ observed in Gaussian white noise is considered. Using the blockwise Stein method, a penalized profile…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan

Many Imitation and Reinforcement Learning approaches rely on the availability of expert-generated demonstrations for learning policies or value functions from data. Obtaining a reliable distribution of trajectories from motion planners is…

Robotics · Computer Science 2021-07-13 Alexander Lambert , Byron Boots

In large-scale regression problems, random Fourier features (RFFs) have significantly enhanced the computational scalability and flexibility of Gaussian processes (GPs) by defining kernels through their spectral density, from which a finite…

Machine Learning · Computer Science 2024-06-05 Houston Warren , Rafael Oliveira , Fabio Ramos

In this paper, we extend to generalized linear models (including logistic and other binary regression models, Poisson regression and gamma regression models) the robust model selection methodology developed by Mueller and Welsh (2005; JASA)…

Methodology · Statistics 2007-11-16 Samuel Mueller , A. H. Welsh

This paper develops a methodology for robust Bayesian inference through the use of disparities. Metrics such as Hellinger distance and negative exponential disparity have a long history in robust estimation in frequentist inference. We…

Methodology · Statistics 2012-11-28 Giles Hooker , Anand Vidyashankar

For parameter estimation of continuous and discrete distributions, we propose a generalization of the method of moments (MM), where Stein identities are utilized for improved estimation performance. The construction of these Stein-type…

Methodology · Statistics 2023-12-25 Simon Nik , Christian H. Weiß

Traditional methods for linear regression generally assume that the underlying error distribution, equivalently the distribution of the responses, is normal. Yet, sometimes real life response data may exhibit a skewed pattern, and assuming…

Methodology · Statistics 2025-01-07 Amarnath Nandy , Ayanendranath Basu , Abhik Ghosh

Assuming an exponential power distribution is one way to deal with outliers in regression and clustering, which can increase the robustness of the analysis. Gaussian distribution is a special case of an exponential distribution. And an…

Methodology · Statistics 2020-12-22 Xiao Chen

Starting from a linear fractional representation of a linear system affected by constant parametric uncertainties, we demonstrate how to enhance standard robust analysis tests by taking available (noisy) input-output data of the uncertain…

Optimization and Control · Mathematics 2023-03-27 Tobias Holicki , Carsten W. Scherer

Statistical integration of diverse data sources is an essential step in the building of generalizable prediction tools, especially in precision health. The invariant features model is a new paradigm for multi-source data integration which…

Methodology · Statistics 2025-03-05 Parker Knight , Ndey Isatou Jobe , Rui Duan

Goodness-of-fit testing is often criticized for its lack of practical relevance: since ``all models are wrong'', the null hypothesis that the data conform to our model is ultimately always rejected as the sample size grows. Despite this,…

Machine Learning · Statistics 2025-10-24 Xing Liu , François-Xavier Briol

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural network models have proved to be adept at modeling processes with spatial-temporal complexity.…

Machine Learning · Computer Science 2025-02-04 Jeremiah Hauth , Cosmin Safta , Xun Huan , Ravi G. Patel , Reese E. Jones

In this paper, we develop efficient randomized algorithms for estimating probabilistic robustness margin and constructing robustness degradation curve for uncertain dynamic systems. One remarkable feature of these algorithms is their…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Gradient boosted models are a fundamental machine learning technique. Robustness to small perturbations of the input is an important quality measure for machine learning models, but the literature lacks a method to prove the robustness of…

Machine Learning · Computer Science 2019-06-27 Gil Einziger , Maayan Goldstein , Yaniv Sa'ar , Itai Segall

Robust regression models in the presence of outliers have significant practical relevance in areas such as signal processing, financial econometrics, and energy management. Many existing robust regression methods, either grounded in…

Signal Processing · Electrical Eng. & Systems 2025-06-30 Pengyang Song , Jue Wang

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng