English
Related papers

Related papers: Robust importance-weighted cross-validation under …

200 papers

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

The generalization ability of minimizers of the empirical risk in the context of binary classification has been investigated under a wide variety of complexity assumptions for the collection of classifiers over which optimization is…

Statistics Theory · Mathematics 2019-01-21 Clémençon Stephan , Patrice Bertail , Guillaume Papa

This article proposes a generalized notion of extreme multivariate dependence between two random vectors which relies on the extremality of the cross-covariance matrix between these two vectors. Using a partial ordering on the…

Econometrics · Economics 2021-02-10 Damien Bosc , Alfred Galichon

In the field of structural reliability, the Monte-Carlo estimator is considered as the reference probability estimator. However, it is still untractable for real engineering cases since it requires a high number of runs of the model. In…

Methodology · Statistics 2015-03-19 V. Dubourg , F. Deheeger , B. Sudret

Biomedical researchers usually study the effects of certain exposures on disease risks among a well-defined population. To achieve this goal, the gold standard is to design a trial with an appropriate sample from that population. Due to the…

Applications · Statistics 2019-11-18 Cheng Zheng , Sayan Dasgupta , Yuxiang Xie , Asad Haris , Ying Qing Chen

Class-level evaluation can conceal substantial performance disparities across subconcepts within the same class, causing models that perform well on average to fail on specific subpopulations. Prior work has shown that common evaluation…

Machine Learning · Computer Science 2026-04-30 Taylor Maxson , Roberto Corizzo , Yaning Wu , Nathalie Japkowicz , Colin Bellinger

In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy…

Machine Learning · Computer Science 2020-12-30 Antoine Blanchard , Themistoklis Sapsis

Binary classifiers trained on a certain proportion of positive items introduce a bias when applied to data sets with different proportions of positive items. Most solutions for dealing with this issue assume that some information on the…

Machine Learning · Statistics 2021-02-18 Marco J. H. Puts , Piet J. H. Daas

We study issues of robustness in the context of Quantitative Risk Management and Optimization. We develop a general methodology for determining whether a given risk measurement related optimization problem is robust, which we call…

Risk Management · Quantitative Finance 2021-02-12 Paul Embrechts , Alexander Schied , Ruodu Wang

We investigate the large-sample behavior of change-point tests based on weighted two-sample U-statistics, in the case of short-range dependent data. Under some mild mixing conditions, we establish convergence of the test statistic to an…

Statistics Theory · Mathematics 2023-04-04 Herold Dehling , Kata Vuk , Martin Wendler

This paper presents a theoretical analysis of sample selection bias correction. The sample bias correction technique commonly used in machine learning consists of reweighting the cost of an error on each training point of a biased sample to…

Machine Learning · Computer Science 2008-12-18 Corinna Cortes , Mehryar Mohri , Michael Riley , Afshin Rostamizadeh

The Cross Entropy method is a well-known adaptive importance sampling method for rare-event probability estimation, which requires estimating an optimal importance sampling density within a parametric class. In this article we estimate an…

Computation · Statistics 2013-10-15 Z. I. Botev , A. Ridder , L. Rojas-Nandayapa

We propose bandit importance sampling (BIS), a powerful importance sampling framework tailored for settings in which evaluating the target density is computationally expensive. BIS facilitates accurate sampling while minimizing the required…

Methodology · Statistics 2026-03-17 Takuo Matsubara , Andrew Duncan , Simon Cotter , Konstantinos Zygalakis

Importance weighting is a standard tool for correcting distribution shift, but its statistical behavior under target shift -- where the label distribution changes between training and testing while the conditional distribution of inputs…

Machine Learning · Statistics 2026-03-04 Davit Gogolashvili

This paper studies distributionally robust optimization for a rich class of risk measures with ambiguity sets defined by $\phi$-divergences. The risk measures are allowed to be non-linear in probabilities, are represented by Choquet…

Optimization and Control · Mathematics 2025-04-15 Guanyu Jin , Roger J. A. Laeven , Dick den Hertog

This paper surveys some well-established approaches on the approximation of Bayes factors used in Bayesian model choice, mostly as covered in Chen et al. (2000). Our focus here is on methods that are based on importance sampling strategies…

Computation · Statistics 2009-10-14 Jean-Michel Marin , Christian P. Robert

The occurrence of atypical circular observations on the torus can badly affect parameter estimation of the multivariate von Mises distribution. This paper addresses the problem of robust fitting of the multivariate von Mises model using the…

Methodology · Statistics 2026-03-04 Giulia Bertagnolli , Luca Greco , Claudio Agostinelli

We examine the problem of construction of confidence intervals within the basic single-parameter, single-iteration variation of the method of quasi-optimal weights. Two kinds of distortions of such intervals due to insufficiently large…

Data Analysis, Statistics and Probability · Physics 2020-05-27 A. D. Morozov , A. V. Lokhov , F. V. Tkachov

Cross-validation (CV) is a popular approach for assessing and selecting predictive models. However, when the number of folds is large, CV suffers from a need to repeatedly refit a learning procedure on a large number of training datasets.…

Machine Learning · Statistics 2020-06-12 Ashia Wilson , Maximilian Kasy , Lester Mackey

Importance Sampling (IS) is a method for approximating expectations under a target distribution using independent samples from a proposal distribution and the associated importance weights. In many applications, the target distribution is…

Machine Learning · Statistics 2022-09-14 Gabriel Cardoso , Sergey Samsonov , Achille Thin , Eric Moulines , Jimmy Olsson