English

Exact Generalization Guarantees for (Regularized) Wasserstein Distributionally Robust Models

Machine Learning 2023-11-07 v2 Machine Learning

Abstract

Wasserstein distributionally robust estimators have emerged as powerful models for prediction and decision-making under uncertainty. These estimators provide attractive generalization guarantees: the robust objective obtained from the training distribution is an exact upper bound on the true risk with high probability. However, existing guarantees either suffer from the curse of dimensionality, are restricted to specific settings, or lead to spurious error terms. In this paper, we show that these generalization guarantees actually hold on general classes of models, do not suffer from the curse of dimensionality, and can even cover distribution shifts at testing. We also prove that these results carry over to the newly-introduced regularized versions of Wasserstein distributionally robust problems.

Keywords

Cite

@article{arxiv.2305.17076,
  title  = {Exact Generalization Guarantees for (Regularized) Wasserstein Distributionally Robust Models},
  author = {Waïss Azizian and Franck Iutzeler and Jérôme Malick},
  journal= {arXiv preprint arXiv:2305.17076},
  year   = {2023}
}

Comments

49 pages, 2 figures; to be presented at the 37th Annual Conference on Neural Information Processing Systems (NeurIPS 2023)

R2 v1 2026-06-28T10:47:45.739Z