English
Related papers

Related papers: Interpolation for Robust Learning: Data Augmentati…

200 papers

Neural networks are vulnerable to adversarial examples and researchers have proposed many heuristic attack and defense mechanisms. We address this problem through the principled lens of distributionally robust optimization, which guarantees…

Machine Learning · Statistics 2020-05-04 Aman Sinha , Hongseok Namkoong , Riccardo Volpi , John Duchi

This paper examines the phenomenon of probabilistic robustness overestimation in TRADES, a prominent adversarial training method. Our study reveals that TRADES sometimes yields disproportionately high PGD validation accuracy compared to the…

Machine Learning · Computer Science 2024-10-11 Jonathan Weiping Li , Ren-Wei Liang , Cheng-Han Yeh , Cheng-Chang Tsai , Kuanchun Yu , Chun-Shien Lu , Shang-Tse Chen

While prior research has proposed a plethora of methods that build neural classifiers robust against adversarial robustness, practitioners are still reluctant to adopt them due to their unacceptably severe clean accuracy penalties. This…

Machine Learning · Computer Science 2024-07-23 Yatong Bai , Brendon G. Anderson , Aerin Kim , Somayeh Sojoudi

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

Optimization and Control · Mathematics 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

Wasserstein geometry and information geometry are two important structures to be introduced in a manifold of probability distributions. Wasserstein geometry is defined by using the transportation cost between two distributions, so it…

Statistics Theory · Mathematics 2021-01-01 Shun-ichi Amari , Takeru Matsuda

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

Machine Learning · Computer Science 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas

The problem of modeling the relationship between univariate distributions and one or more explanatory variables has found increasing interest. Traditional functional data methods cannot be applied directly to distributional data because of…

Methodology · Statistics 2025-02-04 Yidong Zhou , Hans-Georg Müller

Accurate interpolation of seismic data is crucial for improving the quality of imaging and interpretation. In recent years, deep learning models such as U-Net and generative adversarial networks have been widely applied to seismic data…

We introduce Interactive Bayesian Distributional Robustness (IBDR), a novel Bayesian inference framework that allows modeling the interactions between particles, thereby enhancing ensemble quality through increased particle diversity. IBDR…

Machine Learning · Computer Science 2025-06-10 Ngoc-Quan Pham , Tuan Truong , Quyen Tran , Tan Nguyen , Dinh Phung , Trung Le

We present a general duality result for Wasserstein distributionally robust optimization that holds for any Kantorovich transport cost, measurable loss function, and nominal probability distribution. Assuming an interchangeability principle…

Optimization and Control · Mathematics 2024-11-26 Luhao Zhang , Jincheng Yang , Rui Gao

Wasserstein \textbf{D}istributionally \textbf{R}obust \textbf{O}ptimization (DRO) is concerned with finding decisions that perform well on data that are drawn from the worst-case probability distribution within a Wasserstein ball centered…

Optimization and Control · Mathematics 2020-10-27 Jiajin Li , Caihua Chen , Anthony Man-Cho So

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

Machine Learning · Computer Science 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

Knowledge distillation has proven to be an effective technique in improving the performance a student model using predictions from a teacher model. However, recent work has shown that gains in average efficiency are not uniform across…

Machine Learning · Computer Science 2022-06-15 Serena Wang , Harikrishna Narasimhan , Yichen Zhou , Sara Hooker , Michal Lukasik , Aditya Krishna Menon

We revisit the benefits of merging classical vision concepts with deep learning models. In particular, we explore the effect on robustness against adversarial attacks of replacing the first layers of various deep architectures with Gabor…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Juan C. Pérez , Motasem Alfarra , Guillaume Jeanneret , Adel Bibi , Ali Thabet , Bernard Ghanem , Pablo Arbeláez

We introduce a robust variant of the Kelly portfolio optimization model, called the Wasserstein-Kelly portfolio optimization. Our model, taking a Wasserstein distributionally robust optimization (DRO) formulation, addresses the fundamental…

Portfolio Management · Quantitative Finance 2023-02-28 Jonathan Yu-Meng Li

We formulate well-posed continuous-time generative flows for learning distributions that are supported on low-dimensional manifolds through Wasserstein proximal regularizations of $f$-divergences. Wasserstein-1 proximal operators regularize…

Machine Learning · Statistics 2024-07-17 Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang

We propose Gaussian optimal transport for Image style transfer in an Encoder/Decoder framework. Optimal transport for Gaussian measures has closed forms Monge mappings from source to target distributions. Moreover interpolates between a…

Machine Learning · Computer Science 2019-05-31 Youssef Mroueh

The proliferation of large data sets and Bayesian inference techniques motivates demand for better data sparsification. Coresets provide a principled way of summarizing a large dataset via a smaller one that is guaranteed to match the…

Machine Learning · Statistics 2020-03-04 Sebastian Claici , Aude Genevay , Justin Solomon

We adopt the statistical framework on robustness proposed by Watson and Holmes in 2016 and then tackle the practical challenges that hinder its applicability to network models. The goal is to evaluate how the quality of an inference for a…

Methodology · Statistics 2020-12-08 Marios Papamichalis , Simon Lunagomez , Patrick J. Wolfe

Adapting a pre-trained foundation model on downstream tasks should ensure robustness against distribution shifts without the need to retrain the whole model. Although existing weight interpolation methods are simple yet effective, we argue…

Machine Learning · Computer Science 2025-06-02 Changdae Oh , Yixuan Li , Kyungwoo Song , Sangdoo Yun , Dongyoon Han