English
Related papers

Related papers: Certifying Model Accuracy under Distribution Shift…

200 papers

The robustness of risk measures to changes in underlying loss distributions (distributional uncertainty) is of crucial importance in making well-informed decisions. In this paper, we quantify, for the class of distortion risk measures with…

Risk Management · Quantitative Finance 2023-03-14 Carole Bernard , Silvana M. Pesenti , Steven Vanduffel

Currently the most popular method of providing robustness certificates is randomized smoothing where an input is smoothed via some probability distribution. We propose a novel approach to randomized smoothing over multiplicative parameters.…

Machine Learning · Computer Science 2022-08-17 Nikita Muravev , Aleksandr Petiushko

We develop a novel computationally efficient and general framework for robust hypothesis testing. The new framework features a new way to construct uncertainty sets under the null and the alternative distributions, which are sets centered…

Machine Learning · Statistics 2018-05-29 Rui Gao , Liyan Xie , Yao Xie , Huan Xu

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

Machine Learning · Computer Science 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

Machine Learning · Computer Science 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

Federated learning has recently gained significant attention and popularity due to its effectiveness in training machine learning models on distributed data privately. However, as in the single-node supervised learning setup, models trained…

Machine Learning · Computer Science 2022-10-27 Motasem Alfarra , Juan C. Pérez , Egor Shulgin , Peter Richtárik , Bernard Ghanem

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial input uncertainty, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Model attribution is a popular tool to explain the rationales behind model predictions. However, recent work suggests that the attributions are vulnerable to minute perturbations, which can be added to input samples to fool the attributions…

Machine Learning · Computer Science 2024-05-13 Fan Wang , Adams Wai-Kin Kong

We address the challenge of certifying the performance of a federated learning model on an unseen target network using only measurements from the source network that trained the model. Specifically, consider a source network "A" with $K$…

Machine Learning · Statistics 2025-06-10 Amir Najafi , Samin Mahdizadeh Sani , Farzan Farnia

Proposition. Let $f$ be a predictor trained on a distribution $P$ and evaluated on a shifted distribution $Q$. Under verifiable regularity and complexity constraints, the excess risk under shift admits an explicit upper bound determined by…

Machine Learning · Computer Science 2026-02-23 Chandrasekhar Gokavarapu , Sudhakar Gadde , Y. Rajasekhar , S. R. Bhargava

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky

We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in view of the equality of opportunity criterion. We use a type-$\infty$ Wasserstein ambiguity set centered at…

Machine Learning · Computer Science 2021-07-13 Yijie Wang , Viet Anh Nguyen , Grani A. Hanasusanto

Deep learning models are vulnerable to adversarial perturbations, raising important concerns for safety-critical deployment. Empirical defenses can achieve strong robustness in practice, but lack formal guarantees, motivating the need for…

Machine Learning · Computer Science 2026-05-26 Konstantinos Emmanouilidis , Tianjiao Ding , Nghia Nguyen , Nicolas Loizou , René Vidal

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Probabilistic time series forecasting has played critical role in decision-making processes due to its capability to quantify uncertainties. Deep forecasting models, however, could be prone to input perturbations, and the notion of such…

Machine Learning · Computer Science 2022-02-25 TaeHo Yoon , Youngsuk Park , Ernest K. Ryu , Yuyang Wang

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

We propose a distributionally robust logistic regression model with an unfairness penalty that prevents discrimination with respect to sensitive attributes such as gender or ethnicity. This model is equivalent to a tractable convex…

Machine Learning · Computer Science 2020-07-21 Bahar Taskesen , Viet Anh Nguyen , Daniel Kuhn , Jose Blanchet

Deep neural networks have proven to be extremely powerful, however, they are also vulnerable to adversarial attacks which can cause hazardous incorrect predictions in safety-critical applications. Certified robustness via randomized…

Machine Learning · Computer Science 2024-10-29 Sina Däubener , Kira Maag , David Krueger , Asja Fischer

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

Machine Learning · Computer Science 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros