English
Related papers

Related papers: A Flat Minima Perspective on Understanding Augment…

200 papers

Hybrid modeling, the combination of machine learning models and scientific mathematical models, enables flexible and robust data-driven prediction with partial interpretability. However, effectively the scientific models may be ignored in…

Machine Learning · Computer Science 2026-02-09 Naoya Takeishi

Foundation models are a current focus of attention in both industry and academia. While they have shown their capabilities in a variety of tasks, in-depth research is required to determine their robustness to distribution shift when used as…

Computation and Language · Computer Science 2023-12-12 Xiruo Ding , Zhecheng Sheng , Brian Hur , Feng Chen , Serguei V. S. Pakhomov , Trevor Cohen

Label distribution (LD) uses the description degree to describe instances, which provides more fine-grained supervision information when learning with label ambiguity. Nevertheless, LD is unavailable in many real-world applications. To…

Machine Learning · Computer Science 2023-03-22 Zhiqiang Kou , Yuheng Jia , Jing Wang , Boyu Shi , Xin Geng

Data augmentation is an effective technique to improve the generalization of deep neural networks. However, previous data augmentation methods usually treat the augmented samples equally without considering their individual impacts on the…

Machine Learning · Computer Science 2021-03-17 Mingyang Yi , Lu Hou , Lifeng Shang , Xin Jiang , Qun Liu , Zhi-Ming Ma

There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the…

Machine Learning · Statistics 2024-03-19 Faisal Hamman , Erfaun Noorani , Saumitra Mishra , Daniele Magazzeni , Sanghamitra Dutta

Out-of-distribution (OOD) generalization is a complicated problem due to the idiosyncrasies of possible distribution shifts between training and test domains. Most benchmarks employ diverse datasets to address this issue; however, the…

Machine Learning · Computer Science 2023-12-18 Kaican Li , Yifan Zhang , Lanqing Hong , Zhenguo Li , Nevin L. Zhang

Adversarial robustness has received increasing attention along with the study of adversarial examples. So far, existing works show that robust models not only obtain robustness against various adversarial attacks but also boost the…

Machine Learning · Computer Science 2021-11-29 Yang Bai , Xin Yan , Yong Jiang , Shu-Tao Xia , Yisen Wang

The performance of machine learning models under distribution shift has been the focus of the community in recent years. Most of current methods have been proposed to improve the robustness to distribution shift from the algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Ziquan Liu , Yi Xu , Yuanhong Xu , Qi Qian , Hao Li , Rong Jin , Xiangyang Ji , Antoni B. Chan

Recent findings suggest that diffusion models significantly enhance empirical adversarial robustness. While some intuitive explanations have been proposed, the precise mechanisms underlying these improvements remain unclear. In this work,…

Machine Learning · Computer Science 2025-05-30 Liu Yuezhang , Xue-Xin Wei

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

The validity of estimation and smoothing parameter selection for the wide class of generalized additive models for location, scale and shape (GAMLSS) relies on the correct specification of a likelihood function. Deviations from such…

Methodology · Statistics 2019-11-14 William H. Aeberhard , Eva Cantoni , Giampiero Marra , Rosalba Radice

Existing deep neural networks, say for image classification, have been shown to be vulnerable to adversarial images that can cause a DNN misclassification, without any perceptible change to an image. In this work, we propose shock absorbing…

Machine Learning · Computer Science 2019-09-19 Kevin Eykholt , Swati Gupta , Atul Prakash , Amir Rahmati , Pratik Vaishnavi , Haizhong Zheng

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Robustness is a basic property of any control system. In the context of linear output regulation, it was proved that embedding an internal model of the exogenous signals is necessary and sufficient to achieve tracking of the desired…

Systems and Control · Electrical Eng. & Systems 2021-04-23 Michelangelo Bin , Daniele Astolfi , Lorenzo Marconi

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

While the traditional formulation of machine learning tasks is in terms of performance on average, in practice we are often interested in how well a trained model performs on rare or difficult data points at test time. To achieve more…

Machine Learning · Computer Science 2025-12-29 Matthew J. Holland , Toma Hamada

Deep networks have achieved impressive results on a range of well-curated benchmark datasets. Surprisingly, their performance remains sensitive to perturbations that have little effect on human performance. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jonas Ngnawe , Marianne Abemgnigni Njifon , Jonathan Heek , Yann Dauphin

The coarse spatial resolution of gridded climate models, such as general circulation models, limits their direct use in projecting socially relevant variables like extreme precipitation. Most downscaling methods estimate the conditional…

Atmospheric and Oceanic Physics · Physics 2026-01-06 Louise Largeau , Tom Beucler , David Leutwyler , Gregoire Mariethoz , Valerie Chavez-Demoulin , Erwan Koch

As training datasets grow larger, we aspire to develop models that generalize well to any diverse test distribution, even if the latter deviates significantly from the training data. Various approaches like domain adaptation, domain…

Machine Learning · Computer Science 2024-10-10 Andreas Loukas , Karolis Martinkus , Ed Wagstaff , Kyunghyun Cho