中文
相关论文

相关论文: Bridging the Generalization Gap: Training Robust M…

200 篇论文

Information on natural phenomena and engineering systems is typically contained in data. Data can be corrupted by systematic errors in models and experiments. In this paper, we propose a tool to uncover the spatiotemporal solution of the…

流体动力学 · 物理学 2023-06-21 Daniel Kelshaw , Luca Magri

Counterfactually Augmented Data (CAD) involves creating new data samples by applying minimal yet sufficient modifications to flip the label of existing data samples to other classes. Training with CAD enhances model robustness against…

机器学习 · 计算机科学 2024-06-12 Xiaoqi Qiu , Yongjie Wang , Xu Guo , Zhiwei Zeng , Yue Yu , Yuhong Feng , Chunyan Miao

How to train deep neural networks (DNNs) to generalize well is a central concern in deep learning, especially for severely overparameterized networks nowadays. In this paper, we propose an effective method to improve the model…

机器学习 · 计算机科学 2022-06-28 Yang Zhao , Hao Zhang , Xiuyuan Hu

Deep learning has made significant advancements in supervised learning. However, models trained in this setting often face challenges due to domain shift between training and test sets, resulting in a significant drop in performance during…

计算机视觉与模式识别 · 计算机科学 2024-02-08 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

Convolutional Neural Networks (CNNs) have brought revolutionary advances to many research areas due to their capacity of learning from raw data. However, when those methods are applied to non-controllable environments, many different…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Lucas Fernando Alvarenga e Silva , Nicu Sebe , Jurandy Almeida

Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve the model's generalization ability on unseen target domains.…

机器学习 · 计算机科学 2021-06-03 Yunqi Wang , Furui Liu , Zhitang Chen , Qing Lian , Shoubo Hu , Jianye Hao , Yik-Chung Wu

Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets for measuring a model's OOD performance were designed to be…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Prasanna Mayilvahanan , Roland S. Zimmermann , Thaddäus Wiedemer , Evgenia Rusak , Attila Juhos , Matthias Bethge , Wieland Brendel

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Attenuation bias -- the systematic underestimation of regression coefficients due to measurement errors in input variables -- affects astronomical data-driven models. For linear regression, this problem was solved by treating the true input…

天体物理仪器与方法 · 物理学 2026-03-30 Yuan-Sen Ting

Heterogeneity in medical data, e.g., from data collected at different sites and with different protocols in a clinical study, is a fundamental hurdle for accurate prediction using machine learning models, as such models often fail to…

机器学习 · 计算机科学 2021-07-13 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

While deep learning has shown promise in the domain of disease classification from medical images, models based on state-of-the-art convolutional neural network architectures often exhibit performance loss due to dataset shift. Models…

机器学习 · 计算机科学 2020-01-14 Joseph D. Janizek , Gabriel Erion , Alex J. DeGrave , Su-In Lee

While pretrained language models achieve excellent performance on natural language understanding benchmarks, they tend to rely on spurious correlations and generalize poorly to out-of-distribution (OOD) data. Recent work has explored using…

计算与语言 · 计算机科学 2022-03-17 Nitish Joshi , He He

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in…

机器学习 · 计算机科学 2026-04-02 Kulunu Dharmakeerthi , YoonHaeng Hur , Tengyuan Liang

As network data applications continue to expand, causal inference within networks has garnered increasing attention. However, hidden confounders complicate the estimation of causal effects. Most methods rely on the strong ignorability…

机器学习 · 计算机科学 2024-09-16 Xiaojing Du , Feiyu Yang , Wentao Gao , Xiongren Chen

Deep neural networks (DNNs) often struggle with out-of-distribution data, limiting their reliability in diverse realworld applications. To address this issue, domain generalization methods have been developed to learn domain-invariant…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Jiaxi Li , Di Lin , Hao Chen , Hongying Liu , Liang Wan , Wei Feng

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

机器学习 · 计算机科学 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

Existing federated learning models that follow the standard risk minimization paradigm of machine learning often fail to generalize in the presence of spurious correlations in the training data. In many real-world distributed settings,…

机器学习 · 计算机科学 2023-05-31 Praveen Venkateswaran , Vatche Isahagian , Vinod Muthusamy , Nalini Venkatasubramanian

Conditioning on some set of confounders that causally affect both treatment and outcome variables can be sufficient for eliminating bias introduced by all such confounders when estimating causal effect of the treatment on the outcome from…

统计方法学 · 统计学 2018-04-24 Priyantha Wijayatunga

Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard samples lack the flexibility to handle such a variety…

机器学习 · 计算机科学 2023-11-08 Zhijie Deng , Peng Cui , Jun Zhu