中文
相关论文

相关论文: Out-of-Domain Robustness via Targeted Augmentation…

200 篇论文

Domain generalization aims to build generalized models that perform well on unseen domains when only source domains are available for model optimization. Recent studies have shown that large-scale pre-trained models can enhance domain…

机器学习 · 计算机科学 2023-09-12 Byounggyu Lew , Donghyun Son , Buru Chang

Deep neural networks (DNNs) may suffer from significantly degenerated performance when the training and test data are of different underlying distributions. Despite the importance of model generalization to out-of-distribution (OOD) data,…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Chang Liu , Wenzhao Xiang , Yuan He , Hui Xue , Shibao Zheng , Hang Su

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

While deep learning demonstrates its strong ability to handle independent and identically distributed (IID) data, it often suffers from out-of-distribution (OoD) generalization, where the test data come from another distribution (w.r.t. the…

机器学习 · 计算机科学 2020-12-18 Haoyue Bai , Rui Sun , Lanqing Hong , Fengwei Zhou , Nanyang Ye , Han-Jia Ye , S. -H. Gary Chan , Zhenguo Li

Adaptation to out-of-distribution data is a meta-challenge for all statistical learning algorithms that strongly rely on the i.i.d. assumption. It leads to unavoidable labor costs and confidence crises in realistic applications. For that,…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Jingye Wang , Ruoyi Du , Dongliang Chang , Kongming Liang , Zhanyu Ma

Counterfactually-Augmented Data (CAD) -- minimal editing of sentences to flip the corresponding labels -- has the potential to improve the Out-Of-Distribution (OOD) generalization capability of language models, as CAD induces language…

计算与语言 · 计算机科学 2023-10-11 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Counterfactually-Augmented Data (CAD) has the potential to improve language models' Out-Of-Distribution (OOD) generalization capability, as CAD induces language models to exploit causal features and exclude spurious correlations. However,…

计算与语言 · 计算机科学 2023-02-21 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD…

机器学习 · 计算机科学 2024-10-16 Qingyang Zhang , Qiuxuan Feng , Joey Tianyi Zhou , Yatao Bian , Qinghua Hu , Changqing Zhang

Unsupervised domain adaptation (UDA) is the task of modifying a statistical model trained on labeled data from a source domain to achieve better performance on data from a target domain, with access to only unlabeled data in the target…

计算与语言 · 计算机科学 2023-04-06 Timothy A Miller

Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates…

机器学习 · 计算机科学 2023-01-03 John Mitros , Brian Mac Namee

In this paper, we introduce a novel framework for the challenging problem of One-Shot Unsupervised Domain Adaptation (OSUDA), which aims to adapt to a target domain with only a single unlabeled target sample. Unlike existing approaches that…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Julio Ivan Davila Carrazco , Suvarna Kishorkumar Kadam , Pietro Morerio , Alessio Del Bue , Vittorio Murino

We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to learn from a set of source domains to produce a single model…

计算机视觉与模式识别 · 计算机科学 2020-09-01 Prithvijit Chattopadhyay , Yogesh Balaji , Judy Hoffman

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Sen Pei

Although machine learning models typically experience a drop in performance on out-of-distribution data, accuracies on in- versus out-of-distribution data are widely observed to follow a single linear trend when evaluated across a testbed…

机器学习 · 计算机科学 2021-07-01 Anders Andreassen , Yasaman Bahri , Behnam Neyshabur , Rebecca Roelofs

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

机器学习 · 计算机科学 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

计算与语言 · 计算机科学 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Extensive Unsupervised Domain Adaptation (UDA) studies have shown great success in practice by learning transferable representations across a labeled source domain and an unlabeled target domain with deep models. However, previous works…

机器学习 · 计算机科学 2021-09-03 Muhammad Awais , Fengwei Zhou , Hang Xu , Lanqing Hong , Ping Luo , Sung-Ho Bae , Zhenguo Li

In science we are interested in finding the governing equations, the dynamical rules, underlying empirical phenomena. While traditionally scientific models are derived through cycles of human insight and experimentation, recently deep…

机器学习 · 计算机科学 2024-06-11 Niclas Göring , Florian Hess , Manuel Brenner , Zahra Monfared , Daniel Durstewitz

Existing out-of-distribution (OOD) detectors are often tuned by a separate dataset deemed OOD with respect to the training distribution of a neural network (NN). OOD detectors process the activations of NN layers and score the output, where…

机器学习 · 计算机科学 2026-02-06 Sudeepta Mondal , Xinyi Mary Xie , Ruxiao Duan , Alex Wong , Ganesh Sundaramoorthi

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

机器学习 · 计算机科学 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing