中文
相关论文

相关论文: Probable Domain Generalization via Quantile Risk M…

200 篇论文

Quantile Regression (QR) provides a way to approximate a single conditional quantile. To have a more informative description of the conditional distribution, QR can be merged with deep learning techniques to simultaneously estimate multiple…

机器学习 · 计算机科学 2022-02-01 Axel Brando , Joan Gimeno , Jose A. Rodríguez-Serrano , Jordi Vitrià

The objective of domain generalization (DG) is to enhance the transferability of the model learned from a source domain to unobserved domains. To prevent overfitting to a specific domain, Sharpness-Aware Minimization (SAM) reduces source…

机器学习 · 计算机科学 2024-03-13 Seungjae Shin , HeeSun Bae , Byeonghu Na , Yoon-Yeong Kim , Il-Chul Moon

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

机器学习 · 计算机科学 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

机器学习 · 计算机科学 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Probabilistic graphical models (PGMs) provide a compact representation of knowledge that can be queried in a flexible way: after learning the parameters of a graphical model once, new probabilistic queries can be answered at test time…

Domain Generalization (DG) aims to learn a model that can generalize well to unseen target domains from a set of source domains. With the idea of invariant causal mechanism, a lot of efforts have been put into learning robust causal effects…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Qiaowei Miao , Junkun Yuan , Kun Kuang

Domain generalization (DG) is essentially an out-of-distribution problem, aiming to generalize the knowledge learned from multiple source domains to an unseen target domain. The mainstream is to leverage statistical models to model the…

机器学习 · 计算机科学 2022-03-29 Fangrui Lv , Jian Liang , Shuang Li , Bin Zang , Chi Harold Liu , Ziteng Wang , Di Liu

Empirical risk minimization (ERM) is a fundamental machine learning paradigm. However, its generalization ability is limited in various tasks. In this paper, we devise Dummy Risk Minimization (DuRM), a frustratingly easy and general…

机器学习 · 计算机科学 2023-10-10 Juncheng Wang , Jindong Wang , Xixu Hu , Shujun Wang , Xing Xie

This paper addresses the domain generalization (DG) problem in deep learning. While most DG methods focus on enforcing visual feature invariance, we leverage the reasoning capability of multimodal large language models (MLLMs) and explore…

人工智能 · 计算机科学 2026-03-02 Zhipeng Xu , Zilong Wang , Xinyang Jiang , Dongsheng Li , De Cheng , Nannan Wang

Domain Generalization (DG) studies the capability of a deep learning model to generalize to out-of-training distributions. In the last decade, literature has been massively filled with training methodologies that claim to obtain more…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Simone Angarano , Mauro Martini , Francesco Salvetti , Vittorio Mazzia , Marcello Chiaberge

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

机器学习 · 计算机科学 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

In real-world applications, a machine learning model is required to handle an open-set recognition (OSR), where unknown classes appear during the inference, in addition to a domain shift, where the distribution of data differs between the…

计算机视觉与模式识别 · 计算机科学 2023-04-03 Masashi Noguchi , Shinichi Shirakawa

The goal of domain generalization algorithms is to predict well on distributions different from those seen during training. While a myriad of domain generalization algorithms exist, inconsistencies in experimental conditions -- datasets,…

机器学习 · 计算机科学 2020-07-06 Ishaan Gulrajani , David Lopez-Paz

The reliability of neural networks is essential for their use in safety-critical applications. Existing approaches generally aim at improving the robustness of neural networks to either real-world distribution shifts (e.g., common…

机器学习 · 计算机科学 2022-05-20 Leo Schwinn , Leon Bungert , An Nguyen , René Raab , Falk Pulsmeyer , Doina Precup , Björn Eskofier , Dario Zanca

Domain generalization aims to learn a model with good generalization ability, that is, the learned model should not only perform well on several seen domains but also on unseen domains with different data distributions. State-of-the-art…

机器学习 · 计算机科学 2023-04-04 Boyang Lyu , Thuan Nguyen , Matthias Scheutz , Prakash Ishwar , Shuchin Aeron

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

机器学习 · 计算机科学 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

机器学习 · 计算机科学 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many distribution shifts and, therefore, should substantially improve…

计算机视觉与模式识别 · 计算机科学 2022-08-18 Xin Zhang , Shixiang Shane Gu , Yutaka Matsuo , Yusuke Iwasawa

Domain Generalization (DG) is a critical area that focuses on developing models capable of performing well on data from unseen distributions, which is essential for real-world applications. Existing approaches primarily concentrate on…

机器学习 · 计算机科学 2026-01-28 Xudong Han , Senkang Hu , Yihang Tao , Yu Guo , Philip Birch , Sam Tak Wu Kwong , Yuguang Fang

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven…

机器学习 · 计算机科学 2026-02-10 Ruth Crasto , Esther Rolf