中文
相关论文

相关论文: Probable Domain Generalization via Quantile Risk M…

200 篇论文

Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any target data. Existing domain generalization methods ignore…

机器学习 · 计算机科学 2022-06-08 William Wei Wang , Gezheng Xu , Ruizhi Pu , Jiaqi Li , Fan Zhou , Changjian Shui , Charles Ling , Christian Gagné , Boyu Wang

Temporal Domain Generalization (TDG) addresses the challenge of training predictive models under temporally varying data distributions. Traditional TDG approaches typically focus on domain data collected at fixed, discrete time intervals,…

机器学习 · 计算机科学 2024-10-30 Zekun Cai , Guangji Bai , Renhe Jiang , Xuan Song , Liang Zhao

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

计算机视觉与模式识别 · 计算机科学 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

计算机视觉与模式识别 · 计算机科学 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

The coverage and composition of the pretraining data significantly impacts the generalization ability of Large Language Models (LLMs). Despite its importance, recent LLMs still rely on heuristics and trial and error to increase or reduce…

机器学习 · 计算机科学 2024-02-06 Simin Fan , Matteo Pagliardini , Martin Jaggi

Domain Generalization (DG) aims to train models that can generalize to unseen testing domains by leveraging data from multiple training domains. However, traditional DG methods rely on the availability of multiple diverse training domains,…

机器学习 · 计算机科学 2025-03-11 Hao Yan , Marzi Heidari , Yuhong Guo

In general, an experimental environment for deep learning assumes that the training and the test dataset are sampled from the same distribution. However, in real-world situations, a difference in the distribution between two datasets,…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Daehee Kim , Seunghyun Park , Jinkyu Kim , Jaekoo Lee

Supervised learning results typically rely on assumptions of i.i.d. data. Unfortunately, those assumptions are commonly violated in practice. In this work, we tackle such problem by focusing on domain generalization: a formalization where…

机器学习 · 计算机科学 2024-10-30 Isabela Albuquerque , João Monteiro , Mohammad Darvishi , Tiago H. Falk , Ioannis Mitliagkas

Recent empirical studies on domain generalization (DG) have shown that DG algorithms that perform well on some distribution shifts fail on others, and no state-of-the-art DG algorithm performs consistently well on all shifts. Moreover,…

机器学习 · 计算机科学 2024-05-21 Jivat Neet Kaur , Emre Kiciman , Amit Sharma

Machine learning models have exhibited exceptional results in various domains. The most prevalent approach for learning is the empirical risk minimizer (ERM), which adapts the model's weights to reduce the loss on a training set and…

机器学习 · 计算机科学 2024-12-11 Koby Bibas

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Aristotelis Ballas , Christos Diou

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

最优化与控制 · 数学 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

Domain generalization (DG), aiming to make models work on unseen domains, is a surefire way toward general artificial intelligence. Limited by the scale and diversity of current DG datasets, it is difficult for existing methods to scale to…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Hongjing Niu , Hanting Li , Feng Zhao , Bin Li

The problem of domain generalization is to learn from multiple training domains, and extract a domain-agnostic model that can then be applied to an unseen domain. Domain generalization (DG) has a clear motivation in contexts where there are…

计算机视觉与模式识别 · 计算机科学 2017-10-10 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Recent advances in prompt optimization have notably enhanced the performance of pre-trained language models (PLMs) on downstream tasks. However, the potential of optimized prompts on domain generalization has been under-explored. To explore…

计算与语言 · 计算机科学 2024-10-22 Chengzhengxu Li , Xiaoming Liu , Zhaohan Zhang , Yichen Wang , Chen Liu , Yu Lan , Chao Shen

This paper studies the limitations of the generic approaches to solving cryptographic problems in classical and quantum settings in various models. - In the classical generic group model (GGM), we find simple alternative proofs for the…

量子物理 · 物理学 2024-02-20 Minki Hhan

Although distributional reinforcement learning (DRL) has been widely examined in the past few years, very few studies investigate the validity of the obtained Q-function estimator in the distributional setting. To fully understand how the…

机器学习 · 计算机科学 2023-08-01 Qi Kuang , Zhoufan Zhu , Liwen Zhang , Fan Zhou

Quantized neural networks typically require smaller memory footprints and lower computation complexity, which is crucial for efficient deployment. However, quantization inevitably leads to a distribution divergence from the original…

计算机视觉与模式识别 · 计算机科学 2022-05-30 Runpei Dong , Zhanhong Tan , Mengdi Wu , Linfeng Zhang , Kaisheng Ma

Domain generalization (DG) methods aim to maintain good performance in an unseen target domain by using training data from multiple source domains. While success on certain occasions are observed, enhancing the baseline across most…

机器学习 · 计算机科学 2024-10-28 Liang Chen , Yong Zhang , Yibing Song , Zhiqiang Shen , Lingqiao Liu