中文
相关论文

相关论文: A New PAC-Bayesian Perspective on Domain Adaptatio…

200 篇论文

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

机器学习 · 计算机科学 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

We are motivated by the problem of providing strong generalization guarantees in the context of meta-learning. Existing generalization bounds are either challenging to evaluate or provide vacuous guarantees in even relatively simple…

机器学习 · 计算机科学 2021-10-27 Alec Farid , Anirudha Majumdar

We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization scenario is the unavailability of any target domain data during training, resulting…

机器学习 · 计算机科学 2022-02-17 Zehao Xiao , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

In theory, the success of unsupervised domain adaptation (UDA) largely relies on domain gap estimation. However, for source free UDA, the source domain data can not be accessed during adaptation, which poses great challenge of measuring the…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Ziyang Zong , Jun He , Lei Zhang , Hai Huan

PAC-Bayes is a useful framework for deriving generalization bounds which was introduced by McAllester ('98). This framework has the flexibility of deriving distribution- and algorithm-dependent bounds, which are often tighter than…

机器学习 · 计算机科学 2021-09-06 Roi Livni , Shay Moran

In contrast to a standard closed-set domain adaptation task, partial domain adaptation setup caters to a realistic scenario by relaxing the identical label set assumption. The fact of source label set subsuming the target label set,…

机器学习 · 计算机科学 2022-12-12 Sandipan Choudhuri , Hemanth Venkateswara , Arunabha Sen

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization…

机器学习 · 计算机科学 2021-06-18 Wouter M. Kouw , Marco Loog

Domain adaptation aims at adapting the knowledge acquired on a source domain to a new different but related target domain. Several approaches have beenproposed for classification tasks in the unsupervised scenario, where no labeled target…

计算机视觉与模式识别 · 计算机科学 2015-04-30 Basura Fernando , Tatiana Tommasi , Tinne Tuytelaars

PAC-Bayesian learning bounds are of the utmost interest to the learning community. Their role is to connect the generalization ability of an aggregation distribution $\rho$ to its empirical risk and to its Kullback-Leibler divergence with…

机器学习 · 统计学 2019-05-24 Pierre Alquier , Benjamin Guedj

The aim of unsupervised domain adaptation is to leverage the knowledge in a labeled (source) domain to improve a model's learning performance with an unlabeled (target) domain -- the basic strategy being to mitigate the effects of…

机器学习 · 计算机科学 2020-10-09 Zhen Fang , Jie Lu , Feng Liu , Junyu Xuan , Guangquan Zhang

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

机器学习 · 计算机科学 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

This paper uses information-theoretic tools to analyze the generalization error in unsupervised domain adaptation (UDA). We present novel upper bounds for two notions of generalization errors. The first notion measures the gap between the…

机器学习 · 计算机科学 2023-03-03 Ziqiao Wang , Yongyi Mao

By leveraging experience from previous tasks, meta-learning algorithms can achieve effective fast adaptation ability when encountering new tasks. However it is unclear how the generalization property applies to new tasks. Probably…

机器学习 · 计算机科学 2021-02-09 Tianyu Liu , Jie Lu , Zheng Yan , Guangquan Zhang

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

We study a problem of best-effort adaptation motivated by several applications and considerations, which consists of determining an accurate predictor for a target domain, for which a moderate amount of labeled samples are available, while…

机器学习 · 计算机科学 2023-05-11 Pranjal Awasthi , Corinna Cortes , Mehryar Mohri

We present a novel analysis of the expected risk of weighted majority vote in multiclass classification. The analysis takes correlation of predictions by ensemble members into account and provides a bound that is amenable to efficient…

机器学习 · 计算机科学 2020-12-18 Andrés R. Masegosa , Stephan S. Lorenzen , Christian Igel , Yevgeny Seldin

In machine learning, the domain adaptation problem arrives when the test (target) and the train (source) data are generated from different distributions. A key applied issue is thus the design of algorithms able to generalize on a new…

机器学习 · 统计学 2014-10-02 Emilie Morvant

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

机器学习 · 计算机科学 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

PAC-Bayesian bounds have proven to be a valuable tool for deriving generalization bounds and for designing new learning algorithms in machine learning. However, it typically focus on providing generalization bounds with respect to a chosen…

机器学习 · 统计学 2024-08-19 The Tien Mai