中文
相关论文

相关论文: Target Domain Data induces Negative Transfer in Mi…

200 篇论文

There is growing evidence that pretrained language models improve task-specific fine-tuning not just for the languages seen in pretraining, but also for new languages and even non-linguistic data. What is the nature of this surprising…

计算与语言 · 计算机科学 2021-04-20 Zhengxuan Wu , Nelson F. Liu , Christopher Potts

Performance achievable by modern deep learning approaches are directly related to the amount of data used at training time. Unfortunately, the annotation process is notoriously tedious and expensive, especially for pixel-wise tasks like…

计算机视觉与模式识别 · 计算机科学 2018-10-16 Pierluigi Zama Ramirez , Alessio Tonioni , Luigi Di Stefano

Domain adaptation seeks to mitigate the shift between training on the \emph{source} domain and testing on the \emph{target} domain. Most adaptation methods rely on the source data by joint optimization over source data and target data.…

计算机视觉与模式识别 · 计算机科学 2021-09-03 Dequan Wang , Shaoteng Liu , Sayna Ebrahimi , Evan Shelhamer , Trevor Darrell

We address the problem of severe class imbalance in unsupervised domain adaptation, when the class spaces in source and target domains diverge considerably. Till recently, domain adaptation methods assumed the aligned class spaces, such…

机器学习 · 计算机科学 2019-09-20 Boris Chidlovskii

Multi-task learning enables the acquisition of task-generic knowledge by training multiple tasks within a unified architecture. However, training all tasks together in a single architecture can lead to performance degradation, known as…

机器学习 · 计算机科学 2025-04-23 Wooseong Jeong , Kuk-Jin Yoon

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

机器学习 · 统计学 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

Discrepancy between training and testing domains is a fundamental problem in the generalization of machine learning techniques. Recently, several approaches have been proposed to learn domain invariant feature representations through…

机器学习 · 统计学 2019-03-18 Yitong Li , Michael Murias , Samantha Major , Geraldine Dawson , David E. Carlson

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

计算机视觉与模式识别 · 计算机科学 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Domain adaptation (DA) aims to transfer discriminative features learned from source domain to target domain. Most of DA methods focus on enhancing feature transferability through domain-invariance learning. However, source-learned…

机器学习 · 计算机科学 2020-11-10 Jun Wen , Changjian Shui , Kun Kuang , Junsong Yuan , Zenan Huang , Zhefeng Gong , Nenggan Zheng

The goal of this work is to improve images of traffic scenes that are degraded by natural causes such as fog, rain and limited visibility during the night. For these applications, it is next to impossible to get pixel perfect pairs of the…

计算机视觉与模式识别 · 计算机科学 2018-12-10 Elias Vansteenkiste , Patrick Kern

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

Applying an object detector, which is neither trained nor fine-tuned on data close to the final application, often leads to a substantial performance drop. In order to overcome this problem, it is necessary to consider a shift between…

计算机视觉与模式识别 · 计算机科学 2020-05-27 Alexey Abramov , Christopher Bayer , Claudio Heller

(Unsupervised) Domain Adaptation (DA) seeks for classifying target instances when solely provided with source labeled and target unlabeled examples for training. Learning domain-invariant features helps to achieve this goal, whereas it…

机器学习 · 计算机科学 2019-07-09 Ziliang Chen , Jingyu Zhuang , Xiaodan Liang , Liang Lin

In many practical applications, it is often difficult and expensive to obtain large-scale labeled data to train state-of-the-art deep neural networks. Therefore, transferring the learned knowledge from a separate, labeled source domain to…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Sicheng Zhao , Hui Chen , Hu Huang , Pengfei Xu , Guiguang Ding

Standard domain adaptation methods do not work well when a large gap exists between the source and target domains. Gradual domain adaptation is one of the approaches used to address the problem. It involves leveraging the intermediate…

机器学习 · 统计学 2024-01-24 Shogo Sagawa , Hideitsu Hino

Test-Time Adaptation (TTA) addresses domain shifts between training and testing. However, existing methods assume a homogeneous target domain (e.g., single domain) at any given time. They fail to handle the dynamic nature of real-world…

机器学习 · 计算机科学 2025-12-25 Chuyang Ye , Dongyan Wei , Zhendong Liu , Yuanyi Pang , Yixi Lin , Qinting Jiang , Jingyan Jiang , Dongbiao He

Unwanted samples from private source categories in the learning objective of a partial domain adaptation setup can lead to negative transfer and reduce classification performance. Existing methods, such as re-weighting or aggregating target…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Sandipan Choudhuri , Arunabha Sen

As a study on the efficient usage of data, Multi-source Unsupervised Domain Adaptation transfers knowledge from multiple source domains with labeled data to an unlabeled target domain. However, the distribution discrepancy between different…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Tong Xu , Lin Wang , Wu Ning , Chunyan Lyu , Kejun Wang , Chenhui Wang

The standard closed-set domain adaptation approaches seek to mitigate distribution discrepancies between two domains under the constraint of both sharing identical label sets. However, in realistic scenarios, finding an optimal source…

机器学习 · 计算机科学 2022-12-06 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen , Hemanth Venkateswara

Unsupervised domain translation has recently achieved impressive performance with Generative Adversarial Network (GAN) and sufficient (unpaired) training data. However, existing domain translation frameworks form in a disposable way where…

计算机视觉与模式识别 · 计算机科学 2019-09-11 Jianxin Lin , Yijun Wang , Tianyu He , Zhibo Chen