English
Related papers

Related papers: Target Robust Discriminant Analysis

200 papers

Recent advances in domain adaptation establish that requiring a low risk on the source domain and equal feature marginals degrade the adaptation's performance. At the same time, empirical evidence shows that incorporating an unsupervised…

Machine Learning · Computer Science 2022-03-11 Sofien Dhouib , Setareh Maghsudi

In this paper, we propose energy-based sample adaptation at test time for domain generalization. Where previous works adapt their models to target domains, we adapt the unseen target samples to source-trained models. To this end, we design…

Machine Learning · Computer Science 2023-02-23 Zehao Xiao , Xiantong Zhen , Shengcai Liao , Cees G. M. Snoek

Unsupervised domain adaptation~(UDA) aims at reducing the distribution discrepancy when transferring knowledge from a labeled source domain to an unlabeled target domain. Previous UDA methods assume that the source and target domains share…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Chuan-Xian Ren , Pengfei Ge , Peiyi Yang , Shuicheng Yan

Though feature-alignment based Domain Adaptive Object Detection (DAOD) methods have achieved remarkable progress, they ignore the source bias issue, i.e., the detector tends to acquire more source-specific knowledge, impeding its…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Yongchao Feng , Shiwei Li , Yingjie Gao , Ziyue Huang , Yanan Zhang , Qingjie Liu , Yunhong Wang

Domain adaptation performance of a learning algorithm on a target domain is a function of its source domain error and a divergence measure between the data distribution of these two domains. We present a study of various distance-based…

Computation and Language · Computer Science 2020-03-05 Han Guo , Ramakanth Pasunuru , Mohit Bansal

We propose a framework for adversarial training that relies on a sample rather than a single sample point as the fundamental unit of discrimination. Inspired by discrepancy measures and two-sample tests between probability distributions, we…

Machine Learning · Computer Science 2017-07-11 Chengtao Li , David Alvarez-Melis , Keyulu Xu , Stefanie Jegelka , Suvrit Sra

Domain adaptation is crucial in many real-world applications where the distribution of the training data differs from the distribution of the test data. Previous Deep Learning-based approaches to domain adaptation need to be trained jointly…

Computation and Language · Computer Science 2017-02-08 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Self-supervised pre-training with contrastive learning is a powerful method for learning from sparsely labeled data. However, performance can drop considerably when there is a shift in the distribution of data from training to test time. We…

Machine Learning · Computer Science 2026-01-13 Robert Lewis , Katie Matton , Rosalind W. Picard , John Guttag

Unsupervised Domain Adaptation aims to learn a model on a source domain with labeled data in order to perform well on unlabeled data of a target domain. Current approaches focus on learning \textit{Domain Invariant Representations}. It…

Machine Learning · Computer Science 2019-07-30 Victor Bouvier , Philippe Very , Céline Hudelot , Clément Chastagnol

Standard domain adaptation methods do not work well when a large gap exists between the source and target domains. Gradual domain adaptation is one of the approaches used to address the problem. It involves leveraging the intermediate…

Machine Learning · Statistics 2024-01-24 Shogo Sagawa , Hideitsu Hino

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

In malware behavioral analysis, the list of accessed and created files very often indicates whether the examined file is malicious or benign. However, malware authors are trying to avoid detection by generating random filenames and/or…

Machine Learning · Computer Science 2021-10-26 Marek Galovic , Branislav Bosansky , Viliam Lisy

In this paper, we invest the domain transfer learning problem with multi-instance data. We assume we already have a well-trained multi-instance dictionary and its corresponding classifier from the source domain, which can be used to…

Computer Vision and Pattern Recognition · Computer Science 2016-05-27 Ke Wang , Jiayong Liu , Daniel González

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

Machine Learning · Computer Science 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Current approaches which are mainly based on the extraction of low-level relations among individual events are limited by the shortage of publicly available labelled data. Therefore, the resulting models perform poorly when applied to a…

Computation and Language · Computer Science 2020-11-30 Farhad Moghimifar , Gholamreza Haffari , Mahsa Baktashmotlagh

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

Machine Learning · Computer Science 2018-10-31 Alexander Matyasko , Lap-Pui Chau

This paper addresses unsupervised domain adaptation, the setting where labeled training data is available on a source domain, but the goal is to have good performance on a target domain with only unlabeled data. Like much of previous work,…

Machine Learning · Computer Science 2019-10-01 Yu Sun , Eric Tzeng , Trevor Darrell , Alexei A. Efros

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

Most research designing novel predictive models, or employing existing ones, assumes that training and testing data are independent and identically distributed. In practice, the data encountered at serving time often deviate from the…

Machine Learning · Computer Science 2026-03-30 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

Neural networks are known to be data hungry and domain sensitive, but it is nearly impossible to obtain large quantities of labeled data for every domain we are interested in. This necessitates the use of domain adaptation strategies. One…

Computation and Language · Computer Science 2019-10-08 Zi-Yi Dou , Xinyi Wang , Junjie Hu , Graham Neubig