English
Related papers

Related papers: Adaptation Algorithm and Theory Based on Generaliz…

200 papers

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

The most basic assumption used in statistical learning theory is that training data and test data are drawn from the same underlying distribution. Unfortunately, in many applications, the "in-domain" test data is drawn from a distribution…

Machine Learning · Computer Science 2011-09-30 H. Daume , D. Marcu

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Domain adaptation aims at adapting the knowledge acquired on a source domain to a new different but related target domain. Several approaches have beenproposed for classification tasks in the unsupervised scenario, where no labeled target…

Computer Vision and Pattern Recognition · Computer Science 2015-04-30 Basura Fernando , Tatiana Tommasi , Tinne Tuytelaars

In Programming by Demonstration, the robot learns novel skills from human demonstrations. After learning, the robot should be able not only to reproduce the skill, but also to generalize it to shifted domains without collecting new training…

Robotics · Computer Science 2023-11-07 Hector Perez-Villeda , Justus Piater , Matteo Saveriano

Recent unsupervised domain adaptation methods based on deep architectures have shown remarkable performance not only in traditional classification tasks but also in more complex problems involving structured predictions (e.g. semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Levi O. Vasconcelos , Massimiliano Mancini , Davide Boscaini , Samuel Rota Bulo , Barbara Caputo , Elisa Ricci

For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. Previous deep domain adaptation methods mainly learn a global domain shift, i.e., align the global source and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Yongchun Zhu , Fuzhen Zhuang , Jindong Wang , Guolin Ke , Jingwu Chen , Jiang Bian , Hui Xiong , Qing He

We develop an algorithm to improve the performance of a pre-trained model under concept shift without retraining the model from scratch when only unannotated samples of initial concepts are accessible. We model this problem as a domain…

Machine Learning · Computer Science 2022-11-22 Mohammad Rostami , Aram Galstyan

Traditional classification algorithms assume that training and test data come from similar distributions. This assumption is violated in adversarial settings, where malicious actors modify instances to evade detection. A number of custom…

Computer Science and Game Theory · Computer Science 2016-11-29 Bo Li , Yevgeniy Vorobeychik , Xinyun Chen

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner

Traditional machine learning algorithms assume that the training and test data have the same distribution, while this assumption does not necessarily hold in real applications. Domain adaptation methods take into account the deviations in…

Machine Learning · Statistics 2019-02-26 Elif Vural

This report contributes to the field of unsupervised domain adaptation by providing an analysis of existing methods, introducing a new approach, and demonstrating the potential for improving visual recognition tasks across different…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Artem Bituitskii

Domain adaptation aims to transfer knowledge of labeled instances obtained from a source domain to a target domain to fill the gap between the domains. Most domain adaptation methods assume that the source and target domains have the same…

Machine Learning · Computer Science 2022-09-13 Toshimitsu Aritake , Hideitsu Hino

Adaptive gradient methods have achieved remarkable success in training deep neural networks on a wide variety of tasks. However, not much is known about the mathematical and statistical properties of this family of methods. This work aims…

Machine Learning · Computer Science 2021-05-18 Zhang Zhiyi , Liu Ziyin

We study a simple learning algorithm for binary classification. Instead of predicting with the best hypothesis in the hypothesis class, that is, the hypothesis that minimizes the training error, our algorithm predicts with a weighted…

Statistics Theory · Mathematics 2007-06-13 Yoav Freund , Yishay Mansour , Robert E. Schapire

Domain adaptation is widely used in learning problems lacking labels. Recent studies show that deep adversarial domain adaptation models can make markable improvements in performance, which include symmetric and asymmetric architectures.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Guanyu Cai , Yuqin Wang , Mengchu Zhou , Lianghua He

Given an existing trained neural network, it is often desirable to learn new capabilities without hindering performance of those already learned. Existing approaches either learn sub-optimal solutions, require joint training, or incur a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Amir Rosenfeld , John K. Tsotsos

This paper provides a theoretical analysis of domain adaptation based on the PAC-Bayesian theory. We propose an improvement of the previous domain adaptation bound obtained by Germain et al. in two ways. We first give another generalization…

Machine Learning · Statistics 2015-01-14 Pascal Germain , Amaury Habrard , Francois Laviolette , Emilie Morvant

Domain generalization (DG) aims to learn a generic model from multiple observed source domains that generalizes well to arbitrary unseen target domains without further training. The major challenge in DG is that the model inevitably faces a…

Machine Learning · Computer Science 2023-09-19 Jintao Guo , Lei Qi , Yinghuan Shi , Yang Gao