English
Related papers

Related papers: Adaptation Algorithm and Theory Based on Generaliz…

200 papers

A key problem in a variety of applications is that of domain adaptation from a public source domain, for which a relatively large amount of labeled data with no privacy constraints is at one's disposal, to a private target domain, for which…

Machine Learning · Computer Science 2022-08-15 Raef Bassily , Mehryar Mohri , Ananda Theertha Suresh

We introduce the technique of adaptive discretization to design an efficient model-based episodic reinforcement learning algorithm in large (potentially continuous) state-action spaces. Our algorithm is based on optimistic one-step value…

Machine Learning · Computer Science 2020-10-26 Sean R. Sinclair , Tianyu Wang , Gauri Jain , Siddhartha Banerjee , Christina Lee Yu

Domain Generalization (DG) research has gained considerable traction as of late, since the ability to generalize to unseen data distributions is a requirement that eludes even state-of-the-art training algorithms. In this paper we observe…

Machine Learning · Computer Science 2025-07-22 Aristotelis Ballas , Christos Diou

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

We present a powerful general framework for designing data-dependent optimization algorithms, building upon and unifying recent techniques in adaptive regularization, optimistic gradient predictions, and problem-dependent randomization. We…

Machine Learning · Statistics 2015-10-14 Mehryar Mohri , Scott Yang

Existing domain adaptation methods aim to reduce the distributional difference between the source and target domains and respect their specific discriminative information, by establishing the Maximum Mean Discrepancy (MMD) and the…

Machine Learning · Computer Science 2020-07-03 Wei Wang , Haojie Li , Zhengming Ding , Zhihui Wang

This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new…

Machine Learning · Computer Science 2018-05-23 Judy Hoffman , Mehryar Mohri , Ningshan Zhang

Domain adaptation enables the learner to safely generalize into novel environments by mitigating domain shifts across distributions. Previous works may not effectively uncover the underlying reasons that would lead to the drastic model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Ruijia Xu , Guanbin Li , Jihan Yang , Liang Lin

Domain adaptation (DA) and domain generalization (DG) have emerged as a solution to the domain shift problem where the distribution of the source and target data is different. The task of DG is more challenging than DA as the target data is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

In this work, we present a novel upper bound of target error to address the problem for unsupervised domain adaptation. Recent studies reveal that a deep neural network can learn transferable features which generalize well to novel tasks.…

Machine Learning · Computer Science 2019-10-07 Dexuan Zhang , Tatsuya Harada

Domain adaptation, a pivotal branch of transfer learning, aims to enhance the performance of machine learning models when deployed in target domains with distinct data distributions. This is particularly critical for object detection tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Helia Mohamadi , Mohammad Ali Keyvanrad , Mohammad Reza Mohammadi

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

The insertion of deep learning in medical image analysis had lead to the development of state-of-the art strategies in several applications such a disease classification, as well as abnormality detection and segmentation. However, even the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Mauricio Orbes-Arteaga , Thomas Varsavsky , Lauge Sorensen , Mads Nielsen , Akshay Pai , Sebastien Ourselin , Marc Modat , M Jorge Cardoso

In this paper, we propose a new feature selection method for unsupervised domain adaptation based on the emerging optimal transportation theory. We build upon a recent theoretical analysis of optimal transport in domain adaptation and show…

Machine Learning · Computer Science 2018-06-29 Léo Gautheron , Ievgen Redko , Carole Lartizien

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

One of the basic principles of Approximation Theory is that the quality of approximations increase with the smoothness of the function to be approximated. Functions that are smooth in certain subdomains will have good approximations in…

Numerical Analysis · Mathematics 2016-12-23 Licia Lenarduzzi , Robert Schaback

Adversarial training based on the maximum classifier discrepancy between two classifier structures has achieved great success in unsupervised domain adaptation tasks for image classification. The approach adopts the structure of two…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yiju Yang , Taejoon Kim , Guanghui Wang