English
Related papers

Related papers: Understanding Self-Training for Gradual Domain Ada…

200 papers

Machine learning is driven by data, yet while their availability is constantly increasing, training data require laborious, time consuming and error-prone labelling or ground truth acquisition, which in some cases is very difficult or even…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Vasileios Gkitsas , Antonis Karakottas , Nikolaos Zioulis , Dimitrios Zarpalas , Petros Daras

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

Unsupervised domain adaptation (UDA) has become increasingly prevalent in scene text recognition (STR), especially where training and testing data reside in different domains. The efficacy of existing UDA approaches tends to degrade when…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kha Nhat Le , Hoang-Tuan Nguyen , Hung Tien Tran , Thanh Duc Ngo

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

Traditional deep learning algorithms often fail to generalize when they are tested outside of the domain of the training data. The issue can be mitigated by using unlabeled data from the target domain at training time, but because data…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

Machine Learning · Computer Science 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner

Domain adaptation aims at improving model performance by leveraging the learned knowledge in the source domain and transferring it to the target domain. Recently, domain adversarial methods have been particularly successful in alleviating…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Qin Wang , Gabriel Michau , Olga Fink

Classifiers trained on given databases perform poorly when tested on data acquired in different settings. This is explained in domain adaptation through a shift among distributions of the source and target domains. Attempts to align them…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Fabio Maria Carlucci , Lorenzo Porzi , Barbara Caputo , Elisa Ricci , Samuel Rota Bulò

This thesis contributes to the mathematical foundation of domain adaptation as emerging field in machine learning. In contrast to classical statistical learning, the framework of domain adaptation takes into account deviations between…

Machine Learning · Statistics 2020-04-23 Werner Zellinger

Self-training is an important class of unsupervised domain adaptation (UDA) approaches that are used to mitigate the problem of domain shift, when applying knowledge learned from a labeled source domain to unlabeled and heterogeneous target…

Image and Video Processing · Electrical Eng. & Systems 2023-05-25 Xiaofeng Liu , Jerry L. Prince , Fangxu Xing , Jiachen Zhuo , Reese Timothy , Maureen Stone , Georges El Fakhri , Jonghye Woo

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

Machine Learning · Computer Science 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

A commercial robot, trained by its manufacturer to recognize a predefined number and type of objects, might be used in many settings, that will in general differ in their illumination conditions, background, type and degree of clutter, and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Gabriele Angeletti , Barbara Caputo , Tatiana Tommasi

Neural networks are known to be data hungry and domain sensitive, but it is nearly impossible to obtain large quantities of labeled data for every domain we are interested in. This necessitates the use of domain adaptation strategies. One…

Computation and Language · Computer Science 2019-10-08 Zi-Yi Dou , Xinyi Wang , Junjie Hu , Graham Neubig

In domain adaptation, when there is a large distance between the source and target domains, the prediction performance will degrade. Gradual domain adaptation is one of the solutions to such an issue, assuming that we have access to…

Machine Learning · Statistics 2022-11-11 Shogo Sagawa , Hideitsu Hino

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Our goal is to improve reliability of Machine Learning (ML) systems deployed in the wild. ML models perform exceedingly well when test examples are similar to train examples. However, real-world applications are required to perform on any…

Machine Learning · Computer Science 2023-03-07 Vihari Piratla

Machine learning algorithms have revolutionized different fields, including natural language processing, computer vision, signal processing, and medical data processing. Despite the excellent capabilities of machine learning algorithms in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Gita Sarafraz , Armin Behnamnia , Mehran Hosseinzadeh , Ali Balapour , Amin Meghrazi , Hamid R. Rabiee