English
Related papers

Related papers: Improving Generalization of Transfer Learning Acro…

200 papers

Generalization of machine learning models trained on a set of source domains on unseen target domains with different statistics, is a challenging problem. While many approaches have been proposed to solve this problem, they only utilize…

Machine Learning · Computer Science 2021-07-20 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Domain generalization (DG) aims to learn a robust model from source domains that generalize well on unseen target domains. Recent studies focus on generating novel domain samples or features to diversify distributions complementary to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Chenming Li , Daoan Zhang , Wenjian Huang , Jianguo Zhang

Contrastive learning has shown to learn better quality representations than models trained using cross-entropy loss. They also transfer better to downstream datasets from different domains. However, little work has been done to explore the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Alvin De Jun Tan , Clement Tan , Chai Kiat Yeo

Recent breakthroughs in large language models (LLMs) have not only advanced natural language processing but also inspired their application in domains with structurally similar problems--most notably, autonomous driving motion generation.…

Artificial Intelligence · Computer Science 2025-09-04 Mingyi Wang , Jingke Wang , Tengju Ye , Junbo Chen , Kaicheng Yu

Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Hongyi Pan , Bin Wang , Zheyuan Zhang , Xin Zhu , Debesh Jha , Ahmet Enis Cetin , Concetto Spampinato , Ulas Bagci

Despite impressive performance as evaluated on i.i.d. holdout data, deep neural networks depend heavily on superficial statistics of the training data and are liable to break under distribution shift. For example, subtle changes to the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Haohan Wang , Zexue He , Zachary C. Lipton , Eric P. Xing

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Single domain generalization (Single-DG) intends to develop a generalizable model with only one single training domain to perform well on other unknown target domains. Under the domain-hungry configuration, how to expand the coverage of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jian Xu , Chaojie Ji , Yankai Cao , Ye Li , Ruxin Wang

Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo A. Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Deep learning-based intelligent vehicle perception has been developing prominently in recent years to provide a reliable source for motion planning and decision making in autonomous driving. A large number of powerful deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xinyu Liu , Jinlong Li , Jin Ma , Huiming Sun , Zhigang Xu , Tianyun Zhang , Hongkai Yu

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all…

Machine Learning · Computer Science 2022-02-16 A. Tuan Nguyen , Toan Tran , Yarin Gal , Atılım Güneş Baydin

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

Convolutional neural networks require numerous data for training. Considering the difficulties in data collection and labeling in some specific tasks, existing approaches generally use models pre-trained on a large source domain (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Zhichen Zhao , Bowen Zhang , Yuning Jiang , Li Xu , Lei Li , Wei-Ying Ma

In recent years, supervised machine learning models have demonstrated tremendous success in a variety of application domains. Despite the promising results, these successful models are data hungry and their performance relies heavily on the…

Machine Learning · Computer Science 2018-12-05 Azin Asgarian , Parinaz Sobhani , Ji Chao Zhang , Madalin Mihailescu , Ariel Sibilia , Ahmed Bilal Ashraf , Babak Taati

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

Machine Learning · Computer Science 2019-01-15 Wouter M. Kouw , Marco Loog

Through deep learning and computer vision techniques, driving manoeuvres can be predicted accurately a few seconds in advance. Even though adapting a learned model to new drivers and different vehicles is key for robust driver-assistance…

Machine Learning · Computer Science 2019-03-12 Michele Tonutti , Emanuele Ruffaldi , Alessandro Cattaneo , Carlo Alberto Avizzano

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Domain shift is a well known problem where a model trained on a particular domain (source) does not perform well when exposed to samples from a different domain (target). Unsupervised methods that can adapt to domain shift are highly…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Botos Csaba , Xiaojuan Qi , Arslan Chaudhry , Puneet Dokania , Philip Torr

Domain generalization aims to enhance the model robustness against domain shift without accessing the target domain. Since the available source domains for training are limited, recent approaches focus on generating samples of novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Seogkyu Jeon , Kibeom Hong , Pilhyeon Lee , Jewook Lee , Hyeran Byun

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

Machine Learning · Computer Science 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff
‹ Prev 1 4 5 6 7 8 10 Next ›