English
Related papers

Related papers: Holistic Transfer: Towards Non-Disruptive Fine-Tun…

200 papers

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Recently,the detection transformer has gained substantial attention for its inherent minimal post-processing requirement.However,this paradigm relies on abundant training data,yet in the context of the cross-domain adaptation,insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ziru Zeng , Yue Ding , Hongtao Lu

While recent studies on semi-supervised learning have shown remarkable progress in leveraging both labeled and unlabeled data, most of them presume a basic setting of the model is randomly initialized. In this work, we consider…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Abulikemu Abuduweili , Xingjian Li , Humphrey Shi , Cheng-Zhong Xu , Dejing Dou

Domain adaptation addresses the problem created when training data is generated by a so-called source distribution, but test data is generated by a significantly different target distribution. In this work, we present approximate label…

Machine Learning · Computer Science 2017-03-03 Jordan T. Ash , Robert E. Schapire , Barbara E. Engelhardt

We aim for source-free domain adaptation, where the task is to deploy a model pre-trained on source domains to target domains. The challenges stem from the distribution shift from the source to the target domain, coupled with the…

Machine Learning · Computer Science 2022-10-20 Mengmeng Jing , Xiantong Zhen , Jingjing Li , Cees G. M. Snoek

Despite the progress seen in classification methods, current approaches for handling videos with distribution shifts in source and target domains remain source-dependent as they require access to the source data during the adaptation stage.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Avijit Dasgupta , C. V. Jawahar , Karteek Alahari

Numerous algorithms have been proposed for transferring knowledge from a label-rich domain (source) to a label-scarce domain (target). Almost all of them are proposed for a closed-set scenario, where the source and the target domain…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Kuniaki Saito , Shohei Yamamoto , Yoshitaka Ushiku , Tatsuya Harada

Generalized Category Discovery is a crucial real-world task. Despite the improved performance on known categories, current methods perform poorly on novel categories. We attribute the poor performance to two reasons: biased knowledge…

Computation and Language · Computer Science 2023-12-29 Wenbin An , Feng Tian , Wenkai Shi , Yan Chen , Yaqiang Wu , Qianying Wang , Ping Chen

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

Machine Learning · Computer Science 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

If our models are used in new or unexpected cases, do we know if they will make fair predictions? Previously, researchers developed ways to debias a model for a single problem domain. However, this is often not how models are trained and…

Machine Learning · Computer Science 2019-11-18 Candice Schumann , Xuezhi Wang , Alex Beutel , Jilin Chen , Hai Qian , Ed H. Chi

Since annotating and curating large datasets is very expensive, there is a need to transfer the knowledge from existing annotated datasets to unlabelled data. Data that is relevant for a specific application, however, usually differs from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Pau Panareda Busto , Ahsan Iqbal , Juergen Gall

Domain Adaptation methodologies have shown to effectively generalize from a labeled source domain to a label scarce target domain. Previous research has either focused on unlabeled domain adaptation without any target supervision or…

Machine Learning · Computer Science 2022-02-14 Jonas Sonntag , Gunnar Behrens , Lars Schmidt-Thieme

This paper proposes an importance weighted adversarial nets-based method for unsupervised domain adaptation, specific for partial domain adaptation where the target domain has less number of classes compared to the source domain. Previous…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Zewei Ding , Wanqing Li , Philip Ogunbona

In recent years, supervised machine learning models have demonstrated tremendous success in a variety of application domains. Despite the promising results, these successful models are data hungry and their performance relies heavily on the…

Machine Learning · Computer Science 2018-12-05 Azin Asgarian , Parinaz Sobhani , Ji Chao Zhang , Madalin Mihailescu , Ariel Sibilia , Ahmed Bilal Ashraf , Babak Taati

Recent works of multi-source domain adaptation focus on learning a domain-agnostic model, of which the parameters are static. However, such a static model is difficult to handle conflicts across multiple domains, and suffers from a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yunsheng Li , Lu Yuan , Yinpeng Chen , Pei Wang , Nuno Vasconcelos

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Partial domain adaptation which assumes that the unknown target label space is a subset of the source label space has attracted much attention in computer vision. Despite recent progress, existing methods often suffer from three key…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Aadarsh Sahoo , Rameswar Panda , Rogerio Feris , Kate Saenko , Abir Das

The primary objective of domain adaptation methods is to transfer knowledge from a source domain to a target domain that has similar but different data distributions. Thus, in order to correctly classify the unlabeled target domain samples,…

Machine Learning · Computer Science 2019-08-12 Rohith AP , Ambedkar Dukkipati , Gaurav Pandey

Domain adaptation for visual recognition has undergone great progress in the past few years. Nevertheless, most existing methods work in the so-called closed-set scenario, assuming that the classes depicted by the target images are exactly…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Mahsa Baktashmotlagh , Masoud Faraki , Tom Drummond , Mathieu Salzmann