English
Related papers

Related papers: An Empirical Study on Preference Tuning Generaliza…

200 papers

Self-training based on pseudo-labels has emerged as a dominant approach for addressing conditional distribution shifts in unsupervised domain adaptation (UDA) for semantic segmentation problems. A notable drawback, however, is that this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Rajshekhar Das , Jonathan Francis , Sanket Vaibhav Mehta , Jean Oh , Emma Strubell , Jose Moura

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from…

Machine Learning · Statistics 2019-01-08 Jeroen Manders , Twan van Laarhoven , Elena Marchiori

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

Learning from preference labels plays a crucial role in fine-tuning large language models. There are several distinct approaches for preference fine-tuning, including supervised learning, on-policy reinforcement learning (RL), and…

Recently, domain adaptation has become a hot research area with lots of applications. The goal is to adapt a model trained in one domain to another domain with scarce annotated data. We propose a simple yet effective method based on…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Ajinkya Tejankar , Hamed Pirsiavash

We present an approach for unsupervised domain adaptation---with a strong focus on practical considerations of within-domain class imbalance and between-domain class distribution shift---from a class-conditioned domain alignment…

Machine Learning · Computer Science 2020-06-11 Xiang Jiang , Qicheng Lao , Stan Matwin , Mohammad Havaei

Measuring the similarity between two different sentential arguments is an important task in argument mining. However, one of the challenges in this field is that the dataset must be annotated using expertise in a variety of topics, making…

Computation and Language · Computer Science 2021-02-22 ChaeHun Park , Sangwoo Seo

Existing Question Answering (QA) systems limited by the capability of answering questions from unseen domain or any out-of-domain distributions making them less reliable for deployment to real scenarios. Most importantly all the existing QA…

Computation and Language · Computer Science 2023-05-10 Anant Khandelwal

Classical machine learning assumes that the training and test sets come from the same distributions. Therefore, a model learned from the labeled training data is expected to perform well on the test data. However, This assumption may not…

Machine Learning · Computer Science 2020-10-12 Abolfazl Farahani , Sahar Voghoei , Khaled Rasheed , Hamid R. Arabnia

Source-free domain adaptation (SFDA) aims to adapt a well-trained source model to an unlabelled target domain without accessing the source dataset, making it applicable in a variety of real-world scenarios. Existing SFDA methods ONLY assess…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Longxiang Tang , Kai Li , Chunming He , Yulun Zhang , Xiu Li

Prior feature transformation based approaches to Unsupervised Domain Adaptation (UDA) employ the deep features extracted by pre-trained deep models without fine-tuning them on the specific source or target domain data for a particular…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Qian Wang , Toby P. Breckon

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen

Deep learning-based solutions for semantic segmentation suffer from significant performance degradation when tested on data with different characteristics than what was used during the training. Adapting the models using annotated data from…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Xingchen Zhao , Niluthpol Chowdhury Mithun , Abhinav Rajvanshi , Han-Pang Chiu , Supun Samarasekera

Performance of a pre-trained semantic segmentation model is likely to substantially decrease on data from a new domain. We show a pre-trained model can be adapted to unlabelled target domain data by calculating soft-label prototypes under…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ondrej Bohdal , Da Li , Timothy Hospedales

Data sparsity is an inherent challenge in the recommender systems, where most of the data is collected from the implicit feedbacks of users. This causes two difficulties in designing effective algorithms: first, the majority of users only…

Information Retrieval · Computer Science 2020-07-15 Wenhui Yu , Xiao Lin , Junfeng Ge , Wenwu Ou , Zheng Qin

Extensive studies on Unsupervised Domain Adaptation (UDA) have propelled the deployment of deep learning from limited experimental datasets into real-world unconstrained domains. Most UDA approaches align features within a common embedding…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Wenxuan Ma , Jinming Zhang , Shuang Li , Chi Harold Liu , Yulin Wang , Wei Li

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Aligning large language models (LLMs) to human preferences is challenging in domains where preference data is unavailable. We address the problem of learning reward models for such target domains by leveraging feedback collected from…

Machine Learning · Computer Science 2025-01-03 David Wu , Sanjiban Choudhury