English
Related papers

Related papers: CLIP-Powered Domain Generalization and Domain Adap…

200 papers

Contrastive Language-Image Pretraining (CLIP) achieves strong generalization in vision-language tasks by aligning images and texts in a shared embedding space. However, recent findings show that CLIP-like models still underutilize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Weiheng Zhao , Zilong Huang , Jiashi Feng , Xinggang Wang

In multi-label classification, machine learning encounters the challenge of domain generalization when handling tasks with distributions differing from the training data. Existing approaches primarily focus on vision object recognition and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuxin Qiao , Keqin Li , Junhong Lin , Rong Wei , Chufeng Jiang , Yang Luo , Haoyu Yang

Domain Adaptation (DA) techniques are important for overcoming the domain shift between the source domain used for training and the target domain where testing takes place. However, current DA methods assume that the entire target domain is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Abu Md Niamul Taufique , Chowdhury Sadman Jahan , Andreas Savakis

Learning domain-invariant visual representations is important to train a model that can generalize well to unseen target task domains. Recent works demonstrate that text descriptions contain high-level class-discriminative information and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Nokyung Park , Daewon Chae , Jeongyong Shim , Sangpil Kim , Eun-Sol Kim , Jinkyu Kim

In the era of foundation models, CLIP has emerged as a powerful tool for aligning text & visual modalities into a common embedding space. However, the alignment objective used to train CLIP often results in subpar visual features for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Mohamed Fazli Imam , Rufael Fedaku Marew , Jameel Hassan , Mustansar Fiaz , Alham Fikri Aji , Hisham Cholakkal

Top-performing deep architectures are trained on massive amounts of labeled data. In the absence of labeled data for a certain task, domain adaptation often provides an attractive option given that labeled data of similar nature but from a…

Machine Learning · Statistics 2015-03-02 Yaroslav Ganin , Victor Lempitsky

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

As a general-purpose vision-language pretraining model, CLIP demonstrates strong generalization ability in image-text alignment tasks and has been widely adopted in downstream applications such as image classification and image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kuanrong Liu , Siyuan Liang , Cheng Qian , Ming Zhang , Xiaochun Cao

Domain adaptation is pivotal for enabling deep learning models to generalize across diverse domains, a task complicated by variations in presentation and cognitive nuances. In this paper, we introduce AD-Aligning, a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zhuoying Li , Bohua Wan , Cong Mu , Ruzhang Zhao , Shushan Qiu , Chao Yan

Vision-Language models like CLIP have been widely adopted for various tasks due to their impressive zero-shot capabilities. However, CLIP is not suitable for extracting 3D geometric features as it was trained on only images and text by…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Deepti Hegde , Jeya Maria Jose Valanarasu , Vishal M. Patel

Existing studies of training state-of-the-art Contrastive Language-Image Pretraining (CLIP) models on large-scale data involve hundreds of or even thousands of GPUs due to the requirement of a large batch size. However, such a large amount…

Machine Learning · Computer Science 2024-10-03 Xiyuan Wei , Fanjiang Ye , Ori Yonay , Xingyu Chen , Baixi Sun , Dingwen Tao , Tianbao Yang

Transfer learning enables the sharing of common knowledge among models for a variety of downstream tasks, but traditional methods suffer in limited training data settings and produce narrow models incapable of effectively generalizing under…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Kevin Vogt-Lowell , Noah Lee , Theodoros Tsiligkaridis , Marc Vaillant

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui

Deep domain adaption has emerged as a new learning technique to address the lack of massive amounts of labeled data. Compared to conventional methods, which learn shared feature subspaces or reuse important source instances with shallow…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Mei Wang , Weihong Deng

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

In AI-based histopathology, domain shifts are common and well-studied. However, this research focuses on stain and scanner variations, which do not show the full picture -- shifts may be combinations of other shifts, or "invisible" shifts…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Andrew Walker

Most existing studies on unsupervised domain adaptation (UDA) assume that each domain's training samples come with domain labels (e.g., painting, photo). Samples from each domain are assumed to follow the same distribution and the domain…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Zhongying Deng , Kaiyang Zhou , Da Li , Junjun He , Yi-Zhe Song , Tao Xiang

Household environments are visually diverse. Embodied agents performing Vision-and-Language Navigation (VLN) in the wild must be able to handle this diversity, while also following arbitrary language instructions. Recently, Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Vishnu Sashank Dorbala , Gunnar Sigurdsson , Robinson Piramuthu , Jesse Thomason , Gaurav S. Sukhatme

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

Gaze estimation methods often experience significant performance degradation when evaluated across different domains, due to the domain gap between the testing and training data. Existing methods try to address this issue using various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Pengwei Yin , Guanzhong Zeng , Jingjing Wang , Di Xie