English
Related papers

Related papers: CLIP-Powered Domain Generalization and Domain Adap…

200 papers

Despite the remarkable performance of vision language models (VLMs) such as Contrastive Language Image Pre-training (CLIP), the large size of these models is a considerable obstacle to their use in federated learning (FL) systems where the…

Machine Learning · Computer Science 2025-03-11 Yihang Wu , Ahmad Chaddad , Christian Desrosiers , Tareef Daqqaq , Reem Kateb

Contrastive Language-Image Pre-trained (CLIP) models have zero-shot ability of classifying an image belonging to "[CLASS]" by using similarity between the image and the prompt sentence "a [CONTEXT] of [CLASS]". Based on exhaustive text cues…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Xiaofeng Mao , Yuefeng Chen , Xiaojun Jia , Rong Zhang , Hui Xue , Zhao Li

The increase of web-scale weakly labelled image-text pairs have greatly facilitated the development of large-scale vision-language models (e.g., CLIP), which have shown impressive generalization performance over a series of downstream…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Lianyu Hu , Tongkai Shi , Liqing Gao , Zekang Liu , Wei Feng

Recently, there have been breakthroughs in computer vision ("CV") models that are more generalizable with the advent of models such as CLIP and ALIGN. In this paper, we analyze CLIP and highlight some of the challenges such models pose.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Sandhini Agarwal , Gretchen Krueger , Jack Clark , Alec Radford , Jong Wook Kim , Miles Brundage

Large-scale natural image-text datasets, especially those automatically collected from the web, often suffer from loose semantic alignment due to weak supervision, while medical datasets tend to have high cross-modal correlation but low…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Shengzhu Yang , Jiawei Du , Shuai Lu , Weihang Zhang , Ningli Wang , Huiqi Li

Domain adaptation (DA) arises as an important problem in statistical machine learning when the source data used to train a model is different from the target data used to test the model. Recent advances in DA have mainly been…

Machine Learning · Statistics 2021-11-25 Yuansi Chen , Peter Bühlmann

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

Vision-language models (VLMs), e.g., CLIP, have shown remarkable potential in zero-shot image classification. However, adapting these models to new domains remains challenging, especially in unsupervised settings where labeled data is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Eman Ali , Sathira Silva , Muhammad Haris Khan

Contrastive Language-Image Pre-training (CLIP) is an approach that has advanced research and applications in computer vision, fueling modern recognition systems and generative models. We believe that the main ingredient to the success of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hu Xu , Saining Xie , Xiaoqing Ellen Tan , Po-Yao Huang , Russell Howes , Vasu Sharma , Shang-Wen Li , Gargi Ghosh , Luke Zettlemoyer , Christoph Feichtenhofer

Language-image pre-training is an effective technique for learning powerful representations in general domains. However, when directly turning to person representation learning, these general pre-training methods suffer from unsatisfactory…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jialong Zuo , Jiahao Hong , Feng Zhang , Changqian Yu , Hanyu Zhou , Changxin Gao , Nong Sang , Jingdong Wang

To adapt effectively to dynamic real-world environments, intelligent systems must continually acquire new skills while generalizing them to diverse, unseen scenarios. Here, we introduce a novel and realistic setting named domain…

Machine Learning · Computer Science 2025-10-21 Hongwei Yan , Guanglong Sun , Zhiqi Kang , Yi Zhong , Liyuan Wang

Domain adaptation (DA) techniques have the potential in machine learning to alleviate distribution differences between training and test sets by leveraging information from source domains. In image classification, most advances in DA have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Ahmad Chaddad , Yihang Wu , Reem Kateb , Christian Desrosiers

Although current face anti-spoofing methods achieve promising results under intra-dataset testing, they suffer from poor generalization to unseen attacks. Most existing works adopt domain adaptation (DA) or domain generalization (DG)…

Computer Vision and Pattern Recognition · Computer Science 2021-02-25 Jingjing Wang , Jingyi Zhang , Ying Bian , Youyi Cai , Chunmao Wang , Shiliang Pu

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Youshan Zhang , Brian D. Davison

We introduce a practical Domain Adaptation (DA) paradigm called Class-Incremental Domain Adaptation (CIDA). Existing DA methods tackle domain-shift but are unsuitable for learning novel target-domain classes. Meanwhile, class-incremental…

Machine Learning · Computer Science 2020-08-05 Jogendra Nath Kundu , Rahul Mysore Venkatesh , Naveen Venkat , Ambareesh Revanur , R. Venkatesh Babu

Capitalizing on vast amount of image-text data, large-scale vision-language pre-training has demonstrated remarkable zero-shot capabilities and has been utilized in several applications. However, models trained on general everyday…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Umair Nawaz , Muhammad Awais , Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan , Rao Muhammad Anwer

Video understanding has shown remarkable improvements in recent years, largely dependent on the availability of large scaled labeled datasets. Recent advancements in visual-language models, especially based on contrastive pretraining, have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shreyank N Gowda , Boyan Gao , Xiao Gu , Xiaobo Jin

Few-shot Test-Time Domain Adaptation focuses on adapting a model at test time to a specific domain using only a few unlabeled examples, addressing domain shift. Prior methods leverage CLIP's strong out-of-distribution (OOD) abilities by…

Machine Learning · Computer Science 2025-06-24 Zhixiang Chi , Li Gu , Huan Liu , Ziqiang Wang , Yanan Wu , Yang Wang , Konstantinos N Plataniotis

Contrastive language-image pretraining (CLIP) using image-text pairs has achieved impressive results on image classification in both zero-shot and transfer learning settings. However, we show that directly applying such models to recognize…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yiwu Zhong , Jianwei Yang , Pengchuan Zhang , Chunyuan Li , Noel Codella , Liunian Harold Li , Luowei Zhou , Xiyang Dai , Lu Yuan , Yin Li , Jianfeng Gao