English
Related papers

Related papers: BiCLIP: Domain Canonicalization via Structured Geo…

200 papers

Remote sensing applications increasingly rely on deep learning for scene classification. However, their performance is often constrained by the scarcity of labeled data and the high cost of annotation across diverse geographic and sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Ivica Dimitrovski , Vlatko Spasev , Ivan Kitanovski

Recent advancements in deep learning methods have significantly improved the performance of 3D Human Pose Estimation (HPE). However, performance degradation caused by domain gaps between source and target domains remains a major challenge…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Hoosang Lee , Jeha Ryu

Pre-trained vision-language models, e.g., CLIP, have been successfully applied to zero-shot semantic segmentation. Existing CLIP-based approaches primarily utilize visual features from the last layer to align with text embeddings, while…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yunheng Li , ZhongYu Li , Quansheng Zeng , Qibin Hou , Ming-Ming Cheng

In many applications, we desire neural networks to exhibit invariance or equivariance to certain groups due to symmetries inherent in the data. Recently, frame-averaging methods emerged to be a unified framework for attaining symmetries…

Machine Learning · Computer Science 2024-11-05 George Ma , Yifei Wang , Derek Lim , Stefanie Jegelka , Yisen Wang

Pre-trained vision-language models (e.g., CLIP) have shown powerful zero-shot transfer capabilities. But they still struggle with domain shifts and typically require labeled data to adapt to downstream tasks, which could be costly. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Jiachen Liang , Ruibing Hou , Minyang Hu , Hong Chang , Shiguang Shan , Xilin Chen

Image geolocalization is the challenging task of predicting the geographic coordinates of origin for a given photo. It is an unsolved problem relying on the ability to combine visual clues with general knowledge about the world to make…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Lukas Haas , Silas Alberti , Michal Skreta

Vision-Language Models (VLMs), particularly CLIP, have revolutionized anomaly detection by enabling zero-shot and few-shot defect identification without extensive labeled datasets. By learning aligned representations of images and text,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mohit Kakda , Mirudula Shri Muthukumaran , Uttapreksha Patel , Lawrence Swaminathan Xavier Prince

Few-shot Generalist Anomaly Detection requires models to generalize to novel categories without retraining, posing significant challenges in real-world scenarios with scarce samples and rapidly changing categories. Existing CLIP-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Xinyue Liu , Jianyuan Wang , Biao Leng , Shuo Zhang

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot capabilities in various computer vision tasks. However, their application to medical imaging remains challenging due to the high variability and complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xusheng Liang , Lihua Zhou , Nianxin Li , Miao Xu , Ziyang Song , Dong Yi , Jinlin Wu , Jiawei Ma , Hongbin Liu , Zhen Lei , Jiebo Luo

Fine-grained image classification, particularly in zero/few-shot scenarios, presents a significant challenge for vision-language models (VLMs), such as CLIP. These models often struggle with the nuanced task of distinguishing between…

Computation and Language · Computer Science 2024-05-21 Canshi Wei

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Image Anomaly Detection has been a challenging task in Computer Vision field. The advent of Vision-Language models, particularly the rise of CLIP-based frameworks, has opened new avenues for zero-shot anomaly detection. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhaoxiang Zhang , Hanqiu Deng , Jinan Bao , Xingyu Li

Although significant progress has been made in few-shot learning, most of existing few-shot image classification methods require supervised pre-training on a large amount of samples of base classes, which limits their generalization ability…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Fang Peng , Xiaoshan Yang , Linhui Xiao , Yaowei Wang , Changsheng Xu

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Vision-language models (VLMs) like CLIP have shown impressive zero-shot and few-shot learning capabilities across diverse applications. However, adapting these models to new fine-grained domains remains difficult due to reliance on prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Taha Koleilat , Hassan Rivaz , Yiming Xiao

This study presents a control framework leveraging vision language models (VLMs) for multiple tasks and robots. Notably, existing control methods using VLMs have achieved high performance in various tasks and robots in the training…

Robotics · Computer Science 2024-01-19 Kazuki Shibata , Hideki Deguchi , Shun Taguchi

Few-shot Test-Time Domain Adaptation focuses on adapting a model at test time to a specific domain using only a few unlabeled examples, addressing domain shift. Prior methods leverage CLIP's strong out-of-distribution (OOD) abilities by…

Machine Learning · Computer Science 2025-06-24 Zhixiang Chi , Li Gu , Huan Liu , Ziqiang Wang , Yanan Wu , Yang Wang , Konstantinos N Plataniotis

Vision-language models such as CLIP are capable of mapping the different modality data into a unified feature space, enabling zero/few-shot inference by measuring the similarity of given images and texts. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Vision-Language Models (VLMs) like CLIP achieve cross-modal semantic alignment through contrastive learning, exhibiting robust zero-shot generalization. Traditional prompt engineering, however, predominantly relies on coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Leyan Xue , Zongbo Han , Guangyu Wang , Qinghua Hu , Mingyue Cheng , Changqing Zhang

Recent advances in fine-tuning Vision-Language Models (VLMs) have witnessed the success of prompt tuning and adapter tuning, while the classic model fine-tuning on inherent parameters seems to be overlooked. It is believed that fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Li , Jike Zhong , Chenxin Li , Liuzhuozheng Li , Nie Lin , Masashi Sugiyama