中文
相关论文

相关论文: Domain-Invariant Prompt Learning for Vision-Langua…

200 篇论文

Deep learning models have achieved great success on various vision challenges, but a well-trained model would face drastic performance degradation when applied to unseen data. Since the model is sensitive to domain shift, unsupervised…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Ziyu Ye , Chen Ju , Chaofan Ma , Xiaoyun Zhang

Spread of fake news using out-of-context images and captions has become widespread in this era of information overload. Since fake news can belong to different domains like politics, sports, etc. with their unique characteristics, inference…

机器学习 · 计算机科学 2025-01-08 Amartya Bhattacharya , Debarshi Brahma , Suraj Nagaje Mahadev , Anmol Asati , Vikas Verma , Soma Biswas

Universal Multi-source Domain Adaptation (UniMDA) transfers knowledge from multiple labeled source domains to an unlabeled target domain under domain shifts (different data distribution) and class shifts (unknown target classes). Existing…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Yuxiang Yang , Lu Wen , Yuanyuan Xu , Jiliu Zhou , Yan Wang

The Contrastive Language-Image Pre-training (CLIP) has recently shown remarkable generalization on "zero-shot" training and has applied to many downstream tasks. We explore the adaptation of CLIP to achieve a more efficient and generalized…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Qiang Wang , Junlong Du , Ke Yan , Shouhong Ding

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

计算机视觉与模式识别 · 计算机科学 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Vision-language models (VLMs), e.g., CLIP, have shown remarkable potential in zero-shot image classification. However, adapting these models to new domains remains challenging, especially in unsupervised settings where labeled data is…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Eman Ali , Sathira Silva , Muhammad Haris Khan

Recent domain generalized semantic segmentation (DGSS) studies have achieved notable improvements by distilling semantic knowledge from Vision-Language Models (VLMs). However, they overlook the semantic misalignment between visual and…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Seogkyu Jeon , Kibeom Hong , Hyeran Byun

Recent contrastive language image pre-training has led to learning highly transferable and robust image representations. However, adapting these models to video domains with minimal supervision remains an open problem. We explore a simple…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Kanchana Ranasinghe , Michael Ryoo

Unpaired Image Captioning (UIC) has been developed to learn image descriptions from unaligned vision-language sample pairs. Existing works usually tackle this task using adversarial learning and visual concept reward based on reinforcement…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Peipei Zhu , Xiao Wang , Lin Zhu , Zhenglong Sun , Weishi Zheng , Yaowei Wang , Changwen Chen

Prompt tuning based on Context Optimization (CoOp) effectively adapts visual-language models (VLMs) to downstream tasks by inferring additional learnable prompt tokens. However, these tokens are less discriminative as they are independent…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Hantao Yao , Rui Zhang , Lu Yu , Yongdong Zhang , Changsheng Xu

We delve into Open Domain Generalization (ODG), marked by domain and category shifts between training's labeled source and testing's unlabeled target domains. Existing solutions to ODG face limitations due to constrained generalizations of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Mainak Singha , Ankit Jha , Shirsha Bose , Ashwin Nair , Moloud Abdar , Biplab Banerjee

Open-vocabulary semantic segmentation requires models to effectively integrate visual representations with open-vocabulary semantic labels. While Contrastive Language-Image Pre-training (CLIP) models shine in recognizing visual concepts…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Mengcheng Lan , Chaofeng Chen , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

In computer vision, fine-tuning is the de-facto approach to leverage pre-trained vision models to perform downstream tasks. However, deploying it in practice is quite challenging, due to adopting parameter inefficient global update and…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Xing Nie , Bolin Ni , Jianlong Chang , Gaomeng Meng , Chunlei Huo , Zhaoxiang Zhang , Shiming Xiang , Qi Tian , Chunhong Pan

Prompt learning is an effective way to exploit the potential of large-scale pre-trained foundational models. Continuous prompts parameterize context tokens in prompts by turning them into differentiable vectors. Deep continuous prompts…

机器学习 · 计算机科学 2025-01-03 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Prompt tuning, a parameter- and data-efficient transfer learning paradigm that tunes only a small number of parameters in a model's input space, has become a trend in the vision community since the emergence of large vision-language models…

计算机视觉与模式识别 · 计算机科学 2022-10-14 Yuhang Zang , Wei Li , Kaiyang Zhou , Chen Huang , Chen Change Loy

Large language models (LLMs) have achieved great success across diverse tasks, and fine-tuning is sometimes needed to further enhance generation quality. Most existing methods rely on human supervision or parameter retraining, both of which…

计算与语言 · 计算机科学 2025-05-27 Zhen-Yu Zhang , Jiandong Zhang , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Multi-Object Tracking (MOT) aims to associate multiple objects across video frames and is a challenging vision task due to inherent complexities in the tracking environment. Most existing approaches train and track within a single domain,…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Run Luo , Zikai Song , Longze Chen , Yunshui Li , Min Yang , Wei Yang

Pre-trained Vision-Language (VL) models such as CLIP have demonstrated their excellent performance across numerous downstream tasks. A recent method, Context Optimization (CoOp), further improves the performance of VL models on downstream…

计算与语言 · 计算机科学 2024-12-23 Biao Liu , Wenyi Fang , Xiaoyu Wu , Yang Zheng , Zheng Hu , Bo Yuan

Recent advancements in multimodal vision models have highlighted limitations in late-stage feature fusion and suboptimal query selection for hybrid prompts open-world segmentation, alongside constraints from caption-derived vocabularies. To…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Yuchen Guan , Chong Sun , Canmiao Fu , Zhipeng Huang , Chun Yuan , Chen Li

Cross-Domain Recommendation (CDR) stands as a pivotal technology addressing issues of data sparsity and cold start by transferring general knowledge from the source to the target domain. However, existing CDR models suffer limitations in…

信息检索 · 计算机科学 2023-10-23 Bowen Hao , Chaoqun Yang , Lei Guo , Junliang Yu , Hongzhi Yin