中文
相关论文

相关论文: Beyond Sole Strength: Customized Ensembles for Gen…

200 篇论文

Pretrained vision-language models (VLMs), e.g., CLIP, demonstrate impressive zero-shot capabilities on downstream tasks. Prior research highlights the crucial role of visual augmentation techniques, like random cropping, in alignment with…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Lincan Cai , Jingxuan Kang , Shuang Li , Wenxuan Ma , Binhui Xie , Zhida Qin , Jian Liang

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

计算与语言 · 计算机科学 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

Pre-trained multi-modal vision-language models (VLMs) are becoming increasingly popular due to their exceptional performance on downstream vision applications, particularly in the few- and zero-shot settings. However, selecting the…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Orr Zohar , Shih-Cheng Huang , Kuan-Chieh Wang , Serena Yeung

Visual language models (VLMs) rapidly progressed with the recent success of large language models. There have been growing efforts on visual instruction tuning to extend the LLM with visual inputs, but lacks an in-depth study of the visual…

计算机视觉与模式识别 · 计算机科学 2024-05-20 Ji Lin , Hongxu Yin , Wei Ping , Yao Lu , Pavlo Molchanov , Andrew Tao , Huizi Mao , Jan Kautz , Mohammad Shoeybi , Song Han

Vision language models (VLMs) demonstrate impressive capabilities in visual question answering and image captioning, acting as a crucial link between visual and language models. However, existing open-source VLMs heavily rely on pretrained…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Aristeidis Panos , Rahaf Aljundi , Daniel Olmeda Reino , Richard E Turner

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Samarth Singhal , Sandeep Singhal

Large-scale vision-language pre-trained (VLP) models (e.g., CLIP) are renowned for their versatility, as they can be applied to diverse applications in a zero-shot setup. However, when these models are used in specific domains, their…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Anh-Quan Cao , Maximilian Jaritz , Matthieu Guillaumin , Raoul de Charette , Loris Bazzani

Recent advances in large language and vision-language models have enabled zero-shot inference, allowing models to solve new tasks without task-specific training. Various adaptation techniques such as prompt engineering, In-Context Learning…

机器学习 · 计算机科学 2025-04-04 Artyom Gadetsky , Andrei Atanov , Yulun Jiang , Zhitong Gao , Ghazal Hosseini Mighan , Amir Zamir , Maria Brbic

Vision-Language Models (VLMs), such as CLIP, have significantly advanced zero-shot image recognition. However, their performance remains limited by suboptimal prompt engineering and poor adaptability to target classes. While recent methods…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Hui Liu , Kecheng Chen , Jialiang Wang , Xianming Liu , Wenya Wang , Haoliang Li

Current Large Vision Language Models (LVLMs) excel at many zero-shot tasks like image captioning, visual question answering and OCR. However, these same models suffer from poor performance at image classification tasks, underperforming…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Adhemar de Senneville , Xavier Bou , Jérémy Anger , Rafael Grompone , Gabriele Facciolo

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

计算机视觉与模式识别 · 计算机科学 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

Pre-trained Vision-language (VL) models, such as CLIP, have shown significant generalization ability to downstream tasks, even with minimal fine-tuning. While prompt learning has emerged as an effective strategy to adapt pre-trained VL…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Niloufar Alipour Talemi , Hossein Kashiani , Fatemeh Afghah

Vision-language pre-training like CLIP has shown promising performance on various downstream tasks such as zero-shot image classification and image-text retrieval. Most of the existing CLIP-alike works usually adopt relatively large image…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Ying Nie , Wei He , Kai Han , Yehui Tang , Tianyu Guo , Fanyi Du , Yunhe Wang

Vision-language models and their adaptations to image segmentation tasks present enormous potential for producing highly accurate and interpretable results. However, implementations based on CLIP and BiomedCLIP are still lagging behind more…

图像与视频处理 · 电气工程与系统科学 2025-09-08 Julia Dietlmeier , Oluwabukola Grace Adegboro , Vayangi Ganepola , Claudia Mazo , Noel E. O'Connor

Contrastive pretrained large Vision-Language Models (VLMs) like CLIP have revolutionized visual representation learning by providing good performance on downstream datasets. VLMs are 0-shot adapted to a downstream dataset by designing…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Mayug Maniparambil , Chris Vorster , Derek Molloy , Noel Murphy , Kevin McGuinness , Noel E. O'Connor

Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, their deployment in risk-sensitive areas requires a deeper…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Weijie Tu , Weijian Deng , Dylan Campbell , Stephen Gould , Tom Gedeon

Vision-Language Models (VLMs) represent a significant breakthrough in artificial intelligence by integrating visual and textual modalities to achieve impressive zero-shot capabilities. However, VLMs are susceptible to catastrophic…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Haoyuan Gao , Zicong Zhang , Yuqi Wei , Linglan Zhao , Guilin Li , Yexin Li , Bo Wang , Linghe Kong , Weiran Huang

Pre-trained vision-language models, such as CLIP, show impressive zero-shot recognition ability and can be easily transferred to specific downstream tasks via prompt tuning, even with limited training data. However, existing prompt tuning…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Yuqi Peng , Pengfei Wang , Jianzhuang Liu , Shifeng Chen

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen