English
Related papers

Related papers: Beyond Sole Strength: Customized Ensembles for Gen…

200 papers

Pretrained vision-language models (VLMs), e.g., CLIP, demonstrate impressive zero-shot capabilities on downstream tasks. Prior research highlights the crucial role of visual augmentation techniques, like random cropping, in alignment with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Lincan Cai , Jingxuan Kang , Shuang Li , Wenxuan Ma , Binhui Xie , Zhida Qin , Jian Liang

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

Computation and Language · Computer Science 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

Pre-trained multi-modal vision-language models (VLMs) are becoming increasingly popular due to their exceptional performance on downstream vision applications, particularly in the few- and zero-shot settings. However, selecting the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Orr Zohar , Shih-Cheng Huang , Kuan-Chieh Wang , Serena Yeung

Visual language models (VLMs) rapidly progressed with the recent success of large language models. There have been growing efforts on visual instruction tuning to extend the LLM with visual inputs, but lacks an in-depth study of the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Ji Lin , Hongxu Yin , Wei Ping , Yao Lu , Pavlo Molchanov , Andrew Tao , Huizi Mao , Jan Kautz , Mohammad Shoeybi , Song Han

Vision language models (VLMs) demonstrate impressive capabilities in visual question answering and image captioning, acting as a crucial link between visual and language models. However, existing open-source VLMs heavily rely on pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Aristeidis Panos , Rahaf Aljundi , Daniel Olmeda Reino , Richard E Turner

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

Large-scale vision-language pre-trained (VLP) models (e.g., CLIP) are renowned for their versatility, as they can be applied to diverse applications in a zero-shot setup. However, when these models are used in specific domains, their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Anh-Quan Cao , Maximilian Jaritz , Matthieu Guillaumin , Raoul de Charette , Loris Bazzani

Recent advances in large language and vision-language models have enabled zero-shot inference, allowing models to solve new tasks without task-specific training. Various adaptation techniques such as prompt engineering, In-Context Learning…

Machine Learning · Computer Science 2025-04-04 Artyom Gadetsky , Andrei Atanov , Yulun Jiang , Zhitong Gao , Ghazal Hosseini Mighan , Amir Zamir , Maria Brbic

Vision-Language Models (VLMs), such as CLIP, have significantly advanced zero-shot image recognition. However, their performance remains limited by suboptimal prompt engineering and poor adaptability to target classes. While recent methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hui Liu , Kecheng Chen , Jialiang Wang , Xianming Liu , Wenya Wang , Haoliang Li

Current Large Vision Language Models (LVLMs) excel at many zero-shot tasks like image captioning, visual question answering and OCR. However, these same models suffer from poor performance at image classification tasks, underperforming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Adhemar de Senneville , Xavier Bou , Jérémy Anger , Rafael Grompone , Gabriele Facciolo

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

Pre-trained Vision-language (VL) models, such as CLIP, have shown significant generalization ability to downstream tasks, even with minimal fine-tuning. While prompt learning has emerged as an effective strategy to adapt pre-trained VL…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Niloufar Alipour Talemi , Hossein Kashiani , Fatemeh Afghah

Vision-language pre-training like CLIP has shown promising performance on various downstream tasks such as zero-shot image classification and image-text retrieval. Most of the existing CLIP-alike works usually adopt relatively large image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Ying Nie , Wei He , Kai Han , Yehui Tang , Tianyu Guo , Fanyi Du , Yunhe Wang

Vision-language models and their adaptations to image segmentation tasks present enormous potential for producing highly accurate and interpretable results. However, implementations based on CLIP and BiomedCLIP are still lagging behind more…

Image and Video Processing · Electrical Eng. & Systems 2025-09-08 Julia Dietlmeier , Oluwabukola Grace Adegboro , Vayangi Ganepola , Claudia Mazo , Noel E. O'Connor

Contrastive pretrained large Vision-Language Models (VLMs) like CLIP have revolutionized visual representation learning by providing good performance on downstream datasets. VLMs are 0-shot adapted to a downstream dataset by designing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Mayug Maniparambil , Chris Vorster , Derek Molloy , Noel Murphy , Kevin McGuinness , Noel E. O'Connor

Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, their deployment in risk-sensitive areas requires a deeper…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weijie Tu , Weijian Deng , Dylan Campbell , Stephen Gould , Tom Gedeon

Vision-Language Models (VLMs) represent a significant breakthrough in artificial intelligence by integrating visual and textual modalities to achieve impressive zero-shot capabilities. However, VLMs are susceptible to catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Haoyuan Gao , Zicong Zhang , Yuqi Wei , Linglan Zhao , Guilin Li , Yexin Li , Bo Wang , Linghe Kong , Weiran Huang

Pre-trained vision-language models, such as CLIP, show impressive zero-shot recognition ability and can be easily transferred to specific downstream tasks via prompt tuning, even with limited training data. However, existing prompt tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yuqi Peng , Pengfei Wang , Jianzhuang Liu , Shifeng Chen

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen