English
Related papers

Related papers: Learning to Rank Pre-trained Vision-Language Model…

200 papers

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

Recent developments in vision language models (VLM) have shown great potential for diverse applications related to image understanding. In this study, we have explored state-of-the-art VLM models for vision-based transportation engineering…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Sanjita Prajapati , Tanu Singh , Chinmay Hegde , Pranamesh Chakraborty

Vision-language pre-training like CLIP has shown promising performance on various downstream tasks such as zero-shot image classification and image-text retrieval. Most of the existing CLIP-alike works usually adopt relatively large image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Ying Nie , Wei He , Kai Han , Yehui Tang , Tianyu Guo , Fanyi Du , Yunhe Wang

Current Large Vision Language Models (LVLMs) excel at many zero-shot tasks like image captioning, visual question answering and OCR. However, these same models suffer from poor performance at image classification tasks, underperforming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Adhemar de Senneville , Xavier Bou , Jérémy Anger , Rafael Grompone , Gabriele Facciolo

Vision-Language-Action (VLA) models, which integrate pretrained large Vision-Language Models (VLM) into their policy backbone, are gaining significant attention for their promising generalization capabilities. This paper revisits a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jianke Zhang , Xiaoyu Chen , Qiuyue Wang , Mingsheng Li , Yanjiang Guo , Yucheng Hu , Jiajun Zhang , Shuai Bai , Junyang Lin , Jianyu Chen

Fine-tuning vision-language models (VLMs) with abundant unlabeled data recently has attracted increasing attention. Existing methods that resort to the pseudolabeling strategy would suffer from heavily incorrect hard pseudolabels when VLMs…

Machine Learning · Computer Science 2024-06-18 Jiahan Zhang , Qi Wei , Feng Liu , Lei Feng

Vision and Language Pretraining has become the prevalent approach for tackling multimodal downstream tasks. The current trend is to move towards ever larger models and pretraining datasets. This computational headlong rush does not seem…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Mustafa Shukor , Guillaume Couairon , Matthieu Cord

Vision-and-Language (V+L) pre-training models have achieved tremendous success in recent years on various multi-modal benchmarks. However, the majority of existing models require pre-training on a large set of parallel image-text data,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Mingyang Zhou , Licheng Yu , Amanpreet Singh , Mengjiao Wang , Zhou Yu , Ning Zhang

Vision-language models (VLMs) can learn high-quality representations from a large-scale training dataset of image-text pairs. Prompt learning is a popular approach to fine-tuning VLM to adapt them to downstream tasks. Despite the satisfying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhifang Zhang , Yuwei Niu , Xin Liu , Beibei Li

Recent advances in Vision-Language Models (VLMs) in histopathology, such as CONCH and QuiltNet, have demonstrated impressive zero-shot classification capabilities across various tasks. However, their general-purpose design may lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jingna Qiu , Nishanth Jain , Jonas Ammeling , Marc Aubreville , Katharina Breininger

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala

Real-world vision-language applications demand varying levels of perceptual granularity. However, most existing visual large language models (VLLMs), such as LLaVA, pre-assume a fixed resolution for downstream tasks, which leads to subpar…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Weiqing Luo , Zhen Tan , Yifan Li , Xinyu Zhao , Kwonjoon Lee , Behzad Dariush , Tianlong Chen

Pre-trained vision-language models (VLMs) have enabled significant progress in open vocabulary computer vision tasks such as image classification, object detection and image segmentation. Some recent works have focused on extending VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Rohit Gupta , Mamshad Nayeem Rizve , Jayakrishnan Unnikrishnan , Ashish Tawari , Son Tran , Mubarak Shah , Benjamin Yao , Trishul Chilimbi

Large Vision Language Models (VLMs) effectively bridge the modality gap through extensive pretraining, acquiring sophisticated visual representations aligned with language. However, it remains underexplored whether these representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jiahao Guo , Sinan Du , Jingfeng Yao , Wenyu Liu , Bo Li , Haoxiang Cao , Kun Gai , Chun Yuan , Kai Wu , Xinggang Wang

Vision Language Models (VLMs) have demonstrated remarkable performance in open-world zero-shot visual recognition. However, their potential in space-related applications remains largely unexplored. In the space domain, accurate manual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Samet Hicsonmez , Jose Sosa , Dan Pineau , Inder Pal Singh , Arunkumar Rathinam , Abd El Rahman Shabayek , Djamila Aouada

Image and language modeling is of crucial importance for vision-language pre-training (VLP), which aims to learn multi-modal representations from large-scale paired image-text data. However, we observe that most existing VLP methods focus…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Chen Wu , Xiujun Shu , Bo Ren

Classification of pathological images is the basis for automatic cancer diagnosis. Despite that deep learning methods have achieved remarkable performance, they heavily rely on labeled data, demanding extensive human annotation efforts. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Lanfeng Zhong , Zongyao Huang , Yang Liu , Wenjun Liao , Shichuan Zhang , Guotai Wang , Shaoting Zhang

We build upon time-series classification by leveraging the capabilities of Vision Language Models (VLMs). We find that VLMs produce competitive results after two or less epochs of fine-tuning. We develop a novel approach that incorporates…

Artificial Intelligence · Computer Science 2025-01-22 Vinay Prithyani , Mohsin Mohammed , Richa Gadgil , Ricardo Buitrago , Vinija Jain , Aman Chadha

Large-scale vision-language models (VLMs), trained on extensive datasets of image-text pairs, exhibit strong multimodal understanding capabilities by implicitly learning associations between textual descriptions and image regions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

In this paper, we present a comprehensive and systematic analysis of vision-language models (VLMs) for disparate meme classification tasks. We introduced a novel approach that generates a VLM-based understanding of meme images and…

Computation and Language · Computer Science 2025-05-28 Deepesh Gavit , Debajyoti Mazumder , Samiran Das , Jasabanta Patro