English
Related papers

Related papers: Are vision-language models ready to zero-shot repl…

200 papers

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci

Vision-Language models (VLMs) that use contrastive language-image pre-training have shown promising zero-shot classification performance. However, their performance on imbalanced dataset is relatively poor, where the distribution of classes…

Artificial Intelligence · Computer Science 2023-06-22 Yidong Wang , Zhuohao Yu , Jindong Wang , Qiang Heng , Hao Chen , Wei Ye , Rui Xie , Xing Xie , Shikun Zhang

Recent breakthroughs in vision-language models (VLMs) start a new page in the vision community. The VLMs provide stronger and more generalizable feature embeddings compared to those from ImageNet-pretrained models, thanks to the training on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Jieneng Chen , Qihang Yu , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen

This paper introduces a synthetic benchmark to evaluate the performance of vision language models (VLMs) in generating plant simulation configurations for digital twins. While functional-structural plant models (FSPMs) are useful tools for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Heesup Yun , Isaac Kazuo Uyehara , Earl Ranario , Lars Lundqvist , Christine H. Diepenbrock , Brian N. Bailey , J. Mason Earles

Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, their deployment in risk-sensitive areas requires a deeper…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weijie Tu , Weijian Deng , Dylan Campbell , Stephen Gould , Tom Gedeon

Vision-language models (VLMs) have shown impressive performance in substantial downstream multi-modal tasks. However, only comparing the fine-tuned performance on downstream tasks leads to the poor interpretability of VLMs, which is adverse…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zheng Ma , Mianzhi Pan , Wenhan Wu , Kanzhi Cheng , Jianbing Zhang , Shujian Huang , Jiajun Chen

Image geolocalization has traditionally been addressed through retrieval-based place recognition or geometry-based visual localization pipelines. Recent advances in Vision-Language Models (VLMs) have demonstrated strong zero-shot reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Siddhant Bharadwaj , Ashish Vashist , Fahimul Aleem , Shruti Vyas

Despite rapid advances in multimodal large language models, agricultural applications remain constrained by the scarcity of domain-tailored models, curated vision-language corpora, and rigorous evaluation. To address these challenges, we…

Computation and Language · Computer Science 2025-12-09 Bo Yang , Yunkui Chen , Lanfei Feng , Yu Zhang , Xiao Xu , Jianyu Zhang , Nueraili Aierken , Runhe Huang , Hongjian Lin , Yibin Ying , Shijian Li

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

Vision language models (VLMs) excel at zero-shot visual classification, but their performance on fine-grained tasks and large hierarchical label spaces is understudied. This paper investigates whether structured, tree-based reasoning can…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Sary Elmansoury , Islam Mesabah , Gerrit Großmann , Peter Neigel , Raj Bhalwankar , Daniel Kondermann , Sebastian J. Vollmer

Surgery is a highly complex process, and artificial intelligence has emerged as a transformative force in supporting surgical guidance and decision-making. However, the unimodal nature of most current AI systems limits their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Nakul Poudel , Richard Simon , Cristian A. Linte

The advent of large vision-language models (LVLMs) represents a remarkable advance in the quest for artificial general intelligence. However, the model's effectiveness in both specialized and general tasks warrants further investigation.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yao Jiang , Xinyu Yan , Ge-Peng Ji , Keren Fu , Meijun Sun , Huan Xiong , Deng-Ping Fan , Fahad Shahbaz Khan

Large Vision-Language Models (LVLMs) have demonstrated impressive performance on vision-language reasoning tasks. However, their potential for zero-shot fine-grained image classification, a challenging task requiring precise differentiation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Md. Atabuzzaman , Andrew Zhang , Chris Thomas

Recent developments in vision language models (VLM) have shown great potential for diverse applications related to image understanding. In this study, we have explored state-of-the-art VLM models for vision-based transportation engineering…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Sanjita Prajapati , Tanu Singh , Chinmay Hegde , Pranamesh Chakraborty

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

Artificial Intelligence · Computer Science 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Recent advancements in Vision-Language Models (VLMs) have demonstrated strong capabilities in general visual reasoning, yet their applicability to rigorous biometric tasks remains unexplored. This work presents an exploratory study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Marta Robledo-Moreno , Ruben Vera-Rodriguez , Ruben Tolosana , Javier Ortega-Garcia

The deployment of Multimodal Large Language Models (MLLMs) in agriculture is currently stalled by a critical trade-off: the existing literature lacks the large-scale agricultural datasets required for robust model development and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Abderrahmene Boudiaf , Irfan Hussain , Sajid Javed

While deep learning, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), has significantly advanced classification performance, its typical reliance on extensive annotated datasets presents a major obstacle in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Matheus Vinícius Todescato , Joel Luís Carbonera

Recent advances in the development of vision-language models (VLMs) are yielding remarkable success in recognizing visual semantic content, including impressive instances of compositional image understanding. Here, we introduce the novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Vishaal Udandarao , Max F. Burg , Samuel Albanie , Matthias Bethge

To improve crop genetics, high-throughput, effective and comprehensive phenotyping is a critical prerequisite. While such tasks were traditionally performed manually, recent advances in multimodal foundation models, especially in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yu Wu , Guangzeng Han , Ibra Niang Niang , Francia Ravelombola , Maiara Oliveira , Jason Davis , Dong Chen , Feng Lin , Xiaolei Huang