English
Related papers

Related papers: Language-Guided Invariance Probing of Vision-Langu…

200 papers

Large Vision-Language Models (LVLMs) are gaining traction for their remarkable ability to process and integrate visual and textual data. Despite their popularity, the capacity of LVLMs to generate precise, fine-grained textual descriptions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yuhang Huang , Zihan Wu , Chongyang Gao , Jiawei Peng , Xu Yang

Fine-grained vision-language understanding requires precise alignment between visual content and linguistic descriptions, a capability that remains limited in current models, particularly in non-English settings. While models like CLIP…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chunyu Xie , Bin Wang , Fanjing Kong , Jincheng Li , Dawei Liang , Ji Ao , Dawei Leng , Yuhui Yin

Large Vision-Language Models (LVLMs) have made significant strides in the field of video understanding in recent times. Nevertheless, existing video benchmarks predominantly rely on text prompts for evaluation, which often require complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yiming Zhao , Yu Zeng , Yukun Qi , YaoYang Liu , Xikun Bao , Lin Chen , Zehui Chen , Qing Miao , Chenxi Liu , Jie Zhao , Feng Zhao

Modern image classification is based upon directly predicting classes via large discriminative networks, which do not directly contain information about the intuitive visual features that may constitute a classification decision. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhili Feng , Anna Bair , J. Zico Kolter

Large Vision Language Models (LVLMs) excel in various vision-language tasks. Yet, their robustness to visual variations in position, scale, orientation, and context that objects in natural scenes inevitably exhibit due to changes in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhiyuan Fan , Yumeng Wang , Sandeep Polisetty , Yi R. Fung

Vision-language models (VLMs) like CLIP (Contrastive Language-Image Pre-Training) have seen remarkable success in visual recognition, highlighting the increasing need to safeguard the intellectual property (IP) of well-trained models.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Lianyu Wang , Meng Wang , Huazhu Fu , Daoqiang Zhang

Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaqi Zhu , Shaofeng Cai , Fang Deng , Beng Chin Ooi , Junran Wu

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

In recent years, vision and language pre-training (VLP) models have advanced the state-of-the-art results in a variety of cross-modal downstream tasks. Aligning cross-modal semantics is claimed to be one of the essential capabilities of VLP…

Computation and Language · Computer Science 2022-10-19 Zheng Ma , Shi Zong , Mianzhi Pan , Jianbing Zhang , Shujian Huang , Xinyu Dai , Jiajun Chen

Pre-trained Vision-language (VL) models, such as CLIP, have shown significant generalization ability to downstream tasks, even with minimal fine-tuning. While prompt learning has emerged as an effective strategy to adapt pre-trained VL…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Niloufar Alipour Talemi , Hossein Kashiani , Fatemeh Afghah

Vision-language models (VLMs) deliver strong zero-shot recognition but frequently inherit social biases from their training data. We systematically disentangle three design factors -- model size, training-data scale, and training-data…

Machine Learning · Computer Science 2026-01-26 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

Vision-Language Models (VLMs) are advancing multimodal AI, yet their performance consistency across tasks is underexamined. We benchmark CLIP, BLIP, and LXMERT across diverse datasets spanning retrieval, captioning, and reasoning. Our…

Information Retrieval · Computer Science 2025-07-03 Harsh Joshi , Gautam Siddharth Kashyap , Rafiq Ali , Ebad Shabbir , Niharika Jain , Sarthak Jain , Jiechao Gao , Usman Naseem

Modern sensing systems generate large volumes of unlabeled multivariate time-series data. This abundance of unlabeled data makes self-supervised learning (SSL) a natural approach for learning transferable representations. However, most…

Artificial Intelligence · Computer Science 2026-03-13 Yuliang Chen , Arvind Pillai , Yu Yvonne Wu , Tess Z. Griffin , Lisa Marsch , Michael V. Heinz , Nicholas C. Jacobson , Andrew Campbell

Contrastive pretrained large Vision-Language Models (VLMs) like CLIP have revolutionized visual representation learning by providing good performance on downstream datasets. VLMs are 0-shot adapted to a downstream dataset by designing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Mayug Maniparambil , Chris Vorster , Derek Molloy , Noel Murphy , Kevin McGuinness , Noel E. O'Connor

Open-vocabulary semantic segmentation requires models to effectively integrate visual representations with open-vocabulary semantic labels. While Contrastive Language-Image Pre-training (CLIP) models shine in recognizing visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Mengcheng Lan , Chaofeng Chen , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

Despite their remarkable successes, state-of-the-art large language models (LLMs), including vision-and-language models (VLMs) and unimodal language models (ULMs), fail to understand precise semantics. For example, semantically equivalent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Sri Harsha Dumpala , Aman Jaiswal , Chandramouli Sastry , Evangelos Milios , Sageev Oore , Hassan Sajjad

This work explores how color is encoded in CLIP (Contrastive Language-Image Pre-training) which is currently the most influential VML (Visual Language model) in Artificial Intelligence. After performing different experiments on synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Guillem Arias , Ramon Baldrich , Maria Vanrell

Recently, textual prompt tuning has shown inspirational performance in adapting Contrastive Language-Image Pre-training (CLIP) models to natural image quality assessment. However, such uni-modal prompt learning method only tunes the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jun Fu , Wei Zhou , Qiuping Jiang , Hantao Liu , Guangtao Zhai

Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions, yet existing machine learning approaches remain fragmented and task-specific, with each downstream task employing distinct architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Pushkal Mishra , Kshitiz Bansal , Dinesh Bharadia