English
Related papers

Related papers: Which private attributes do VLMs agree on and pred…

200 papers

Accurate video moment retrieval (VMR) requires universal visual-textual correlations that can handle unknown vocabulary and unseen scenes. However, the learned correlations are likely either biased when derived from a limited amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Dezhao Luo , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

This research investigates both explicit and implicit social biases exhibited by Vision-Language Models (VLMs). The key distinction between these bias types lies in the level of awareness: explicit bias refers to conscious, intentional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jen-tse Huang , Jiantong Qin , Jianping Zhang , Youliang Yuan , Wenxuan Wang , Jieyu Zhao

Vision-language models (VLMs) pre-trained on large, heterogeneous data sources are becoming increasingly popular, providing rich multi-modal embeddings that enable efficient transfer to new tasks. A particularly relevant application is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Julio Silva-Rodríguez , Ender Konukoglu

Artificial Intelligence have profoundly transformed the technological landscape in recent years. Large Language Models (LLMs) have demonstrated impressive abilities in reasoning, text comprehension, contextual pattern recognition, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Efthymios Tsaprazlis , Tiantian Feng , Anil Ramakrishna , Rahul Gupta , Shrikanth Narayanan

Tactile perception is vital, especially when distinguishing visually similar objects. We propose an approach to incorporate tactile data into a Vision-Language Model (VLM) for visuo-tactile zero-shot object recognition. Our approach…

Robotics · Computer Science 2024-09-17 Shiori Ueda , Atsushi Hashimoto , Masashi Hamaya , Kazutoshi Tanaka , Hideo Saito

Recent advances in Vision-Language Models (VLMs) in histopathology, such as CONCH and QuiltNet, have demonstrated impressive zero-shot classification capabilities across various tasks. However, their general-purpose design may lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jingna Qiu , Nishanth Jain , Jonas Ammeling , Marc Aubreville , Katharina Breininger

Pre-trained general-purpose Vision-Language Models (VLM) hold the potential to enhance intuitive human-machine interactions due to their rich world knowledge and 2D object detection capabilities. However, VLMs for 3D coordinates detection…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ari Wahl , Dorian Gawlinski , David Przewozny , Paul Chojecki , Felix Bießmann , Sebastian Bosse

Visual perspective-taking (VPT), the ability to understand the viewpoint of another person, enables individuals to anticipate the actions of other people. For instance, a driver can avoid accidents by assessing what pedestrians see. Humans…

Computation and Language · Computer Science 2024-09-23 Gracjan Góral , Alicja Ziarko , Michal Nauman , Maciej Wołczyk

The prevalence of Vision-Language Models (VLMs) raises important questions about privacy in an era where visual information is increasingly available. While foundation VLMs demonstrate broad knowledge and learned capabilities, we…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Neel Jay , Hieu Minh Nguyen , Trung Dung Hoang , Jacob Haimes

Vision-Language Models (VLMs) have demonstrated impressive capabilities in zero-shot action recognition by learning to associate video embeddings with class embeddings. However, a significant challenge arises when relying solely on action…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yehna Kim , Young-Eun Kim , Seong-Whan Lee

Traditional supervised methods for detecting AI-generated images depend on large, curated datasets for training and fail to generalize to novel, out-of-domain image generators. As an alternative, we explore pre-trained Vision-Language…

Machine Learning · Computer Science 2026-01-27 Zoher Kachwala , Danishjeet Singh , Danielle Yang , Filippo Menczer

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

Vision-language models (VLMs) have enabled strong zero-shot classification through image-text alignment. Yet, their purely visual inference capabilities remain under-explored. In this work, we conduct a comprehensive evaluation of both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Illia Volkov , Nikita Kisel , Klara Janouskova , Jiri Matas

Recent advances in the development of vision-language models (VLMs) are yielding remarkable success in recognizing visual semantic content, including impressive instances of compositional image understanding. Here, we introduce the novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Vishaal Udandarao , Max F. Burg , Samuel Albanie , Matthias Bethge

Vision-Language Models (VLMs) are trained on vast amounts of data captured by humans emulating our understanding of the world. However, known as visual illusions, human's perception of reality isn't always faithful to the physical world.…

Artificial Intelligence · Computer Science 2023-11-02 Yichi Zhang , Jiayi Pan , Yuchen Zhou , Rui Pan , Joyce Chai

Visual Language Models (VLMs) show remarkable performance in visual reasoning tasks, successfully tackling college-level challenges that require high-level understanding of images. However, some recent reports of VLMs struggling to reason…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Gene Tangtartharakul , Katherine R. Storrs

The rapid adoption of Vision Language Models (VLMs), pre-trained on large image-text and video-text datasets, calls for protecting and informing users about when to trust these systems. This survey reviews studies on trust dynamics in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Agnese Chiatti , Sara Bernardini , Lara Shibelski Godoy Piccolo , Viola Schiaffonati , Matteo Matteucci

Vision-Language models (VLMs) that use contrastive language-image pre-training have shown promising zero-shot classification performance. However, their performance on imbalanced dataset is relatively poor, where the distribution of classes…

Artificial Intelligence · Computer Science 2023-06-22 Yidong Wang , Zhuohao Yu , Jindong Wang , Qiang Heng , Hao Chen , Wei Ye , Rui Xie , Xing Xie , Shikun Zhang

The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Oindrila Saha , Grant Van Horn , Subhransu Maji