English
Related papers

Related papers: Examining Vision Language Models through Multi-dim…

200 papers

Hallucination is a long-standing problem that has been actively investigated in Vision-Language Models (VLMs). Existing research commonly attributes hallucinations to technical limitations or sycophancy bias, where the latter means the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Xiangrui Liu , Man Luo , Agneet Chatterjee , Hua Wei , Chitta Baral , Yezhou Yang

Learning generalizable reward functions is a core challenge in embodied intelligence. Recent work leverages contrastive vision language models (VLMs) to obtain dense, domain-agnostic rewards without human supervision. These methods adapt…

Machine Learning · Computer Science 2025-12-25 Simon Roy , Samuel Barbeau , Giovanni Beltrame , Christian Desrosiers , Nicolas Thome

The Vision Language Model (VLM) excels in aligning vision and language representations, and prompt learning has emerged as a key technique for adapting such models to downstream tasks. However, the application of prompt learning with VLM in…

Machine Learning · Computer Science 2025-09-19 Zhihao Wang , Wenke Huang , Tian Chen , Zekun Shi , Guancheng Wan , Yu Qiao , Bin Yang , Jian Wang , Bing Li , Mang Ye

Vision-Language Models (VLMs) are increasingly used as perceptual modules for visual content reasoning, including through captioning and DeepFake detection. In this work, we expose a critical vulnerability of VLMs when exposed to subtle,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jordan Vice , Naveed Akhtar , Yansong Gao , Richard Hartley , Ajmal Mian

Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability encourage automated approaches. We investigate whether Vision Language Models (VLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Imran Mehmood , Imad Ali Shah , Ming Ronnier Luo , Brian Deegan

Vision-language models (VLMs), serve as foundation models for multi-modal applications such as image captioning and text-to-image generation. Recent studies have highlighted limitations in VLM text encoders, particularly in areas like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Sri Harsha Dumpala , David Arps , Sageev Oore , Laura Kallmeyer , Hassan Sajjad

The recent trend in the Large Vision and Language model has brought a new change in how information extraction systems are built. VLMs have set a new benchmark with their State-of-the-art techniques in understanding documents and building…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Dipankar Medhi

Students' academic emotions significantly influence their social behavior and learning performance. Traditional approaches to automatically and accurately analyze these emotions have predominantly relied on supervised machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Deliang Wang , Chao Yang , Gaowei Chen

Multimodal large language models (MLLMs) achieve strong performance on vision-language tasks, yet their visual processing is opaque. Most black-box evaluations measure task accuracy, but reveal little about underlying mechanisms. Drawing on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 John Burden , Jonathan Prunty , Ben Slater , Matthieu Tehenan , Greg Davis , Lucy Cheke

While vision-language models (VLMs) have achieved remarkable performance improvements recently, there is growing evidence that these models also posses harmful biases with respect to social attributes such as gender and race. Prior studies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Phillip Howard , Avinash Madasu , Tiep Le , Gustavo Lujan Moreno , Vasudev Lal

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

Vision-Language Models (VLMs) combine visual and textual understanding, rendering them well-suited for diverse tasks like generating image captions and answering visual questions across various domains. However, these capabilities are built…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Simone Caldarella , Massimiliano Mancini , Elisa Ricci , Rahaf Aljundi

Vision-Language Models (VLMs) integrate visual knowledge with the analytical capabilities of Large Language Models (LLMs) through supervised visual instruction tuning, using image-question-answer triplets. However, the potential of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yunlong Deng , Guangyi Chen , Tianpei Gu , Lingjing Kong , Yan Li , Zeyu Tang , Kun Zhang

Where someone looks is a nonverbal communication cue that children and adults readily use. How well can Vision-Language Models (VLMs) infer gaze targets? To construct evaluation stimuli, we captured 1,360 real-world photos of scenes in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zory Zhang , Pinyuan Feng , Bingyang Wang , Tianwei Zhao , Suyang Yu , Qingying Gao , Hokin Deng , Ziqiao Ma , Yijiang Li , Dezhi Luo

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Vision-Language Models (VLMs) achieve strong results on multimodal tasks such as visual question answering, yet they can still fail even when the correct visual evidence is present. In this work, we systematically investigate whether these…

Artificial Intelligence · Computer Science 2025-10-21 Zhining Liu , Ziyi Chen , Hui Liu , Chen Luo , Xianfeng Tang , Suhang Wang , Joy Zeng , Zhenwei Dai , Zhan Shi , Tianxin Wei , Benoit Dumoulin , Hanghang Tong

Benchmark accuracy is often implicitly assumed to reflect grounded visual understanding in vision-language models (VLMs), yet it remains unclear to what extent such scores truly reflect reliance on visual evidence. Motivated by a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zixuan Lan , Luzhe Sun , Matthew R. Walter , Jiawei Zhou

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

Computation and Language · Computer Science 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

Many vision-language models (VLMs) that prove very effective at a range of multimodal task, build on CLIP-based vision encoders, which are known to have various limitations. We investigate the hypothesis that the strong language backbone in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Sho Takishita , Jay Gala , Abdelrahman Mohamed , Kentaro Inui , Yova Kementchedjhieva
‹ Prev 1 4 5 6 7 8 10 Next ›