English
Related papers

Related papers: Visual Language Models show widespread visual defi…

200 papers

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Recently, Multimodal Large Language Models (MLLMs) and Vision Language Models (VLMs) have shown great promise in language-guided perceptual tasks such as recognition, segmentation, and object detection. However, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Xu Cao , Yifan Shen , Bolin Lai , Wenqian Ye , Yunsheng Ma , Joerg Heintz , Jintai Chen , Meihuan Huang , Jianguo Cao , Aidong Zhang , James M. Rehg

Are vision-language models (VLMs) for open-vocabulary perception inherently open-set models because they are trained on internet-scale datasets? We answer this question with a clear no - VLMs introduce closed-set assumptions via their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Dimity Miller , Niko Sünderhauf , Alex Kenna , Keita Mason

Dyslexia, a neurodevelopmental disorder characterized by persistent reading difficulties, is often linked to reduced activity of the visual word form area (VWFA) in the ventral occipito-temporal cortex. Traditional approaches to studying…

Computation and Language · Computer Science 2026-02-27 Melika Honarmand , Ayati Sharma , Badr AlKhamissi , Johannes Mehrer , Martin Schrimpf

What does learning to model relationships between strings teach large language models (LLMs) about the visual world? We systematically evaluate LLMs' abilities to generate and recognize an assortment of visual concepts of increasing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Pratyusha Sharma , Tamar Rott Shaham , Manel Baradad , Stephanie Fu , Adrian Rodriguez-Munoz , Shivam Duggal , Phillip Isola , Antonio Torralba

Is vision good enough for language? Recent advancements in multimodal models primarily stem from the powerful reasoning abilities of large language models (LLMs). However, the visual component typically depends only on the instance-level…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Shengbang Tong , Zhuang Liu , Yuexiang Zhai , Yi Ma , Yann LeCun , Saining Xie

Vision-Language Models (VLMs) have achieved remarkable progress in complex visual understanding across scientific and reasoning tasks. While performance benchmarking has advanced our understanding of these capabilities, the critical…

Artificial Intelligence · Computer Science 2026-01-27 Asif Azad , Mohammad Sadat Hossain , MD Sadik Hossain Shanto , M Saifur Rahman , Md Rizwan Parvez

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Vision Language Models (VLMs) extend remarkable capabilities of text-only large language models and vision-only models, and are able to learn from and process multi-modal vision-text input. While modern VLMs perform well on a number of…

Computation and Language · Computer Science 2025-07-22 Hannah Sterz , Jonas Pfeiffer , Ivan Vulić

Despite significant advancements, large multimodal models (LMMs) still struggle to bridge the gap between low-level visual perception -- focusing on shapes, sizes, and layouts -- and high-level language reasoning, such as semantics and…

Computation and Language · Computer Science 2025-06-13 Zhenhailong Wang , Joy Hsu , Xingyao Wang , Kuan-Hao Huang , Manling Li , Jiajun Wu , Heng Ji

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy

In this article, we investigate vision-language models (VLM) as reasoners. The ability to form abstractions underlies mathematical reasoning, problem-solving, and other Math AI tasks. Several formalisms have been given to these underlying…

Artificial Intelligence · Computer Science 2024-07-08 Denisa Roberts , Lucas Roberts

Vision-Language Models (VLMs) have become a central focus of today's AI community, owing to their impressive abilities gained from training on large-scale vision-language data from the Web. These models have demonstrated strong performance…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xuyang Guo , Zekai Huang , Zhenmei Shi , Zhao Song , Jiahao Zhang

Vision-language models (VLMs) are increasingly used in settings where sensitivity to low-level image degradations matters, including content moderation, image restoration, and quality monitoring. Yet their ability to recognize distortion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Divyanshu Goyal , Akhil Eppa , Vanya Bannihatti Kumar

Vision-language modeling (VLM) aims to bridge the information gap between images and natural language. Under the new paradigm of first pre-training on massive image-text pairs and then fine-tuning on task-specific data, VLM in the remote…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xingxing Weng , Chao Pang , Gui-Song Xia

Vision-Language(-Action) Models (VLMs) are increasingly applied to interactive environments, yet existing benchmarks often overlook the complex physical reasoning required for point-and-click puzzle games. This paper introduces…

Artificial Intelligence · Computer Science 2026-05-19 Maximilian Triebel , Marco Menner , Dominik Helfenstein

Internal world models (WMs) enable agents to understand the world's state and predict transitions, serving as the basis for advanced deliberative reasoning. Recent large Vision-Language Models (VLMs), such as OpenAI o3, GPT-4o and Gemini,…

Large language models (LLMs) memorize a vast amount of prior knowledge from the Internet that helps them on downstream tasks but also may notoriously sway their outputs towards wrong or biased answers. In this work, we test how the…

Machine Learning · Computer Science 2026-04-21 An Vo , Khai-Nguyen Nguyen , Mohammad Reza Taesiri , Vy Tuong Dang , Anh Totti Nguyen , Daeyoung Kim

Occlusion perception, a critical foundation for human-level spatial understanding, embodies the challenge of integrating visual recognition and reasoning. Though multimodal large language models (MLLMs) have demonstrated remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhaochen Liu , Kaiwen Gao , Shuyi Liang , Bin Xiao , Limeng Qiao , Lin Ma , Tingting Jiang