English
Related papers

Related papers: The LLM Bottleneck: Why Open-Source Vision LLMs St…

200 papers

Vision Language Models (VLMs) extend remarkable capabilities of text-only large language models and vision-only models, and are able to learn from and process multi-modal vision-text input. While modern VLMs perform well on a number of…

Computation and Language · Computer Science 2025-07-22 Hannah Sterz , Jonas Pfeiffer , Ivan Vulić

Large Vision-Language Models (LVLMs) typically align visual features from an encoder with a pre-trained Large Language Model (LLM). However, this makes the visual perception module a bottleneck, which constrains the overall capabilities of…

Artificial Intelligence · Computer Science 2025-11-18 Wenhao Zhou , Hao Zheng , Rong Zhao

Since Pretrained Language Models (PLMs) are the cornerstone of the most recent Information Retrieval (IR) models, the way they encode semantic knowledge is particularly important. However, little attention has been given to studying the…

Computation and Language · Computer Science 2023-12-18 Jesús Lovón-Melgarejo , Jose G. Moreno , Romaric Besançon , Olivier Ferret , Lynda Tamine

Visual language is a system of communication that conveys information through symbols, shapes, and spatial arrangements. Diagrams are a typical example of a visual language depicting complex concepts and their relationships in the form of…

Computation and Language · Computer Science 2025-05-27 Yifan Hou , Buse Giledereli , Yilei Tu , Mrinmaya Sachan

Large language models (LLMs) have shown significant achievements in solving a wide range of tasks. Recently, LLMs' capability to store, retrieve and infer with symbolic knowledge has drawn a great deal of attention, showing their potential…

Artificial Intelligence · Computer Science 2024-10-11 Keyu Wang , Guilin Qi , Jiaqi Li , Songlin Zhai

Vision-language models (VLMs) increasingly combine visual and textual information to perform complex tasks. However, conflicts between their internal knowledge and external visual input can lead to hallucinations and unreliable predictions.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Francesco Ortu , Zhijing Jin , Diego Doimo , Alberto Cazzaniga

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

Vision-language Models (VLMs) have emerged as general-purpose tools for addressing a variety of complex computer vision problems. Such models have been shown to be highly capable, but, at the same time, lacking some basic visual…

Machine Learning · Computer Science 2025-07-15 Shivam Chandhok , Wan-Cyuan Fan , Vered Shwartz , Vineeth N Balasubramanian , Leonid Sigal

Vision Language Models (VLMs) are designed to extend Large Language Models (LLMs) with visual capabilities, yet in this work we observe a surprising phenomenon: VLMs can outperform their underlying LLMs on purely text-only tasks,…

Machine Learning · Computer Science 2026-02-18 Nicolas Buzeta , Felipe del Rio , Cristian Hinostroza , Denis Parra , Hans Lobel , Rodrigo Toro Icarte

Large language models (LLMs) demonstrate an impressive ability to internalize knowledge and answer natural language questions. Although previous studies validate that LLMs perform well on general knowledge while presenting poor performance…

Computation and Language · Computer Science 2024-06-21 Yushi Sun , Hao Xin , Kai Sun , Yifan Ethan Xu , Xiao Yang , Xin Luna Dong , Nan Tang , Lei Chen

Recent advancements in visiolinguistic (VL) learning have allowed the development of multiple models and techniques that offer several impressive implementations, able to currently resolve a variety of tasks that require the collaboration…

Computation and Language · Computer Science 2024-05-06 Maria Lymperaiou , Giorgos Stamou

It is still challenging to build an AI system that can perform tasks that involve vision and language at human level. So far, researchers have singled out individual tasks separately, for each of which they have designed networks and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

When a vision-language model (VLM) is prompted to identify an entity depicted in an image, it may answer 'I see a conifer,' rather than the specific label 'norway spruce'. This raises two issues for evaluation: First, the unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Vésteinn Snæbjarnarson , Kevin Du , Niklas Stoehr , Serge Belongie , Ryan Cotterell , Nico Lang , Stella Frank

Accurate diagnosis of ophthalmic diseases relies heavily on the interpretation of multimodal ophthalmic images, a process often time-consuming and expertise-dependent. Visual Question Answering (VQA) presents a potential interdisciplinary…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Xiaolan Chen , Ruoyu Chen , Pusheng Xu , Weiyi Zhang , Xianwen Shang , Mingguang He , Danli Shi

The proliferation of open-source Large Language Models (LLMs) from various institutions has highlighted the urgent need for comprehensive evaluation methods. However, current evaluation platforms, such as the widely recognized HuggingFace…

Computation and Language · Computer Science 2024-11-01 Fanghua Ye , Mingming Yang , Jianhui Pang , Longyue Wang , Derek F. Wong , Emine Yilmaz , Shuming Shi , Zhaopeng Tu

Multimodal Large Language Models (MLLMs) have experienced rapid progress in visual recognition tasks in recent years. Given their potential integration into many critical applications, it is important to understand the limitations of their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jiarui Zhang , Mahyar Khayatkhoei , Prateek Chhikara , Filip Ilievski

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated remarkable progress in visual understanding. This impressive leap raises a compelling question: how can language models, initially trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jing Bi , Junjia Guo , Yunlong Tang , Lianggong Bruce Wen , Zhang Liu , Chenliang Xu

Vision-Language Models (VLMs) combine visual and textual understanding, rendering them well-suited for diverse tasks like generating image captions and answering visual questions across various domains. However, these capabilities are built…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Simone Caldarella , Massimiliano Mancini , Elisa Ricci , Rahaf Aljundi

Recent advances in large vision-language models (VLMs) have shown significant promise for 3D scene understanding. Existing VLM-based approaches typically align 3D scene features with the VLM's embedding space. However, this implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chen Li , Eric Peh , Basura Fernando

Recent developments in multimodal large language models (MLLM) have equipped language models to reason about vision and language jointly. This permits MLLMs to both perceive and answer questions about data visualization across a variety of…

Human-Computer Interaction · Computer Science 2025-04-23 Zhimin Li , Haichao Miao , Xinyuan Yan , Valerio Pascucci , Matthew Berger , Shusen Liu