English
Related papers

Related papers: Measuring Progress in Fine-grained Vision-and-Lang…

200 papers

Current pre-trained vison-language models (PVLMs) achieve excellent performance on a range of multi-modal datasets. Recent work has aimed at building multilingual models, and a range of novel multilingual multi-modal datasets have been…

Computation and Language · Computer Science 2023-10-25 Hanxu Hu , Frank Keller

To leverage the full potential of Large Language Models (LLMs) it is crucial to have some information on their answers' uncertainty. This means that the model has to be able to quantify how certain it is in the correctness of a given…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mirko Borszukovszki , Ivo Pascal de Jong , Matias Valdenegro-Toro

The rapid development of Large Language Models (LLMs) has catalyzed significant advancements in video understanding technologies. This survey provides a comprehensive analysis of benchmarks and evaluation methodologies specifically designed…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yogesh Kumar

Recent advances in the development of vision-language models (VLMs) are yielding remarkable success in recognizing visual semantic content, including impressive instances of compositional image understanding. Here, we introduce the novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Vishaal Udandarao , Max F. Burg , Samuel Albanie , Matthias Bethge

Vision-language models (VLMs) excel in zero-shot recognition but their performance varies greatly across different visual concepts. For example, although CLIP achieves impressive accuracy on ImageNet (60-80%), its performance drops below…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Shubham Parashar , Zhiqiu Lin , Tian Liu , Xiangjue Dong , Yanan Li , Deva Ramanan , James Caverlee , Shu Kong

Current benchmarks for evaluating Vision Language Models (VLMs) often fall short in thoroughly assessing model abilities to understand and process complex visual and textual content. They typically focus on simple tasks that do not require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Harsha Vardhan Khurdula , Basem Rizk , Indus Khaitan , Janit Anjaria , Aviral Srivastava , Rajvardhan Khaitan

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

With the rapid development of Vision-Language Models (VLMs) and the growing demand for their applications, efficient compression of the image inputs has become increasingly important. Existing VLMs predominantly digest and understand…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zifu Zhang , Tongda Xu , Siqi Li , Shengxi Li , Yue Zhang , Mai Xu , Yan Wang

Artificial intelligence has made great progress in recent years, particularly in the development of Vision--Language Models (VLMs) that understand both visual and textual data. However, these advancements remain largely limited to English,…

Computation and Language · Computer Science 2025-12-12 Jules Lahmi , Alexis Roger

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in general video understanding, yet they often struggle with the fine-grained comprehension crucial for real-world applications requiring nuanced interpretation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Gueter Josmy Faure , Min-Hung Chen , Jia-Fong Yeh , Hung-Ting Su , Winston H. Hsu

One of the primary challenges faced by deep learning is the degree to which current methods exploit superficial statistics and dataset bias, rather than learning to generalise over the specific representations they have experienced. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Damien Teney , Peng Wang , Jiewei Cao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Real-world vision-language applications demand varying levels of perceptual granularity. However, most existing visual large language models (VLLMs), such as LLaVA, pre-assume a fixed resolution for downstream tasks, which leads to subpar…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Weiqing Luo , Zhen Tan , Yifan Li , Xinyu Zhao , Kwonjoon Lee , Behzad Dariush , Tianlong Chen

The exploration of various vision-language tasks, such as visual captioning, visual question answering, and visual commonsense reasoning, is an important area in artificial intelligence and continuously attracts the research community's…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yayun Qi , Hongxi Li , Yiqi Song , Xinxiao Wu , Jiebo Luo

The recent advancements in text-to-image generative models have been remarkable. Yet, the field suffers from a lack of evaluation metrics that accurately reflect the performance of these models, particularly lacking fine-grained metrics…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Zhiyu Tan , Xiaomeng Yang , Luozheng Qin , Mengping Yang , Cheng Zhang , Hao Li

Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive ability to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Hang Hua , Jing Shi , Kushal Kafle , Simon Jenni , Daoan Zhang , John Collomosse , Scott Cohen , Jiebo Luo

Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Weihan Wang , Zhen Yang , Bin Xu , Juanzi Li , Yankui Sun

Vision Language Models (VLMs) have achieved remarkable progress in multimodal tasks, yet they often struggle with visual arithmetic, seemingly simple capabilities like object counting or length comparison, which are essential for relevant…

Artificial Intelligence · Computer Science 2025-05-27 Kung-Hsiang Huang , Can Qin , Haoyi Qiu , Philippe Laban , Shafiq Joty , Caiming Xiong , Chien-Sheng Wu

Following the initial flourishing of large language models (LLMs), there has been a surge in proposed large vision-language models (LVLMs) that integrate LLMs with vision capabilities. However, it has been observed that LVLMs, after tuning…

Computation and Language · Computer Science 2025-12-30 Daiki Shiono , Shumpei Miyawaki , Ryota Tanaka , Jun Suzuki

Large Language Models (LLMs), trained on extensive web-scale corpora, have demonstrated remarkable abilities across diverse tasks, especially as they are scaled up. Nevertheless, even state-of-the-art models struggle in certain cases,…

Computation and Language · Computer Science 2025-01-16 Irina Bigoulaeva , Harish Tayyar Madabushi , Iryna Gurevych

Large vision-language models (LVLMs) have demonstrated exceptional capabilities in understanding visual information with human languages but also exhibit an imbalance in multilingual capabilities. In this work, we delve into the…

Computation and Language · Computer Science 2025-08-27 Yuchun Fan , Yilin Wang , Yongyu Mu , Lei Huang , Bei Li , Xiaocheng Feng , Tong Xiao , Jingbo Zhu