English
Related papers

Related papers: Benchmarking Large Multimodal Models for Ophthalmi…

200 papers

We introduce EXAMS-V, a new challenging multi-discipline multimodal multilingual exam benchmark for evaluating vision language models. It consists of 20,932 multiple-choice questions across 20 school disciplines covering natural science,…

Computation and Language · Computer Science 2024-03-18 Rocktim Jyoti Das , Simeon Emilov Hristov , Haonan Li , Dimitar Iliyanov Dimitrov , Ivan Koychev , Preslav Nakov

Multimodal Large Language Models (MLLMs) have significantly progressed in offline video understanding. However, applying these models to real-world scenarios, such as autonomous driving and human-computer interaction, presents unique…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Zhenpeng Huang , Xinhao Li , Jiaqi Li , Jing Wang , Xiangyu Zeng , Cheng Liang , Tao Wu , Xi Chen , Liang Li , Limin Wang

In this work, we present Qwen3.5-Omni, the latest advancement in the Qwen-Omni model family. Representing a significant evolution over its predecessor, Qwen3.5-Omni scales to hundreds of billions of parameters and supports a 256k context…

Computation and Language · Computer Science 2026-04-22 Qwen Team

The rapid advancement of Multimodal Large Language Models (MLLMs) has enabled browsing agents to acquire and reason over multimodal information in the real world. But existing benchmarks suffer from two limitations: insufficient evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhengbo Zhang , Jinbo Su , Zhaowen Zhou , Changtao Miao , Yuhan Hong , Qimeng Wu , Yumeng Liu , Feier Wu , Yihe Tian , Yuhao Liang , Zitong Shan , Wanke Xia , Yi-Fan Zhang , Bo Zhang , Zhe Li , Shiming Xiang , Ying Yan

Hallucination remains a persistent challenge in Large Language Models (LLMs), particularly in context-grounded settings such as RAG and agentic AI systems. This study focuses on contextual hallucination detection in summarization tasks. We…

Computation and Language · Computer Science 2026-05-12 I. F. Atasoy , B. Mutlu , E. A. Sezer , A. Wahdan

Large Language models (LLMs) have demonstrated impressive performance on a wide range of tasks, including in multimodal settings such as speech. However, their evaluation is often limited to English and a few high-resource languages. For…

We introduce AudioCapBench, a benchmark for evaluating audio captioning capabilities of large multimodal models. \method covers three distinct audio domains, including environmental sound, music, and speech, with 1,000 curated evaluation…

Humans apprehend the world through various sensory modalities, yet language is their predominant communication channel. Machine learning systems need to draw on the same multimodal richness to have informed discourses with humans in natural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Min Wang , Ata Mahjoubfar , Anupama Joshi

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

This study evaluates the biases in Gemini 2.0 Flash Experimental, a state-of-the-art large language model (LLM) developed by Google, focusing on content moderation and gender disparities. By comparing its performance to ChatGPT-4o, examined…

Computation and Language · Computer Science 2025-03-24 Roberto Balestri

The rapid evolution of Large Vision-Language Models (LVLMs) has highlighted the necessity for comprehensive evaluation frameworks that assess these models across diverse dimensions. While existing benchmarks focus on specific aspects such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jie Zhang , Zheng Yuan , Zhongqi Wang , Bei Yan , Sibo Wang , Xiangkui Cao , Zonghui Guo , Shiguang Shan , Xilin Chen

Process-supervised reward models serve as a fine-grained function that provides detailed step-wise feedback to model responses, facilitating effective selection of reasoning trajectories for complex tasks. Despite its advantages, evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Haoqin Tu , Weitao Feng , Hardy Chen , Hui Liu , Xianfeng Tang , Cihang Xie

Understanding signboard text in natural scenes is essential for real-world applications of Visual Question Answering (VQA), yet remains underexplored, particularly in low-resource languages. We introduce ViSignVQA, the first large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hieu Minh Nguyen , Tam Le-Thanh Dang , Kiet Van Nguyen

Large Language Models (LLMs) have been progressively exhibiting there capabilities in various areas of research. The performance of the LLMs in acute maternal healthcare area, predominantly in low resource languages like Telugu, Hindi,…

Information Retrieval · Computer Science 2026-03-20 Anagani Bhanusree , Sai Divya Vissamsetty , K VenkataKrishna Rao , Rimjhim

Large Vision-Language Models (LVLMs) have recently played a dominant role in multimodal vision-language learning. Despite the great success, it lacks a holistic evaluation of their efficacy. This paper presents a comprehensive evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Peng Xu , Wenqi Shao , Kaipeng Zhang , Peng Gao , Shuo Liu , Meng Lei , Fanqing Meng , Siyuan Huang , Yu Qiao , Ping Luo

Vision-language models (VLMs) are increasingly proposed as general-purpose solutions for visual recognition tasks, yet their reliability for agricultural decision support remains poorly understood. We benchmark a diverse set of open-source…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Earl Ranario , Mason J. Earles

We demonstrate that vision language models (VLMs) are capable of recognizing the content in audio recordings when given corresponding spectrogram images. Specifically, we instruct VLMs to perform audio classification tasks in a few-shot…

Sound · Computer Science 2024-11-20 Satvik Dixit , Laurie M. Heller , Chris Donahue

The advancement of general medical Multimodal Large Language Models (MLLMs) has shown great potential for building conversational assistants to support clinical diagnosis. However, their adaptation to highly specialized domains such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xuanzhao Dong , Wenhui Zhu , Xiwen Chen , Hao Wang , Xin Li , Yujian Xiong , Jiajun Cheng , Jingjing Wang , Xiaobing Yu , Haiyu Wu , Shao Tang , Zhipeng Wang , Langechuan Liu , Shan Lin , Oana Dumitrascu , Yalin Wang

Visual Language Models (VLMs) are now sufficiently advanced to support a broad range of applications, including answering complex visual questions, and are increasingly expected to interact with images in varied ways. To evaluate them,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ludovic Arnould , Salim Khazem , Hugues Ali Mehenni