English
Related papers

Related papers: Are We on the Right Way for Evaluating Large Visio…

200 papers

Recent advances in multimodal large language models (MLLMs) have catalyzed transformative progress in affective computing, enabling models to exhibit emergent emotional intelligence. Despite substantial methodological progress, current…

Large Vision and Language Models have enabled significant advances in fully supervised and zero-shot visual tasks. These large architectures serve as the baseline to what is currently known as Instruction Tuning Large Vision and Language…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Andrés Villa , Juan Carlos León Alcázar , Alvaro Soto , Bernard Ghanem

The rapidly developing field of large multimodal models (LMMs) has led to the emergence of diverse models with remarkable capabilities. However, existing benchmarks fail to comprehensively, objectively and accurately evaluate whether LMMs…

Large visual-language models (LVLMs) exhibit exceptional performance in visual-language reasoning across diverse cross-modal benchmarks. Despite these advances, recent research indicates that Large Language Models (LLMs), like…

Computation and Language · Computer Science 2025-04-17 Ye Jiang , Yimin Wang

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Despite the advancements and impressive performance of Multimodal Large Language Models (MLLMs) on benchmarks, their effectiveness in real-world, long-context, and multi-image tasks is unclear due to the benchmarks' limited scope. Existing…

Computation and Language · Computer Science 2024-05-16 Dingjie Song , Shunian Chen , Guiming Hardy Chen , Fei Yu , Xiang Wan , Benyou Wang

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

Artificial Intelligence · Computer Science 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Large Vision-Language Models (LVLMs) have achieved remarkable progress on visual perception and linguistic interpretation. Despite their impressive capabilities across various tasks, LVLMs still suffer from the issue of hallucination, which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Xingwei He , Qianru Zhang , A-Long Jin , Yuan Yuan , Siu-Ming Yiu

While Multimodal Large Language Models (MLLMs) have exhibited remarkable general intelligence across diverse domains, their potential in low-altitude applications dominated by Unmanned Aerial Vehicles (UAVs) remains largely underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shiqi Dai , Zizhi Ma , Zhicong Luo , Xuesong Yang , Yibin Huang , Wanyue Zhang , Chi Chen , Zonghao Guo , Wang Xu , Yufei Sun , Maosong Sun

Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease. While such capability is largely attributed to the rich world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Jeonghwan Kim , Heng Ji

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

Artificial Intelligence · Computer Science 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across diverse tasks, garnering significant attention in AI communities. However, their performance and reliability in specialized domains…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yang Nan , Huichi Zhou , Xiaodan Xing , Guang Yang

Evaluating the abilities of large models and manifesting their gaps are challenging. Current benchmarks adopt either ground-truth-based score-form evaluation on static datasets or indistinct textual chatbot-style human preferences…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Zijian Chen , Lirong Deng , Zhengyu Chen , Kaiwei Zhang , Qi Jia , Yuan Tian , Yucheng Zhu , Guangtao Zhai

Large language models (LLMs) have become increasingly useful computational models of human language processing, but it remains unclear whether vision-language learning makes text representations more human-like during natural reading. Here,…

Computation and Language · Computer Science 2026-05-28 Jinzhou Wu , Zhengwu Ma , Jixing Li , Baoping Tang , Zitong Lu

The rapid advancement of Multimodal Large Language Models (MLLMs) has been accompanied by the development of various benchmarks to evaluate their capabilities. However, the true nature of these evaluations and the extent to which they…

Computation and Language · Computer Science 2024-10-17 Botian Jiang , Lei Li , Xiaonan Li , Zhaowei Li , Xiachong Feng , Lingpeng Kong , Qi Liu , Xipeng Qiu

Large Vision-Language Models (LVLMs) have achieved strong performance on vision-language tasks, particularly Visual Question Answering (VQA). While prior work has explored unimodal biases in VQA, the problem of selection bias in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Md. Atabuzzaman , Ali Asgarov , Chris Thomas

As multimodal large language models (MLLMs) advance rapidly, rigorous evaluation has become essential, providing further guidance for their development. In this work, we focus on a unified and robust evaluation of \textbf{vision perception}…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Feng Chen , Chenhui Gou , Jing Liu , Yang Yang , Zhaoyang Li , Jiyuan Zhang , Zhenbang Sun , Bohan Zhuang , Qi Wu

Multimodal large language models (MLLMs) have shown success in vision-language tasks, but their ability to reason over complex educational materials remains largely untested. This work presents the first evaluation of state-of-the-art…

Computation and Language · Computer Science 2025-07-16 Hessa A. Alawwad , Anas Zafar , Areej Alhothali , Usman Naseem , Ali Alkhathlan , Amani Jamal

The development of Multimodal Large Language Models (MLLMs) has seen significant advancements with increasing demands in various fields (e.g., multimodal agents, embodied intelligence). While model-driven approaches attempt to enhance MLLMs…

Recent extensive works have demonstrated that by introducing long CoT, the capabilities of MLLMs to solve complex problems can be effectively enhanced. However, the reasons for the effectiveness of such paradigms remain unclear. It is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Jiachen Yu , Yufei Zhan , Ziheng Wu , Yousong Zhu , Jinqiao Wang , Minghui Qiu