English
Related papers

Related papers: GAOKAO-MM: A Chinese Human-Level Benchmark for Mul…

200 papers

In this paper, we propose a comprehensive evaluation benchmark for Visual Language Models (VLM) in Traditional Chinese. Our evaluation suite, the first of its kind, contains two complementary components: (1) VisTW-MCQ, a collection of…

Computation and Language · Computer Science 2025-03-18 Zhi Rui Tam , Ya-Ting Pai , Yen-Wei Lee , Yun-Nung Chen

Large Multimodal Models (LMMs) have shown promise in vision-language tasks but struggle with high-resolution input and detailed scene understanding. Addressing these challenges, we introduce Monkey to enhance LMM capabilities. Firstly,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhang Li , Biao Yang , Qiang Liu , Zhiyin Ma , Shuo Zhang , Jingxu Yang , Yabo Sun , Yuliang Liu , Xiang Bai

Large Language Models (LLMs) and Multimodal Large language models (MLLMs) have taken the world by storm with impressive abilities in complex reasoning and linguistic comprehension. Meanwhile there are plethora of works related to Vietnamese…

Computation and Language · Computer Science 2024-07-17 Chi Tran , Huong Le Thanh

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

As large language models (LLMs) continue to advance, evaluating their comprehensive capabilities becomes significant for their application in various fields. This research study comprehensively evaluates the language, vision, speech, and…

This study aims to test and evaluate the capabilities and characteristics of current mainstream Visual Language Models (VLMs) in generating critiques for traditional Chinese painting. To achieve this, we first developed a quantitative…

Computation and Language · Computer Science 2026-02-03 Haorui Yu , Ramon Ruiz-Dolz , Qiufeng Yi

Recent advancements have seen Large Language Models (LLMs) and Large Multimodal Models (LMMs) surpassing general human capabilities in various tasks, approaching the proficiency level of human experts across multiple domains. With…

Computation and Language · Computer Science 2024-06-07 Chaoqun He , Renjie Luo , Yuzhuo Bai , Shengding Hu , Zhen Leng Thai , Junhao Shen , Jinyi Hu , Xu Han , Yujie Huang , Yuxiang Zhang , Jie Liu , Lei Qi , Zhiyuan Liu , Maosong Sun

Recent Large Vision-Language Models (LVLMs) have shown promising reasoning capabilities on text-rich images from charts, tables, and documents. However, the abundant text within such images may increase the model's sensitivity to language.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xinmiao Yu , Xiaocheng Feng , Yun Li , Minghui Liao , Ya-Qi Yu , Xiachong Feng , Weihong Zhong , Ruihan Chen , Mengkang Hu , Jihao Wu , Dandan Tu , Duyu Tang , Bing Qin

Recently, multimodal large language models (MLLMs), such as GPT-4o, Gemini 1.5 Pro, and Reka Core, have expanded their capabilities to include vision and audio modalities. While these models demonstrate impressive performance across a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kaixiong Gong , Kaituo Feng , Bohao Li , Yibing Wang , Mofan Cheng , Shijia Yang , Jiaming Han , Benyou Wang , Yutong Bai , Zhuoran Yang , Xiangyu Yue

While Multimodal Large Language Models (MLLMs) excel at many vision tasks, it is unknown if they exhibit human-like perceptual behaviors. To evaluate this, we introduce HVSBench, the first large-scale benchmark with over 85,000 samples…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Jiaying Lin , Shuquan Ye , Dan Xu , Wanli Ouyang , Rynson W. H. Lau

Large Vision-Language Models (VLMs) have demonstrated impressive performance on complex tasks involving visual input with natural language instructions. However, it remains unclear to what extent capabilities on natural images transfer to…

Computation and Language · Computer Science 2024-02-01 Chenhui Zhang , Sherrie Wang

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address…

Computation and Language · Computer Science 2023-10-24 Junling Liu , Peilin Zhou , Yining Hua , Dading Chong , Zhongyu Tian , Andrew Liu , Helin Wang , Chenyu You , Zhenhua Guo , Lei Zhu , Michael Lingzhi Li

The effective assessment of the instruction-following ability of large language models (LLMs) is of paramount importance. A model that cannot adhere to human instructions might be not able to provide reliable and helpful responses. In…

Computation and Language · Computer Science 2023-11-17 Yimin Jing , Renren Jin , Jiahao Hu , Huishi Qiu , Xiaohua Wang , Peng Wang , Deyi Xiong

With the rapid evolution of large language models (LLMs), there is a growing concern that they may pose risks or have negative social impacts. Therefore, evaluation of human values alignment is becoming increasingly important. Previous work…

Computation and Language · Computer Science 2023-07-20 Guohai Xu , Jiayi Liu , Ming Yan , Haotian Xu , Jinghui Si , Zhuoran Zhou , Peng Yi , Xing Gao , Jitao Sang , Rong Zhang , Ji Zhang , Chao Peng , Fei Huang , Jingren Zhou

This paper presents a summary of the VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models (LMMs), hosted as part of the ICCV 2025 Workshop on Visual Quality Assessment. The challenge aims to evaluate and enhance…

The rapid advancement of Chinese LLMs underscores the need for vertical-domain evaluations to ensure reliable applications. However, existing benchmarks often lack domain coverage and provide limited insights into the Chinese working…

Computation and Language · Computer Science 2025-09-04 Mengze Hong , Wailing Ng , Chen Jason Zhang , Di Jiang

Large language models (LLMs) have shown significant promise across various medical applications, with ophthalmology being a notable area of focus. Many ophthalmic tasks have shown substantial improvement through the integration of LLMs.…

Computation and Language · Computer Science 2025-02-04 Chengfeng Zhou , Ji Wang , Juanjuan Qin , Yining Wang , Ling Sun , Weiwei Dai

Multimodal large language models have demonstrated remarkable reasoning capabilities in various visual tasks. However, their abilities in K12 scenarios are still systematically underexplored. Previous studies suffer from various limitations…

Artificial Intelligence · Computer Science 2025-06-03 Chong Li , Chenglin Zhu , Tao Zhang , Mingan Lin , Zenan Zhou , Jian Xie

Vision-language models (VLMs) hold promise for enhancing visualization tools, but effective human-AI collaboration hinges on a shared perceptual understanding of visual content. Prior studies assessed VLM visualization literacy through…

Human-Computer Interaction · Computer Science 2025-11-10 Péter Ferenc Gyarmati , Manfred Klaffenböck , Laura Koesten , Torsten Möller

Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding, often misinterpreting symbols, gestures, and artifacts due to biases in predominantly Western-centric training data. In this paper,…

Artificial Intelligence · Computer Science 2025-01-03 Shudong Liu , Yiqiao Jin , Cheng Li , Derek F. Wong , Qingsong Wen , Lichao Sun , Haipeng Chen , Xing Xie , Jindong Wang