English
Related papers

Related papers: SEED-Bench-2: Benchmarking Multimodal Large Langua…

200 papers

The advent of Multimodal Large Language Models, leveraging the power of Large Language Models, has recently demonstrated superior multimodal understanding and reasoning abilities, heralding a new era for artificial general intelligence.…

Artificial Intelligence · Computer Science 2025-04-14 Lu Qiu , Yi Chen , Yuying Ge , Yixiao Ge , Ying Shan , Xihui Liu

Multimodal language analysis is a rapidly evolving field that leverages multiple modalities to enhance the understanding of high-level semantics underlying human conversational utterances. Despite its significance, little research has…

Computation and Language · Computer Science 2025-04-25 Hanlei Zhang , Zhuohang Li , Yeshuang Zhu , Hua Xu , Peiwu Wang , Haige Zhu , Jie Zhou , Jinchao Zhang

Multimodal large language models (MLLMs) have emerged as a promising paradigm for dental image analysis. However, their ability to capture the multi-level cognitive processes required for radiographic analysis remains unclear. Here, we…

Computation and Language · Computer Science 2026-05-11 Rongyang Wang , Shuang Zhou , Jiashuo Wang , Wenya Xie , Xiaoxia Che

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Multimodal reasoning, which integrates language and visual cues into problem solving and decision making, is a fundamental aspect of human intelligence and a crucial step toward artificial general intelligence. However, the evaluation of…

Multimodal large language models (MLLMs) have enabled a wide range of advanced vision-language applications, including fine-grained object recognition and contextual understanding. When querying specific regions or objects in an image,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mingjie Xu , Jinpeng Chen , Yuzhi Zhao , Jason Chun Lok Li , Yue Qiu , Zekang Du , Mengyang Wu , Pingping Zhang , Kun Li , Hongzheng Yang , Wenao Ma , Jiaheng Wei , Qinbin Li , Kangcheng Liu , Wenqiang Lei

The Multimodal Large Language Model (MLLM) is currently experiencing rapid growth, driven by the advanced capabilities of LLMs. Unlike earlier specialists, existing MLLMs are evolving towards a Multimodal Generalist paradigm. Initially…

Since the release of ChatGPT, the field of Natural Language Processing has experienced rapid advancements, particularly in Large Language Models (LLMs) and their multimodal counterparts, Large Multimodal Models (LMMs). Despite their…

Computation and Language · Computer Science 2024-08-27 Florian Schneider , Sunayana Sitaram

The rapid advancement of Multimodal Large Language Models (MLLMs) has ignited discussions regarding their potential to surpass human performance in multimodal tasks. In response, we introduce MANBench (Multimodal Ability Norms Benchmark), a…

Computation and Language · Computer Science 2025-06-16 Han Zhou , Qitong Xu , Yiheng Dong , Xin Yang

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

This paper provides a comprehensive survey of the latest research on multilingual large language models (MLLMs). MLLMs not only are able to understand and generate language across linguistic boundaries, but also represent an important…

Computation and Language · Computer Science 2024-11-20 Shaolin Zhu , Supryadi , Shaoyang Xu , Haoran Sun , Leiyu Pan , Menglong Cui , Jiangcun Du , Renren Jin , António Branco , Deyi Xiong

We explore Multimodal Large Language Models (MLLMs), which integrate LLMs like GPT-4 to handle multimodal data, including text, images, audio, and more. MLLMs demonstrate capabilities such as generating image captions and answering…

Computation and Language · Computer Science 2025-01-09 Shezheng Song , Xiaopeng Li , Shasha Li , Shan Zhao , Jie Yu , Jun Ma , Xiaoguang Mao , Weimin Zhang

Large language models (LLMs) have shown great promise in generating structured diagrams from natural language descriptions, particularly Mermaid sequence diagrams for software engineering. However, the lack of existing benchmarks to assess…

Software Engineering · Computer Science 2026-04-28 Basel Shbita , Farhan Ahmed , Chad DeLuca

The recent development of Multimodal Large Language Models (MLLMs) has significantly advanced AI's ability to understand visual modalities. However, existing evaluation benchmarks remain limited to single-turn question answering,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Yaning Pan , Qianqian Xie , Guohui Zhang , Zekun Wang , Yongqian Wen , Yuanxing Zhang , Haoxuan Hu , Zhiyu Pan , Yibing Huang , Zhidong Gan , Yonghong Lin , An Ping , Shihao Li , Yanghai Wang , Tianhao Peng , Jiaheng Liu

Artificial Intelligence (AI) has demonstrated significant capabilities in various fields, and in areas such as human-computer interaction (HCI), embodied intelligence, and the design and animation of virtual digital humans, both…

Computation and Language · Computer Science 2024-11-19 Yingjie Zhou , Zicheng Zhang , Jiezhang Cao , Jun Jia , Yanwei Jiang , Farong Wen , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

The popularity of multimodal large language models (MLLMs) has triggered a recent surge in research efforts dedicated to evaluating these models. Nevertheless, existing evaluation studies of MLLMs primarily focus on the comprehension and…

Computation and Language · Computer Science 2023-10-16 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

Large multimodal language models (MLLMs) such as GPT-4V and GPT-4o have achieved remarkable advancements in understanding and generating multimodal content, showcasing superior quality and capabilities across diverse tasks. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Xuelu Feng , Yunsheng Li , Dongdong Chen , Mei Gao , Mengchen Liu , Junsong Yuan , Chunming Qiao

Generative AI models have shown impressive performance on many Natural Language Processing tasks such as language understanding, reasoning, and language generation. An important question being asked by the AI community today is about the…

Seed science is essential for modern agriculture, directly influencing crop yields and global food security. However, challenges such as interdisciplinary complexity and high costs with limited returns hinder progress, leading to a shortage…

Computation and Language · Computer Science 2025-05-20 Jie Ying , Zihong Chen , Zhefan Wang , Wanli Jiang , Chenyang Wang , Zhonghang Yuan , Haoyang Su , Huanjun Kong , Fan Yang , Nanqing Dong

The rapid advancements in the development of multimodal large language models (MLLMs) have consistently led to new breakthroughs on various benchmarks. In response, numerous challenging and comprehensive benchmarks have been proposed to…