English
Related papers

Related papers: MMT-Bench: A Comprehensive Multimodal Benchmark fo…

200 papers

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in visual understanding, but their application to long-term Earth observation analysis remains limited, primarily focusing on single-temporal or bi-temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Weihao Xuan , Junjue Wang , Heli Qi , Zihang Chen , Zhuo Zheng , Yanfei Zhong , Junshi Xia , Naoto Yokoya

Multimodal Large Language Models (MLLMs) have gained significant attention recently, showing remarkable potential in artificial general intelligence. However, assessing the utility of MLLMs presents considerable challenges, primarily due to…

Computation and Language · Computer Science 2024-06-12 Dongping Chen , Ruoxi Chen , Shilin Zhang , Yinuo Liu , Yaochen Wang , Huichi Zhou , Qihui Zhang , Yao Wan , Pan Zhou , Lichao Sun

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

The astonishing breakthrough of multimodal large language models (MLLMs) has necessitated new benchmarks to quantitatively assess their capabilities, reveal their limitations, and indicate future research directions. However, this is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Fengxiang Wang , Hongzhen Wang , Mingshuo Chen , Di Wang , Yulin Wang , Zonghao Guo , Qiang Ma , Long Lan , Wenjing Yang , Jing Zhang , Zhiyuan Liu , Maosong Sun

This study explores the capabilities of multimodal large language models (LLMs) in handling challenging multistep tasks that integrate language and vision, focusing on model steerability, composability, and the application of long-term…

Artificial Intelligence · Computer Science 2023-12-20 David Noever , Samantha Elizabeth Miller Noever

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress in tackling complex multimodal tasks. Among these cutting-edge developments, Google's Bard stands out for its remarkable multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Wenqi Shao , Meng Lei , Yutao Hu , Peng Gao , Kaipeng Zhang , Fanqing Meng , Peng Xu , Siyuan Huang , Hongsheng Li , Yu Qiao , Ping Luo

Recent advances in multimodal large language models (MLLMs) have demonstrated substantial potential in video understanding. However, existing benchmarks fail to comprehensively evaluate synergistic reasoning capabilities across audio and…

The exponential growth of large language models (LLMs) has opened up numerous possibilities for multimodal AGI systems. However, the progress in vision and vision-language foundation models, which are also critical elements of multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhe Chen , Jiannan Wu , Wenhai Wang , Weijie Su , Guo Chen , Sen Xing , Muyan Zhong , Qinglong Zhang , Xizhou Zhu , Lewei Lu , Bin Li , Ping Luo , Tong Lu , Yu Qiao , Jifeng Dai

The advent of Multimodal Large Language Models, leveraging the power of Large Language Models, has recently demonstrated superior multimodal understanding and reasoning abilities, heralding a new era for artificial general intelligence.…

Artificial Intelligence · Computer Science 2025-04-14 Lu Qiu , Yi Chen , Yuying Ge , Yixiao Ge , Ying Shan , Xihui Liu

Recent advances in multimodal large language models (LLMs) have highlighted their potential for medical and surgical applications. However, existing surgical datasets predominantly adopt a Visual Question Answering (VQA) format with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Tae-Min Choi , Tae Kyeong Jeong , Garam Kim , Jaemin Lee , Yeongyoon Koh , In Cheul Choi , Jae-Ho Chung , Jong Woong Park , Juyoun Park

The advent of large vision-language models (LVLMs) has spurred research into their applications in multi-modal contexts, particularly in video understanding. Traditional VideoQA benchmarks, despite providing quantitative metrics, often fail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Xinyu Fang , Kangrui Mao , Haodong Duan , Xiangyu Zhao , Yining Li , Dahua Lin , Kai Chen

Large language models (LLMs) and multimodal large models (MLLMs) are increasingly used for transportation tasks such as regulation question answering, traffic management support, engineering review, and autonomous-driving scene reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Han Gong , Zhen Zhou , Yunyang Shi , Yan Tan , Jinbiao Huo , Qi Hong , Zhiyuan Liu

Recent advances in multimodal large language models (MLLMs) have significantly enhanced video understanding capabilities, opening new possibilities for practical applications. Yet current video benchmarks focus largely on indoor scenes or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hao Wang , Eiki Murata , Lingfang Zhang , Ayako Sato , So Fukuda , Ziqi Yin , Wentao Hu , Keisuke Nakao , Yusuke Nakamura , Sebastian Zwirner , Yi-Chia Chen , Hiroyuki Otomo , Hiroki Ouchi , Daisuke Kawahara

PowerPoint presentations combine rich textual content with structured visual layouts, making them a natural testbed for evaluating the multimodal reasoning and layout understanding abilities of modern MLLMs. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zheng Huang , Xukai Liu , Tianyu Hu , Kai Zhang , Ye Liu

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ekta Gavas , Sudipta Banerjee , Chinmay Hegde , Nasir Memon

The goal of achieving Artificial General Intelligence (AGI) is to imitate humans and surpass them. Models such as OpenAI's o1, o3, and DeepSeek's R1 have demonstrated that large language models (LLMs) with human-like reasoning capabilities…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yansheng Qiu , Li Xiao , Zhaopan Xu , Pengfei Zhou , Zheng Wang , Kaipeng Zhang

The prevalence of vision-threatening eye diseases is a significant global burden, with many cases remaining undiagnosed or diagnosed too late for effective treatment. Large vision-language models (LVLMs) have the potential to assist in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zhenyue Qin , Yu Yin , Dylan Campbell , Xuansheng Wu , Ke Zou , Yih-Chung Tham , Ninghao Liu , Xiuzhen Zhang , Qingyu Chen

Large Multimodal Models (LMMs) have achieved remarkable progress across various capabilities; however, complex video reasoning in the scientific domain remains a significant and challenging frontier. Current video benchmarks predominantly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Andong Deng , Taojiannan Yang , Shoubin Yu , Lincoln Spencer , Mohit Bansal , Chen Chen , Serena Yeung-Levy , Xiaohan Wang

MM-Vet, with open-ended vision-language questions targeting at evaluating integrated capabilities, has become one of the most popular benchmarks for large multimodal model evaluation. MM-Vet assesses six core vision-language (VL)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Weihao Yu , Zhengyuan Yang , Lingfeng Ren , Linjie Li , Jianfeng Wang , Kevin Lin , Chung-Ching Lin , Zicheng Liu , Lijuan Wang , Xinchao Wang

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua