Computer Vision and Pattern Recognition · Computer Science
MMR: Evaluating Reading Ability of Large Multimodal Models
Jian Chen, Ruiyi Zhang, Yufan Zhou, Ryan Rossi +2
2024-08-28
Software Engineering · Computer Science
LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Research
Shuo Yan, Ruochen Li, Ziming Luo, Zimu Wang +10
2025-06-24
Computation and Language · Computer Science
MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation
Xiaoyuan Li, Keqin Bao, Yubo Ma, Moxin Li +5
2026-05-22
Computer Vision and Pattern Recognition · Computer Science
XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?
Fengxiang Wang, Hongzhen Wang, Mingshuo Chen, Di Wang +8
2025-04-01
Computation and Language · Computer Science
Can LLMs reason over extended multilingual contexts? Towards long-context evaluation beyond retrieval and haystacks
Amey Hengle, Prasoon Bajpai, Soham Dan, Tanmoy Chakraborty
2025-04-18
Computer Vision and Pattern Recognition · Computer Science
OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning
Ling Fu, Zhebin Kuang, Jiajun Song, Mingxin Huang +20
2025-06-06
Computation and Language · Computer Science
VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
Junpeng Liu, Yifan Song, Bill Yuchen Lin, Wai Lam +3
2024-04-10
Computer Vision and Pattern Recognition · Computer Science
Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
Chun-Hsiao Yeh, Chenyu Wang, Shengbang Tong, Ta-Ying Cheng +6
2025-04-29
Computer Vision and Pattern Recognition · Computer Science
VisR-Bench: An Empirical Study on Visual Retrieval-Augmented Generation for Multilingual Long Document Understanding
Jian Chen, Ming Li, Jihyung Kil, Chenguang Wang +5
2025-08-26
Computer Vision and Pattern Recognition · Computer Science
LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Models
Ruilin Yao, Bo Zhang, Jirui Huang, Xinwei Long +17
2026-05-14
Computer Vision and Pattern Recognition · Computer Science
VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Models
Mingjie Xu, Jinpeng Chen, Yuzhi Zhao, Jason Chun Lok Li +11
2025-11-17
Computer Vision and Pattern Recognition · Computer Science
Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLM
Xinyu Fang, Zhijian Chen, Kai Lan, Lixin Ma +9
2025-03-20
Computer Vision and Pattern Recognition · Computer Science
HM-Bench: A Comprehensive Benchmark for Multimodal Large Language Models in Hyperspectral Remote Sensing
Xinyu Zhang, Zurong Mai, Qingmei Li, Zjin Liao +12
2026-04-13
Computer Vision and Pattern Recognition · Computer Science
MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
Kaining Ying, Fanqing Meng, Jin Wang, Zhiqian Li +18
2024-04-25
Computer Vision and Pattern Recognition · Computer Science
Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models
Yu Zeng, Wenxuan Huang, Zhen Fang, Shuang Chen +13
2026-03-03
Computer Vision and Pattern Recognition · Computer Science
MindBench: A Comprehensive Benchmark for Mind Map Structure Recognition and Analysis
Lei Chen, Feng Yan, Yujie Zhong, Shaoxiang Chen +2
2024-07-04
Computer Vision and Pattern Recognition · Computer Science
SEED-Bench-2: Benchmarking Multimodal Large Language Models
Bohao Li, Yuying Ge, Yixiao Ge, Guangzhi Wang +3
2023-11-30
Computation and Language · Computer Science
A Survey on Benchmarks of Multimodal Large Language Models
Jian Li, Weiheng Lu, Hao Fei, Meng Luo +10
2024-09-09
Computation and Language · Computer Science
MATP-BENCH: Can MLLM Be a Good Automated Theorem Prover for Multimodal Problems?
Zhitao He, Zongwei Lyu, Dazhong Chen, Dadi Guo +1
2025-06-09
Computer Vision and Pattern Recognition · Computer Science
MT-Video-Bench: A Holistic Video Understanding Benchmark for Evaluating Multimodal LLMs in Multi-Turn Dialogues
Yaning Pan, Qianqian Xie, Guohui Zhang, Zekun Wang +12
2026-01-09
Computer Vision and Pattern Recognition · Computer Science
SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension
Bohao Li, Yuying Ge, Yi Chen, Yixiao Ge +2
2024-04-26
Computer Vision and Pattern Recognition · Computer Science
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin +10
2025-10-27
Computation and Language · Computer Science
MileBench: Benchmarking MLLMs in Long Context
Dingjie Song, Shunian Chen, Guiming Hardy Chen, Fei Yu +2
2024-05-16