Artificial Intelligence · Computer Science
MARBLE: A Hard Benchmark for Multimodal Spatial Reasoning and Planning
Yulun Jiang, Yekun Chai, Maria Brbić, Michael Moor
2025-07-01
Artificial Intelligence · Computer Science
Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables
Yitong Zhou, Mingyue Cheng, Qingyang Mao, Yucong Luo +6
2025-12-12
Computation and Language · Computer Science
Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning
Bohao Yang, Yingji Zhang, Dong Liu, André Freitas +1
2025-02-26
Computation and Language · Computer Science
Multimodal Table Understanding
Mingyu Zheng, Xinwei Feng, Qingyi Si, Qiaoqiao She +3
2024-06-13
Computer Vision and Pattern Recognition · Computer Science
MathScape: Benchmarking Multimodal Large Language Models in Real-World Mathematical Contexts
Hao Liang, Linzhuang Sun, Minxuan Zhou, Zirong Chen +6
2026-02-24
Computation and Language · Computer Science
ReasonTabQA: A Comprehensive Benchmark for Table Question Answering from Real World Industrial Scenarios
Changzai Pan, Jie Zhang, Kaiwen Wei, Chenshuo Pan +14
2026-01-13
Computer Vision and Pattern Recognition · Computer Science
MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Models
Jun Feng, Zixin Wang, Zhentao Zhang, Yue Guo +4
2025-08-11
Computer Vision and Pattern Recognition · Computer Science
MMRel: Benchmarking Relation Understanding in Multi-Modal Large Language Models
Jiahao Nie, Gongjie Zhang, Wenbin An, Yun Xing +3
2025-12-19
Computation and Language · Computer Science
A Survey on Benchmarks of Multimodal Large Language Models
Jian Li, Weiheng Lu, Hao Fei, Meng Luo +10
2024-09-09
Artificial Intelligence · Computer Science
Efficient Table Retrieval and Understanding with Multimodal Large Language Models
Zhuoyan Xu, Haoyang Fang, Boran Han, Bonan Min +3
2026-02-10
Computer Vision and Pattern Recognition · Computer Science
Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark
Ziming Cheng, Binrui Xu, Lisheng Gong, Zuhe Song +13
2025-06-06
Machine Learning · Computer Science
MapTab: Are MLLMs Ready for Multi-Criteria Route Planning in Heterogeneous Graphs?
Ziqiao Shang, Lingyue Ge, Zi-Jian Cheng, Shi-Yu Tian +9
2026-05-22
Computer Vision and Pattern Recognition · Computer Science
ChartBench: A Benchmark for Complex Visual Reasoning in Charts
Zhengzhuo Xu, Sinan Du, Yiyan Qi, Chengjin Xu +2
2024-06-21
Artificial Intelligence · Computer Science
A Survey of Multimodal Mathematical Reasoning: From Perception, Alignment to Reasoning
Tianyu Yang, Sihong Wu, Yilun Zhao, Zhenwen Liang +5
2026-04-15
Computer Vision and Pattern Recognition · Computer Science
MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models
Pengfei Zhou, Fanrui Zhang, Xiaopeng Peng, Zhaopan Xu +16
2025-04-09
Computer Vision and Pattern Recognition · Computer Science
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation
Jinsheng Huang, Liang Chen, Taian Guo, Fu Zeng +12
2025-02-28
Computation and Language · Computer Science
Knowledge-Aware Reasoning over Multimodal Semi-structured Tables
Suyash Vardhan Mathur, Jainit Sushil Bafna, Kunal Kartik, Harshita Khandelwal +4
2024-08-27
Artificial Intelligence · Computer Science
A Survey on Multimodal Benchmarks: In the Era of Large AI Models
Lin Li, Guikun Chen, Hanrong Shi, Jun Xiao +1
2024-09-30
Computation and Language · Computer Science
TableEval: A Real-World Benchmark for Complex, Multilingual, and Multi-Structured Table Question Answering
Junnan Zhu, Jingyi Wang, Bohan Yu, Xiaoyu Wu +3
2025-09-23
Artificial Intelligence · Computer Science
OmniMatBench: A Human-Calibrated Multimodal Reasoning Benchmark Across 19 Materials Science Subfields
Wanhao Liu, Jiaqing Xie, Qian Tan, Weida Wang +9
2026-05-29
Computation and Language · Computer Science
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity
Zheyuan Yang, Liqiang Shang, Junjie Chen, Xun Yang +5
2026-05-08
Computation and Language · Computer Science
MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems
Zifeng Zhu, Mengzhao Jia, Zhihan Zhang, Lang Li +1
2025-02-11
Computation and Language · Computer Science
Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models
Qianqi Yan, Yue Fan, Hongquan Li, Shan Jiang +4
2025-06-12
Computation and Language · Computer Science
CORDIAL: Can Multimodal Large Language Models Effectively Understand Coherence Relationships?
Aashish Anantha Ramakrishnan, Aadarsh Anantha Ramakrishnan, Dongwon Lee
2025-06-10