English

A Multi-To-One Interview Paradigm for Efficient MLLM Evaluation

Computation and Language 2025-09-19 v1 Artificial Intelligence

Abstract

The rapid progress of Multi-Modal Large Language Models (MLLMs) has spurred the creation of numerous benchmarks. However, conventional full-coverage Question-Answering evaluations suffer from high redundancy and low efficiency. Inspired by human interview processes, we propose a multi-to-one interview paradigm for efficient MLLM evaluation. Our framework consists of (i) a two-stage interview strategy with pre-interview and formal interview phases, (ii) dynamic adjustment of interviewer weights to ensure fairness, and (iii) an adaptive mechanism for question difficulty-level chosen. Experiments on different benchmarks show that the proposed paradigm achieves significantly higher correlation with full-coverage results than random sampling, with improvements of up to 17.6% in PLCC and 16.7% in SRCC, while reducing the number of required questions. These findings demonstrate that the proposed paradigm provides a reliable and efficient alternative for large-scale MLLM benchmarking.

Keywords

Cite

@article{arxiv.2509.14886,
  title  = {A Multi-To-One Interview Paradigm for Efficient MLLM Evaluation},
  author = {Ye Shen and Junying Wang and Farong Wen and Yijin Guo and Qi Jia and Zicheng Zhang and Guangtao Zhai},
  journal= {arXiv preprint arXiv:2509.14886},
  year   = {2025}
}

Comments

5 pages, 2 figures

R2 v1 2026-07-01T05:43:42.490Z