English

Benchmarking and Improving LVLMs on Event Extraction from Multimedia Documents

Computation and Language 2025-09-17 v1 Multimedia

Abstract

The proliferation of multimedia content necessitates the development of effective Multimedia Event Extraction (M2E2) systems. Though Large Vision-Language Models (LVLMs) have shown strong cross-modal capabilities, their utility in the M2E2 task remains underexplored. In this paper, we present the first systematic evaluation of representative LVLMs, including DeepSeek-VL2 and the Qwen-VL series, on the M2E2 dataset. Our evaluations cover text-only, image-only, and cross-media subtasks, assessed under both few-shot prompting and fine-tuning settings. Our key findings highlight the following valuable insights: (1) Few-shot LVLMs perform notably better on visual tasks but struggle significantly with textual tasks; (2) Fine-tuning LVLMs with LoRA substantially enhances model performance; and (3) LVLMs exhibit strong synergy when combining modalities, achieving superior performance in cross-modal settings. We further provide a detailed error analysis to reveal persistent challenges in areas such as semantic precision, localization, and cross-modal grounding, which remain critical obstacles for advancing M2E2 capabilities.

Keywords

Cite

@article{arxiv.2509.12876,
  title  = {Benchmarking and Improving LVLMs on Event Extraction from Multimedia Documents},
  author = {Fuyu Xing and Zimu Wang and Wei Wang and Haiyang Zhang},
  journal= {arXiv preprint arXiv:2509.12876},
  year   = {2025}
}

Comments

Accepted at INLG 2025. Camera-ready version

R2 v1 2026-07-01T05:38:47.957Z