English

Physics-Based Benchmarking Metrics for Multimodal Synthetic Images

Computer Vision and Pattern Recognition 2026-05-11 v3 Artificial Intelligence

Abstract

Current state of the art measures like BLEU, CIDEr, VQA score, SigLIP-2 and CLIPScore are often unable to capture semantic or structural accuracy, especially for domain-specific or context-dependent scenarios. For this, this paper proposes a Physics-Constrained Multimodal Data Evaluation (PCMDE) metric combining large language models with reasoning, knowledge based mapping and vision-language models to overcome these limitations. The architecture is comprised of three main stages: (1) feature extraction of spatial and semantic information with multimodal features through object detection and VLMs; (2) Confidence-Weighted Component Fusion for adaptive component-level validation; and (3) physics-guided reasoning using large language models for structural and relational constraints (e.g., alignment, position, consistency) enforcement.

Keywords

Cite

@article{arxiv.2511.15204,
  title  = {Physics-Based Benchmarking Metrics for Multimodal Synthetic Images},
  author = {Kishor Datta Gupta and Marufa Kamal and Md. Mahfuzur Rahman and Fahad Rahman and Mohd Ariful Haque and Sunzida Siddique},
  journal= {arXiv preprint arXiv:2511.15204},
  year   = {2026}
}
R2 v1 2026-07-01T07:44:51.231Z