English

MJ1: Multimodal Judgment via Grounded Verification

Machine Learning 2026-03-25 v2

Abstract

Multimodal judges struggle to ground decisions in visual evidence. We present MJ1, a multimodal judge trained with reinforcement learning that enforces visual grounding through a structured grounded verification chain (observations \rightarrow claims \rightarrow verification \rightarrow evaluation \rightarrow scoring) and a counterfactual consistency reward that penalizes position bias. Even without training, our mechanism improves base-model accuracy on MMRB2 by +3.8 points on Image Editing and +1.7 on Multimodal Reasoning. After training, MJ1, with only 3B active parameters, achieves 77.0% accuracy on MMRB2 and surpasses orders-of-magnitude larger models like Gemini-3-Pro. These results show that grounded verification and consistency-based training substantially improve multimodal judgment without increasing model scale.

Keywords

Cite

@article{arxiv.2603.07990,
  title  = {MJ1: Multimodal Judgment via Grounded Verification},
  author = {Bhavesh Kumar and Dylan Feng and Leonard Tang},
  journal= {arXiv preprint arXiv:2603.07990},
  year   = {2026}
}
R2 v1 2026-07-01T11:09:42.174Z