English

Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations

Computer Vision and Pattern Recognition 2026-03-03 v1 Artificial Intelligence

Abstract

While visual reasoning for simple analogies has received significant attention, compositional visual relations (CVR) remain relatively unexplored due to their greater complexity. To solve CVR tasks, we propose Predictive Reasoning with Augmented Anomaly Contrastive Learning (PR-A2^2CL), \ie, to identify an outlier image given three other images that follow the same compositional rules. To address the challenge of modelling abundant compositional rules, an Augmented Anomaly Contrastive Learning is designed to distil discriminative and generalizable features by maximizing similarity among normal instances while minimizing similarity between normal and anomalous outliers. More importantly, a predict-and-verify paradigm is introduced for rule-based reasoning, in which a series of Predictive Anomaly Reasoning Blocks (PARBs) iteratively leverage features from three out of the four images to predict those of the remaining one. Throughout the subsequent verification stage, the PARBs progressively pinpoint the specific discrepancies attributable to the underlying rules. Experimental results on SVRT, CVR and MC2^2R datasets show that PR-A2^2CL significantly outperforms state-of-the-art reasoning models.

Keywords

Cite

@article{arxiv.2603.01125,
  title  = {Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations},
  author = {Chengtai Li and Yuting He and Jianfeng Ren and Ruibin Bai and Yitian Zhao and Heng Yu and Xudong Jiang},
  journal= {arXiv preprint arXiv:2603.01125},
  year   = {2026}
}

Comments

Accepted by IEEE Transactions on Multimedia

R2 v1 2026-07-01T10:58:00.578Z