English

AICA-Bench: Holistically Examining the Capabilities of VLMs in Affective Image Content Analysis

Computer Vision and Pattern Recognition 2026-04-08 v1

Abstract

Vision-Language Models (VLMs) have demonstrated strong capabilities in perception, yet holistic Affective Image Content Analysis (AICA), which integrates perception, reasoning, and generation into a unified framework, remains underexplored. To address this gap, we introduce AICA-Bench, a comprehensive benchmark with three core tasks: Emotion Understanding (EU), Emotion Reasoning (ER), and Emotion-Guided Content Generation (EGCG). We evaluate 23 VLMs and identify two major limitations: weak intensity calibration and shallow open-ended descriptions. To address these issues, we propose Grounded Affective Tree (GAT) Prompting, a training-free framework that combines visual scaffolding with hierarchical reasoning. Experiments show that GAT reduces intensity errors and improves descriptive depth, providing a strong baseline for future research on affective multimodal understanding and generation.

Keywords

Cite

@article{arxiv.2604.05900,
  title  = {AICA-Bench: Holistically Examining the Capabilities of VLMs in Affective Image Content Analysis},
  author = {Dong She and Xianrong Yao and Liqun Chen and Jinghe Yu and Yang Gao and Zhanpeng Jin},
  journal= {arXiv preprint arXiv:2604.05900},
  year   = {2026}
}

Comments

Accepted by Findings of ACL 2026