English

Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures

Information Retrieval 2025-10-24 v1 Computation and Language Computer Vision and Pattern Recognition Machine Learning

Abstract

Question Answering (QA) systems have traditionally relied on structured text data, but the rapid growth of multimedia content (images, audio, video, and structured metadata) has introduced new challenges and opportunities for retrieval-augmented QA. In this survey, we review recent advancements in QA systems that integrate multimedia retrieval pipelines, focusing on architectures that align vision, language, and audio modalities with user queries. We categorize approaches based on retrieval methods, fusion techniques, and answer generation strategies, and analyze benchmark datasets, evaluation protocols, and performance tradeoffs. Furthermore, we highlight key challenges such as cross-modal alignment, latency-accuracy tradeoffs, and semantic grounding, and outline open problems and future research directions for building more robust and context-aware QA systems leveraging multimedia data.

Keywords

Cite

@article{arxiv.2510.20193,
  title  = {Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures},
  author = {Rahul Raja and Arpita Vats},
  journal= {arXiv preprint arXiv:2510.20193},
  year   = {2025}
}

Comments

In Proceedings of the 2nd ACM Workshop in AI-powered Question and Answering Systems (AIQAM '25), October 27-28, 2025, Dublin, Ireland. ACM, New York, NY, USA, 8 pages. https://doi.org/10.1145/3746274.3760393