English

Cross-Modal State-Space Graph Reasoning for Structured Summarization

Computation and Language 2025-07-31 v2 Graphics

Abstract

The ability to extract compact, meaningful summaries from large-scale and multimodal data is critical for numerous applications, ranging from video analytics to medical reports. Prior methods in cross-modal summarization have often suffered from high computational overheads and limited interpretability. In this paper, we propose a \textit{Cross-Modal State-Space Graph Reasoning} (\textbf{CSS-GR}) framework that incorporates a state-space model with graph-based message passing, inspired by prior work on efficient state-space models. Unlike existing approaches relying on purely sequential models, our method constructs a graph that captures inter- and intra-modal relationships, allowing more holistic reasoning over both textual and visual streams. We demonstrate that our approach significantly improves summarization quality and interpretability while maintaining computational efficiency, as validated on standard multimodal summarization benchmarks. We also provide a thorough ablation study to highlight the contributions of each component.

Keywords

Cite

@article{arxiv.2503.20988,
  title  = {Cross-Modal State-Space Graph Reasoning for Structured Summarization},
  author = {Hannah Kim and Sofia Martinez and Jason Lee},
  journal= {arXiv preprint arXiv:2503.20988},
  year   = {2025}
}

Comments

arXiv admin note: This paper has been withdrawn by arXiv due to disputed and unverifiable authorship and affiliation

R2 v1 2026-06-28T22:35:53.711Z