English

M3TR: Temporal Retrieval Enhanced Multi-Modal Micro-video Popularity Prediction

Multimedia 2026-03-02 v2 Artificial Intelligence

Abstract

Accurately predicting the popularity of micro-videos is a critical but challenging task, characterized by volatile, `rollercoaster-like' engagement dynamics. Existing methods often fail to capture these complex temporal patterns, leading to inaccurate long-term forecasts. This failure stems from two fundamental limitations: \ding{172} a superficial understanding of user feedback dynamics, which overlooks the mutually exciting and decaying nature of interactions such as likes, comments, and shares; and~\ding{173} retrieval mechanisms that rely solely on static content similarity, ignoring the crucial patterns of how a video's popularity evolves over time. To address these limitations, we propose \textbf{M3^3TR}, a \textbf{T}emporal \textbf{R}etrieval enhanced \textbf{M}ulti-\textbf{M}odal framework that uniquely synergizes fine-grained temporal modeling with a novel temporal-aware retrieval process for \textbf{M}icro-video popularity prediction. At its core, M3^3TR introduces a Mamba-Hawkes Process (MHP) module to explicitly model user feedback as a sequence of self-exciting events, capturing the intricate, long-range dependencies within user interactions (for \textbf{limitation} \ding{172}). This rich temporal representation then powers a temporal-aware retrieval engine that identifies historically relevant videos based on a combined similarity of both their multi-modal content (visual, audio, text) and their popularity trajectories (for \textbf{limitation} \ding{173}). By augmenting the target video's features with this retrieved knowledge, M3^3TR achieves a comprehensive understanding of prediction. Extensive experiments on two real-world datasets demonstrate the superiority of our framework. M3^3TR achieves state-of-the-art performance, outperforming previous methods by up to \textbf{19.3}\% in nMSE and showing significant gains in addressing long-term prediction challenges.

Keywords

Cite

@article{arxiv.2411.15455,
  title  = {M3TR: Temporal Retrieval Enhanced Multi-Modal Micro-video Popularity Prediction},
  author = {Jiacheng Lu and Weijian Wang and Mingyuan Xiao and Yang Hua and Tao Song and Jiaru Zhang and Bo Peng and Cheng Hua and Haibing Guan},
  journal= {arXiv preprint arXiv:2411.15455},
  year   = {2026}
}

Comments

14 pages,9 figures

R2 v1 2026-06-28T20:09:51.534Z