English

Graph Unfolding and Sampling for Transitory Video Summarization via Gershgorin Disc Alignment

Computer Vision and Pattern Recognition 2024-08-06 v1 Image and Video Processing Signal Processing

Abstract

User-generated videos (UGVs) uploaded from mobile phones to social media sites like YouTube and TikTok are short and non-repetitive. We summarize a transitory UGV into several keyframes in linear time via fast graph sampling based on Gershgorin disc alignment (GDA). Specifically, we first model a sequence of NN frames in a UGV as an MM-hop path graph Go\mathcal{G}^o for MNM \ll N, where the similarity between two frames within MM time instants is encoded as a positive edge based on feature similarity. Towards efficient sampling, we then "unfold" Go\mathcal{G}^o to a 11-hop path graph G\mathcal{G}, specified by a generalized graph Laplacian matrix L\mathcal{L}, via one of two graph unfolding procedures with provable performance bounds. We show that maximizing the smallest eigenvalue λmin(B)\lambda_{\min}(\mathbf{B}) of a coefficient matrix B=diag(h)+μL\mathbf{B} = \textit{diag}\left(\mathbf{h}\right) + \mu \mathcal{L}, where h\mathbf{h} is the binary keyframe selection vector, is equivalent to minimizing a worst-case signal reconstruction error. We maximize instead the Gershgorin circle theorem (GCT) lower bound λmin(B)\lambda^-_{\min}(\mathbf{B}) by choosing h\mathbf{h} via a new fast graph sampling algorithm that iteratively aligns left-ends of Gershgorin discs for all graph nodes (frames). Extensive experiments on multiple short video datasets show that our algorithm achieves comparable or better video summarization performance compared to state-of-the-art methods, at a substantially reduced complexity.

Keywords

Cite

@article{arxiv.2408.01859,
  title  = {Graph Unfolding and Sampling for Transitory Video Summarization via Gershgorin Disc Alignment},
  author = {Sadid Sahami and Gene Cheung and Chia-Wen Lin},
  journal= {arXiv preprint arXiv:2408.01859},
  year   = {2024}
}

Comments

13 pages, 5 figures

R2 v1 2026-06-28T18:03:12.907Z