English

Comparing Learning Paradigms for Egocentric Video Summarization

Computer Vision and Pattern Recognition 2025-06-30 v1 Artificial Intelligence

Abstract

In this study, we investigate various computer vision paradigms - supervised learning, unsupervised learning, and prompt fine-tuning - by assessing their ability to understand and interpret egocentric video data. Specifically, we examine Shotluck Holmes (state-of-the-art supervised learning), TAC-SUM (state-of-the-art unsupervised learning), and GPT-4o (a prompt fine-tuned pre-trained model), evaluating their effectiveness in video summarization. Our results demonstrate that current state-of-the-art models perform less effectively on first-person videos compared to third-person videos, highlighting the need for further advancements in the egocentric video domain. Notably, a prompt fine-tuned general-purpose GPT-4o model outperforms these specialized models, emphasizing the limitations of existing approaches in adapting to the unique challenges of first-person perspectives. Although our evaluation is conducted on a small subset of egocentric videos from the Ego-Exo4D dataset due to resource constraints, the primary objective of this research is to provide a comprehensive proof-of-concept analysis aimed at advancing the application of computer vision techniques to first-person videos. By exploring novel methodologies and evaluating their potential, we aim to contribute to the ongoing development of models capable of effectively processing and interpreting egocentric perspectives.

Keywords

Cite

@article{arxiv.2506.21785,
  title  = {Comparing Learning Paradigms for Egocentric Video Summarization},
  author = {Daniel Wen},
  journal= {arXiv preprint arXiv:2506.21785},
  year   = {2025}
}
R2 v1 2026-07-01T03:35:30.067Z