English

Pseudo Dataset Generation for Out-of-Domain Multi-Camera View Recommendation

Computer Vision and Pattern Recognition 2024-10-18 v1

Abstract

Multi-camera systems are indispensable in movies, TV shows, and other media. Selecting the appropriate camera at every timestamp has a decisive impact on production quality and audience preferences. Learning-based view recommendation frameworks can assist professionals in decision-making. However, they often struggle outside of their training domains. The scarcity of labeled multi-camera view recommendation datasets exacerbates the issue. Based on the insight that many videos are edited from the original multi-camera videos, we propose transforming regular videos into pseudo-labeled multi-camera view recommendation datasets. Promisingly, by training the model on pseudo-labeled datasets stemming from videos in the target domain, we achieve a 68% relative improvement in the model's accuracy in the target domain and bridge the accuracy gap between in-domain and never-before-seen domains.

Keywords

Cite

@article{arxiv.2410.13585,
  title  = {Pseudo Dataset Generation for Out-of-Domain Multi-Camera View Recommendation},
  author = {Kuan-Ying Lee and Qian Zhou and Klara Nahrstedt},
  journal= {arXiv preprint arXiv:2410.13585},
  year   = {2024}
}

Comments

Accepted to VCIP 2024. Project page: https://eric11220.github.io/publication/VCIP24/