English

Clear Skies Ahead: Towards Real-Time Automatic Sky Replacement in Video

Computer Vision and Pattern Recognition 2019-03-08 v1

Abstract

Digital videos such as those captured by a smartphone often exhibit exposure inconsistencies, a poorly exposed sky, or simply suffer from an uninteresting or plain looking sky. Professionals may edit these videos using advanced and time-consuming tools unavailable to most users, to replace the sky with a more expressive or imaginative sky. In this work, we propose an algorithm for automatic replacement of the sky region in a video with a different sky, providing nonprofessional users with a simple yet efficient tool to seamlessly replace the sky. The method is fast, achieving close to real-time performance on mobile devices and the user's involvement can remain as limited as simply selecting the replacement sky.

Keywords

Cite

@article{arxiv.1903.02582,
  title  = {Clear Skies Ahead: Towards Real-Time Automatic Sky Replacement in Video},
  author = {Tavi Halperin and Harel Cain and Ofir Bibi and Michael Werman},
  journal= {arXiv preprint arXiv:1903.02582},
  year   = {2019}
}

Comments

Eurographics 2019. Supplementary video: https://youtu.be/1uZ46YzX-pI