English
Related papers

Related papers: Fully Automatic Video Colorization with Self-Regul…

200 papers

We propose a method for generating a temporally remapped video that matches the desired target duration while maximally preserving natural video dynamics. Our approach trains a neural network through self-supervision to recognize and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Simon Jenni , Markus Woodson , Fabian Caba Heilbron

Colorization methods using deep neural networks have become a recent trend. However, most of them do not allow user inputs, or only allow limited user inputs (only global inputs or only local inputs), to control the output colorful images.…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Yi Xiao , Peiyao Zhou , Yan Zheng

Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly focus on images. In…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Haozhi Huang , Senzhe Xu , Junxiong Cai , Wei Liu , Shimin Hu

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Video colour editing is a crucial task for content creation, yet existing solutions either require painstaking frame-by-frame manipulation or produce unrealistic results with temporal artefacts. We present a practical, training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Chaitat Utintu , Pinaki Nath Chowdhury , Aneeshan Sain , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

This paper introduces Comprehensive Relighting, the first all-in-one approach that can both control and harmonize the lighting from an image or video of humans with arbitrary body parts from any scene. Building such a generalizable model is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Junying Wang , Jingyuan Liu , Xin Sun , Krishna Kumar Singh , Zhixin Shu , He Zhang , Jimei Yang , Nanxuan Zhao , Tuanfeng Y. Wang , Simon S. Chen , Ulrich Neumann , Jae Shin Yoon

Image colorization aims to bring colors back to grayscale images. Automatic image colorization methods, which requires no additional guidance, struggle to generate high-quality images due to color ambiguity, and provides limited user…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yifan Li , Shuai Yang , Jiaying Liu

This paper presents the first end-to-end network for exemplar-based video colorization. The main challenge is to achieve temporal consistency while remaining faithful to the reference style. To address this issue, we introduce a recurrent…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Bo Zhang , Mingming He , Jing Liao , Pedro V. Sander , Lu Yuan , Amine Bermak , Dong Chen

Coloring line art images based on the colors of reference images is an important stage in animation production, which is time-consuming and tedious. In this paper, we propose a deep architecture to automatically color line art videos with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Min Shi , Jia-Qi Zhang , Shu-Yu Chen , Lin Gao , Yu-Kun Lai , Fang-Lue Zhang

Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one. The question of how to strike a good trade-off between visual quality and computational speed has remained one of the open challenges in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiyue Zhao , Xin Li , Zhan Peng , Xianrui Luo , Xinyi Ye , Hao Lu , Zhiguo Cao

We propose a hybrid recurrent Video Colorization with Hybrid Generative Adversarial Network (VCGAN), an improved approach to video colorization using end-to-end learning. The VCGAN addresses two prevalent issues in the video colorization…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuzhi Zhao , Lai-Man Po , Wing-Yin Yu , Yasar Abbas Ur Rehman , Mengyang Liu , Yujia Zhang , Weifeng Ou

We present the Colorization Transformer, a novel approach for diverse high fidelity image colorization based on self-attention. Given a grayscale image, the colorization proceeds in three steps. We first use a conditional autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Manoj Kumar , Dirk Weissenborn , Nal Kalchbrenner

Image colorization is the process of colorizing grayscale images or recoloring an already-color image. This image manipulation can be used for grayscale satellite, medical and historical images making them more expressive. With the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Ahmed Samir Ragab , Shereen Aly Taie , Howida Youssry Abdelnaby

Over the last decade, the process of automatic image colorization has been of significant interest for several application areas including restoration of aged or degraded images. This problem is highly ill-posed due to the large degrees of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Kamyar Nazeri , Eric Ng , Mehran Ebrahimi

Video portraits relighting is critical in user-facing human photography, especially for immersive VR/AR experience. Recent advances still fail to recover consistent relit result under dynamic illuminations from monocular RGB stream,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Longwen Zhang , Qixuan Zhang , Minye Wu , Jingyi Yu , Lan Xu

In this paper, we present a color transfer algorithm to colorize a broad range of gray images without any user intervention. The algorithm uses a machine learning-based approach to automatically colorize grayscale images. The algorithm uses…

Graphics · Computer Science 2017-04-18 Raj Kumar Gupta , Alex Yong-Sang Chia , Deepu Rajan , Huang Zhiyong

Image acquisition in low-light conditions suffers from poor quality and significant degradation in visual aesthetics. This affects the visual perception of the acquired image and the performance of various computer vision and image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Sumit Shekhar , Max Reimann , Amir Semmo , Sebastian Pasewaldt , Jürgen Döllner , Matthias Trapp

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Automatic video colorization is inherently an ill-posed problem because each monochrome frame has multiple optional color candidates. Previous exemplar-based video colorization methods restrict the user's imagination due to the elaborate…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zheng Chang , Shuchen Weng , Huan Ouyang , Yu Li , Si Li , Boxin Shi