English
Related papers

Related papers: Reference-Based Video Colorization with Spatiotemp…

200 papers

Colorization of gray-scale images relies on prior color information. Examplar-based methods use a color image as source of such information. Then the colors of the source image are transferred to the gray-scale image. In the literature,…

Graphics · Computer Science 2017-07-04 Johannes Persch , Fabien Pierre , Gabriele Steidl

We propose the first deep learning approach for exemplar-based local colorization. Given a reference color image, our convolutional neural network directly maps a grayscale image to an output colorized image. Rather than using hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Mingming He , Dongdong Chen , Jing Liao , Pedro V. Sander , Lu Yuan

Colorization is a traditional computer vision task and it plays an important role in many time-consuming tasks, such as old film restoration. Existing methods suffer from unsaturated color and temporally inconsistency. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Han Wang , Yuang Zhang , Yuhong Zhang , Lingxiao Lu , Li Song

Video summarization aims to select keyframes that are visually diverse and can represent the whole story of a given video. Previous approaches have focused on global interlinkability between frames in a video by temporal modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jungin Park , Jiyoung Lee , Kwanghoon Sohn

Coloring line art images based on the colors of reference images is an important stage in animation production, which is time-consuming and tedious. In this paper, we propose a deep architecture to automatically color line art videos with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Min Shi , Jia-Qi Zhang , Shu-Yu Chen , Lin Gao , Yu-Kun Lai , Fang-Lue Zhang

This paper presents a self-supervised method for learning reliable visual correspondence from unlabeled videos. We formulate the correspondence as finding paths in a joint space-time graph, where nodes are grid patches sampled from frames,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Zixu Zhao , Yueming Jin , Pheng-Ann Heng

How to effectively explore the colors of reference exemplars and propagate them to colorize each frame is vital for exemplar-based video colorization. In this paper, we present an effective BiSTNet to explore colors of reference exemplars…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yixin Yang , Zhongzheng Peng , Xiaoyu Du , Zhulin Tao , Jinhui Tang , Jinshan Pan

Video inpainting aims to fill spatio-temporal "corrupted" regions with plausible content. To achieve this goal, it is necessary to find correspondences from neighbouring frames to faithfully hallucinate the unknown content. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Xueyan Zou , Linjie Yang , Ding Liu , Yong Jae Lee

The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networks, difficulties with controllability and visual quality…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nir Zabari , Aharon Azulay , Alexey Gorkor , Tavi Halperin , Ohad Fried

The remarkable efficacy of text-to-image diffusion models has motivated extensive exploration of their potential application in video domains. Zero-shot methods seek to extend image diffusion models to videos without necessitating model…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Shuai Yang , Yifan Zhou , Ziwei Liu , Chen Change Loy

Referring video object segmentation aims to segment a referent throughout a video sequence according to a natural language expression. It requires aligning the natural language expression with the objects' motions and their dynamic…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiajin Tang , Ge Zheng , Sibei Yang

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Rui Li , Dong Liu

Video colorization is a challenging and highly ill-posed problem. Although recent years have witnessed remarkable progress in single image colorization, there is relatively less research effort on video colorization and existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yihao Liu , Hengyuan Zhao , Kelvin C. K. Chan , Xintao Wang , Chen Change Loy , Yu Qiao , Chao Dong

In this work, we propose a no-reference video quality assessment method, aiming to achieve high-generalization capability in cross-content, -resolution and -frame rate quality prediction. In particular, we evaluate the quality of a video by…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Baoliang Chen , Lingyu Zhu , Guo Li , Hongfei Fan , Shiqi Wang

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

We propose a technique that propagates information forward through video data. The method is conceptually simple and can be applied to tasks that require the propagation of structured information, such as semantic labels, based on video…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Varun Jampani , Raghudeep Gadde , Peter V. Gehler

We develop an automated video colorization framework that minimizes the flickering of colors across frames. If we apply image colorization techniques to successive frames of a video, they treat each frame as a separate colorization task.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Thejan Wijesinghe , Chamath Abeysinghe , Chanuka Wijayakoon , Lahiru Jayathilake , Uthayasanker Thayasivam

It is often desirable to analyse trajectory data in local coordinates relative to a reference location. Similarly, temporal data also needs to be transformed to be relative to an event. Together, temporal and spatial contextualisation…

Human-Computer Interaction · Computer Science 2017-11-15 Andrew Simmons , Rajesh Vasa

Video colorization, aiming at obtaining colorful and plausible results from grayish frames, has aroused a lot of interest recently. Nevertheless, how to maintain temporal consistency while keeping the quality of colorized results remains…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Zheyuan Liu , Pan Mu , Hanning Xu , Cong Bai

Exemplar-based colorization approaches rely on reference image to provide plausible colors for target gray-scale image. The key and difficulty of exemplar-based colorization is to establish an accurate correspondence between these two…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Yunpeng Bai , Chao Dong , Zenghao Chai , Andong Wang , Zhengzhuo Xu , Chun Yuan