English
Related papers

Related papers: Improving Video Colorization by Test-Time Tuning

200 papers

The purpose of this contribution is to introduce a new method of signal prediction in video coding. Unlike most existent prediction methods that either use temporal or use spatial correlations to generate the prediction signal, the proposed…

Image and Video Processing · Electrical Eng. & Systems 2022-07-11 Jürgen Seiler , André Kaup

We present a fully automatic approach to video colorization with self-regularization and diversity. Our model contains a colorization network for video frame colorization and a refinement network for spatiotemporal color refinement. Without…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Chenyang Lei , Qifeng Chen

Colorization is a traditional computer vision task and it plays an important role in many time-consuming tasks, such as old film restoration. Existing methods suffer from unsaturated color and temporally inconsistency. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Han Wang , Yuang Zhang , Yuhong Zhang , Lingxiao Lu , Li Song

We present an efficient finetuning methodology for neural-network filters which are applied as a postprocessing artifact-removal step in video coding pipelines. The fine-tuning is performed at encoder side to adapt the neural network to the…

Image and Video Processing · Electrical Eng. & Systems 2020-08-14 Yat-Hong Lam , Alireza Zare , Francesco Cricri , Jani Lainema , Miska Hannuksela

Hyperspectral cameras face challenging spatial-spectral resolution trade-offs and are more affected by shot noise than RGB photos taken over the same total exposure time. Here, we present a colorization algorithm to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 M. Kerem Aydin , Qi Guo , Emma Alexander

Image colorization is a well-known problem in computer vision. However, due to the ill-posed nature of the task, image colorization is inherently challenging. Though several attempts have been made by researchers to make the colorization…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Subhankar Ghosh , Prasun Roy , Saumik Bhattacharya , Umapada Pal , Michael Blumenstein

We develop an automated video colorization framework that minimizes the flickering of colors across frames. If we apply image colorization techniques to successive frames of a video, they treat each frame as a separate colorization task.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Thejan Wijesinghe , Chamath Abeysinghe , Chanuka Wijayakoon , Lahiru Jayathilake , Uthayasanker Thayasivam

We propose a novel reference-based video colorization framework with spatiotemporal correspondence. Reference-based methods colorize grayscale frames referencing a user input color frame. Existing methods suffer from the color leakage…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Naofumi Akimoto , Akio Hayakawa , Andrew Shin , Takuya Narihira

We describe a novel integrated algorithm for real-time enhancement of video acquired under challenging lighting conditions. Such conditions include low lighting, haze, and high dynamic range situations. The algorithm automatically detects…

Graphics · Computer Science 2011-02-17 Xuan Dong , Jiangtao , Wen , Weixin Li , Yi , Pang , Guan Wang , Yao Lu , Wei Meng

Automatic colorization of gray images with objects of different colors and sizes is challenging due to inter- and intra-object color variation and the small area of the main objects due to extensive backgrounds. The learning process often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Mrityunjoy Gain , Avi Deb Raha , Rameswar Debnath

Measuring the colorfulness of a natural or virtual scene is critical for many applications in image processing field ranging from capturing to display. In this paper, we propose the first deep learning-based colorfulness estimation metric.…

Multimedia · Computer Science 2019-08-23 Emin Zerman , Aakanksha Rana , Aljosa Smolic

Underwater images often suffer from quality degradation due to absorption and scattering effects. Most existing underwater image enhancement algorithms produce a single, fixed-color image, limiting user flexibility and application. To…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xiaofeng Cong , Jing Zhang , Yeying Jin , Junming Hou , Yu Zhao , Jie Gui , James Tin-Yau Kwok , Yuan Yan Tang

Consumer-grade music recordings such as those captured by mobile devices typically contain distortions in the form of background noise, reverb, and microphone-induced EQ. This paper presents a deep learning approach to enhance low-quality…

Sound · Computer Science 2022-04-29 Nikhil Kandpal , Oriol Nieto , Zeyu Jin

Colorization is a process that converts a grayscale image into a color one that looks as natural as possible. Over the years this task has received a lot of attention. Existing colorization methods rely on different color spaces: RGB, YUV,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Coloma Ballester , Aurélie Bugeau , Hernan Carrillo , Michaël Clément , Rémi Giraud , Lara Raad , Patricia Vitoria

In Neural Processing Letters 50,3 (2019) a machine learning approach to blind video quality assessment was proposed. It is based on temporal pooling of features of video frames, taken from the last pooling layer of deep convolutional neural…

Multimedia · Computer Science 2020-05-12 Franz Götz-Hahn , Vlad Hosu , Dietmar Saupe

Recent data-driven image colorization methods have enabled automatic or reference-based colorization, while still suffering from unsatisfactory and inaccurate object-level color control. To address these issues, we propose a new method…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Jianxin Lin , Peng Xiao , Yijun Wang , Rongju Zhang , Xiangxiang Zeng

Adding color to black-and-white speaker videos automatically is a highly desirable technique. It is an artistic process that requires interactivity with humans for the best results. Many existing automatic video colorization systems provide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Rory Ward , John G. Breslin , Peter Corcoran

A popular method for enhancing images involves learning the style of a professional photo editor using pairs of training images comprised of the original input with the editor-enhanced version. When manipulating images, many editing tools…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 David Serrano-Lozano , Luis Herranz , Michael S. Brown , Javier Vazquez-Corral

In this contribution, a novel spatio-temporal prediction algorithm for video coding is introduced. This algorithm exploits temporal as well as spatial redundancies for effectively predicting the signal to be encoded. To achieve this, the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Jürgen Seiler , André Kaup

Utilization of event-based cameras is expected to improve the visual quality of video frame interpolation solutions. We introduce a learning-based method to exploit moving region boundaries in a video sequence to increase the overall…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Ahmet Akman , Onur Selim Kılıç , A. Aydın Alatan