English
Related papers

Related papers: DeepRemaster: Temporal Source-Reference Attention …

200 papers

Video super-resolution plays an important role in surveillance video analysis and ultra-high-definition video display, which has drawn much attention in both the research and industrial communities. Although many deep learning-based VSR…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Takashi Isobe , Fang Zhu , Xu Jia , Shengjin Wang

In this paper, we propose a novel video super-resolution method that aims at generating high-fidelity high-resolution (HR) videos from low-resolution (LR) ones. Previous methods predominantly leverage temporal neighbor frames to assist the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jiyang Yu , Jingen Liu , Liefeng Bo , Tao Mei

Video restoration is a low-level vision task that seeks to restore clean, sharp videos from quality-degraded frames. One would use the temporal information from adjacent frames to make video restoration successful. Recently, the success of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Fu-Jen Tsai , Yan-Tsung Peng , Chen-Yu Chang , Chan-Yu Li , Yen-Yu Lin , Chung-Chi Tsai , Chia-Wen Lin

We propose a method for generating a temporally remapped video that matches the desired target duration while maximally preserving natural video dynamics. Our approach trains a neural network through self-supervision to recognize and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Simon Jenni , Markus Woodson , Fabian Caba Heilbron

Spatially dense self-supervised learning is a rapidly growing problem domain with promising applications for unsupervised segmentation and pretraining for dense downstream tasks. Despite the abundance of temporal data in the form of videos,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Mohammadreza Salehi , Efstratios Gavves , Cees G. M. Snoek , Yuki M. Asano

Long-range temporal alignment is critical yet challenging for video restoration tasks. Recently, some works attempt to divide the long-range alignment into several sub-alignments and handle them progressively. Although this operation is…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Kun Zhou , Wenbo Li , Liying Lu , Xiaoguang Han , Jiangbo Lu

Video colorization task has recently attracted wide attention. Recent methods mainly work on the temporal consistency in adjacent frames or frames with small interval. However, it still faces severe challenge of the inconsistency between…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Yu Zhang , Siqi Chen , Mingdao Wang , Xianlin Zhang , Chuang Zhu , Yue Zhang , Xueming Li

This paper proposes a novel deep learning-based video object matting method that can achieve temporally coherent matting results. Its key component is an attention-based temporal aggregation module that maximizes image matting networks'…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Yunke Zhang , Chi Wang , Miaomiao Cui , Peiran Ren , Xuansong Xie , Xian-sheng Hua , Hujun Bao , Qixing Huang , Weiwei Xu

We propose a novel reference-based video colorization framework with spatiotemporal correspondence. Reference-based methods colorize grayscale frames referencing a user input color frame. Existing methods suffer from the color leakage…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Naofumi Akimoto , Akio Hayakawa , Andrew Shin , Takuya Narihira

Exemplar-based video colorization is an essential technique for applications like old movie restoration. Although recent methods perform well in still scenes or scenes with regular movement, they always lack robustness in moving scenes due…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Siqi Chen , Xueming Li , Xianlin Zhang , Mingdao Wang , Yu Zhang , Jiatong Han , Yue Zhang

Cine cardiac magnetic resonance (CMR) imaging is recognised as the benchmark modality for the comprehensive assessment of cardiac function. Nevertheless, the acquisition process of cine CMR is considered as an impediment due to its…

Image and Video Processing · Electrical Eng. & Systems 2024-04-11 Anam Hashmi , Julia Dietlmeier , Kathleen M. Curran , Noel E. O'Connor

Video restoration, which aims to restore clear frames from degraded videos, has numerous important applications. The key to video restoration depends on utilizing inter-frame information. However, existing deep learning methods often rely…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Dasong Li , Xiaoyu Shi , Yi Zhang , Ka Chun Cheung , Simon See , Xiaogang Wang , Hongwei Qin , Hongsheng Li

Video Super-Resolution (VSR) aims to restore high-resolution (HR) videos from low-resolution (LR) videos. Existing VSR techniques usually recover HR frames by extracting pertinent textures from nearby frames with known degradation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Zhongwei Qiu , Huan Yang , Jianlong Fu , Daochang Liu , Chang Xu , Dongmei Fu

Attention is a powerful concept in computer vision. End-to-end networks that learn to focus selectively on regions of an image or video often perform strongly. However, other image regions, while not necessarily containing the signal of…

Image and Video Processing · Electrical Eng. & Systems 2020-10-16 Ewa Nowara , Daniel McDuff , Ashok Veeraraghavan

In this study, we propose a self-supervised video denoising method called "restore-from-restored." This method fine-tunes a pre-trained network by using a pseudo clean video during the test phase. The pseudo clean video is obtained by…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Seunghwan Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

Deep convolutional neural networks perform better on images containing spatially invariant degradations, also known as synthetic degradations; however, their performance is limited on real-degraded photographs and requires multiple-stage…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Saeed Anwar , Nick Barnes , Lars Petersson

Video super-resolution aims at generating a high-resolution video from its low-resolution counterpart. With the rapid rise of deep learning, many recently proposed video super-resolution methods use convolutional neural networks in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xiaohong Liu , Lingshi Kong , Yang Zhou , Jiying Zhao , Jun Chen

Convolutional Neural Networks (CNNs) for visual tasks are believed to learn both the low-level textures and high-level object attributes, throughout the network depth. This paper further investigates the `texture bias' in CNNs. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Amin Banitalebi-Dehkordi , Yong Zhang

Video restoration (VR) aims to recover high-quality videos from degraded ones. Although recent zero-shot VR methods using pre-trained diffusion models (DMs) show good promise, they suffer from approximation errors during reverse diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Hengkang Wang , Yang Liu , Huidong Liu , Chien-Chih Wang , Yanhui Guo , Hongdong Li , Bryan Wang , Ju Sun

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Nießner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , Christian Theobalt