English
Related papers

Related papers: VDTR: Video Deblurring with Transformer

200 papers

Video instance segmentation (VIS) task requires classifying, segmenting, and tracking object instances over all frames in a video clip. Recently, VisTR has been proposed as end-to-end transformer-based VIS framework, while demonstrating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Sudhir Yarram , Jialian Wu , Pan Ji , Yi Xu , Junsong Yuan

For the success of video deblurring, it is essential to utilize information from neighboring frames. Most state-of-the-art video deblurring methods adopt motion compensation between video frames to aggregate information from multiple frames…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Hyeongseok Son , Junyong Lee , Jonghyeop Lee , Sunghyun Cho , Seungyong Lee

Video deblurring has achieved remarkable progress thanks to the success of deep neural networks. Most methods solve for the deblurring end-to-end with limited information propagation from the video sequence. However, different frame regions…

Image and Video Processing · Electrical Eng. & Systems 2022-04-08 Bo Ji , Angela Yao

Diffusion models have shown great potential in generating realistic image detail. However, adapting these models to video super-resolution (VSR) remains challenging due to their inherent stochasticity and lack of temporal modeling. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yong Liu , Jinshan Pan , Yinchuan Li , Qingji Dong , Chao Zhu , Yu Guo , Fei Wang

Dynamic scene video deblurring aims to remove undesirable blurry artifacts captured during the exposure process. Although previous video deblurring methods have achieved impressive results, they suffer from significant performance drops due…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jin-Ting He , Fu-Jen Tsai , Jia-Hao Wu , Yan-Tsung Peng , Chung-Chi Tsai , Chia-Wen Lin , Yen-Yu Lin

In many real-world scenarios, recorded videos suffer from accidental focus blur, and while video deblurring methods exist, most specifically target motion blur or spatial-invariant blur. This paper introduces a framework optimized for the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Crispian Morris , Nantheera Anantrasirichai , Fan Zhang , David Bull

The key success factor of the video deblurring methods is to compensate for the blurry pixels of the mid-frame with the sharp pixels of the adjacent video frames. Therefore, mainstream methods align the adjacent frames based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Huicong Zhang , Haozhe Xie , Hongxun Yao

In this paper, we propose a new Transformer block for video future frames prediction based on an efficient local spatial-temporal separation attention mechanism. Based on this new Transformer block, a fully autoregressive video future…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xi Ye , Guillaume-Alexandre Bilodeau

Video watermarking embeds a message into a cover video in an imperceptible manner, which can be retrieved even if the video undergoes certain modifications or distortions. Traditional watermarking methods are often manually designed for…

Multimedia · Computer Science 2021-04-27 Xiyang Luo , Yinxiao Li , Huiwen Chang , Ce Liu , Peyman Milanfar , Feng Yang

The spatio-temporal information among video sequences is significant for video super-resolution (SR). However, the spatio-temporal information cannot be fully used by existing video SR methods since spatial feature extraction and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Xinyi Ying , Longguang Wang , Yingqian Wang , Weidong Sheng , Wei An , Yulan Guo

The video super-resolution (VSR) task aims to restore a high-resolution (HR) video frame by using its corresponding low-resolution (LR) frame and multiple neighboring frames. At present, many deep learning-based VSR methods rely on optical…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Hua Wang , Dewei Su , Chuangchuang Liu , Longcun Jin , Xianfang Sun , Xinyi Peng

Do video-text transformers learn to model temporal relationships across frames? Despite their immense capacity and the abundance of multimodal training data, recent work has revealed the strong tendency of video-text models towards…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yi Li , Kyle Min , Subarna Tripathi , Nuno Vasconcelos

Video super-resolution (VSR) is a prominent research topic in low-level computer vision, where deep learning technologies have played a significant role. The rapid progress in deep learning and its applications in VSR has led to a…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Arbind Agrahari Baniya , Tsz-Kwan Lee , Peter Eklund , Sunil Aryal

Video restoration is a low-level vision task that seeks to restore clean, sharp videos from quality-degraded frames. One would use the temporal information from adjacent frames to make video restoration successful. Recently, the success of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Fu-Jen Tsai , Yan-Tsung Peng , Chen-Yu Chang , Chan-Yu Li , Yen-Yu Lin , Chung-Chi Tsai , Chia-Wen Lin

This paper is on video recognition using Transformers. Very recent attempts in this area have demonstrated promising results in terms of recognition accuracy, yet they have been also shown to induce, in many cases, significant computational…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Adrian Bulat , Juan-Manuel Perez-Rua , Swathikiran Sudhakaran , Brais Martinez , Georgios Tzimiropoulos

Images taken in dynamic scenes may contain unwanted motion blur, which significantly degrades visual quality. Such blur causes short- and long-range region-specific smoothing artifacts that are often directional and non-uniform, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Fu-Jen Tsai , Yan-Tsung Peng , Yen-Yu Lin , Chung-Chi Tsai , Chia-Wen Lin

Detection Transformer (DETR) and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors. However, their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Qianyu Zhou , Xiangtai Li , Lu He , Yibo Yang , Guangliang Cheng , Yunhai Tong , Lizhuang Ma , Dacheng Tao

Video Super-Resolution (VSR) aims to recover sequences of high-resolution (HR) frames from low-resolution (LR) frames. Previous methods mainly utilize temporally adjacent frames to assist the reconstruction of target frames. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Yongjie Chen , Tieru Wu

Video transformers have recently emerged as an effective alternative to convolutional networks for action classification. However, most prior video transformers adopt either global space-time attention or hand-defined strategies to compare…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jue Wang , Lorenzo Torresani

Several state-of-the-art video deblurring methods are based on a strong assumption that the captured scenes are static. These methods fail to deblur blurry videos in dynamic scenes. We propose a video deblurring method to deal with general…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Tae Hyun Kim , Kyoung Mu Lee