English
Related papers

Related papers: Cross-Attention Transformer for Video Interpolatio…

200 papers

For video frame interpolation (VFI), existing deep-learning-based approaches strongly rely on the ground-truth (GT) intermediate frames, which sometimes ignore the non-unique nature of motion judging from the given adjacent frames. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Kun Zhou , Wenbo Li , Xiaoguang Han , Jiangbo Lu

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

In recent years, learned image compression methods have demonstrated superior rate-distortion performance compared to traditional image compression methods. Recent methods utilize convolutional neural networks (CNN), variational…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Priyanka Mudgal , Feng Liu

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Whole-Slide Imaging allows for the capturing and digitization of high-resolution images of histological specimen. An automated analysis of such images using deep learning models is therefore of high demand. The transformer architecture has…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Firas Khader , Jakob Nikolas Kather , Tianyu Han , Sven Nebelung , Christiane Kuhl , Johannes Stegmaier , Daniel Truhn

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Recently, the remarkable success of pre-trained Vision Transformers (ViTs) from image-text matching has sparked an interest in image-to-video adaptation. However, most current approaches retain the full forward pass for each frame, leading…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Guozhen Zhang , Jingyu Liu , Shengming Cao , Xiaotong Zhao , Kevin Zhao , Kai Ma , Limin Wang

The estimation of large and extreme image rotation plays a key role in multiple computer vision domains, where the rotated images are related by a limited or a non-overlapping field of view. Contemporary approaches apply convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shay Dekel , Yosi Keller , Martin Cadik

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Brandon Yushan Feng , Susmija Jabbireddy , Amitabh Varshney

Single image deraining is a crucial problem because rain severely degenerates the visibility of images and affects the performance of computer vision tasks like outdoor surveillance systems and intelligent vehicles. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Hao-Hsiang Yang , Chao-Han Huck Yang , Yu-Chiang Frank Wang

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yuting Yang , Licheng Jiao , Xu Liu , Fang Liu , Shuyuan Yang , Zhixi Feng , Xu Tang

We present CSWin Transformer, an efficient and effective Transformer-based backbone for general-purpose vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute whereas local…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Xiaoyi Dong , Jianmin Bao , Dongdong Chen , Weiming Zhang , Nenghai Yu , Lu Yuan , Dong Chen , Baining Guo

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

The versatility of recent machine learning approaches makes them ideal for improvement of next generation video compression solutions. Unfortunately, these approaches typically bring significant increases in computational complexity and are…

Image and Video Processing · Electrical Eng. & Systems 2021-06-18 Luka Murn , Saverio Blasi , Alan F. Smeaton , Marta Mrak

Conditional diffusion models can create unseen images in various settings, aiding image interpolation. Interpolation in latent spaces is well-studied, but interpolation with specific conditions like text or poses is less understood. Simple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Qiyuan He , Jinghao Wang , Ziwei Liu , Angela Yao

Given a query patch from a novel class, one-shot object detection aims to detect all instances of that class in a target image through the semantic similarity comparison. However, due to the extremely limited guidance in the novel class as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Weidong Lin , Yuyan Deng , Yang Gao , Ning Wang , Jinghao Zhou , Lingqiao Liu , Lei Zhang , Peng Wang