中文
相关论文

相关论文: Cross-Attention Transformer for Video Interpolatio…

200 篇论文

For video frame interpolation (VFI), existing deep-learning-based approaches strongly rely on the ground-truth (GT) intermediate frames, which sometimes ignore the non-unique nature of motion judging from the given adjacent frames. As a…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Kun Zhou , Wenbo Li , Xiaoguang Han , Jiangbo Lu

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

In recent years, learned image compression methods have demonstrated superior rate-distortion performance compared to traditional image compression methods. Recent methods utilize convolutional neural networks (CNN), variational…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Priyanka Mudgal , Feng Liu

Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. Due to the selective transmission of light by polarized filters, longer exposure times are…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Feng Huang , Xin Zhang , Yixuan Xu , Xuesong Wang , Xianyu Wu

Whole-Slide Imaging allows for the capturing and digitization of high-resolution images of histological specimen. An automated analysis of such images using deep learning models is therefore of high demand. The transformer architecture has…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Firas Khader , Jakob Nikolas Kather , Tianyu Han , Sven Nebelung , Christiane Kuhl , Johannes Stegmaier , Daniel Truhn

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

Frame interpolation attempts to synthesise frames given one or more consecutive video frames. In recent years, deep learning approaches, and notably convolutional neural networks, have succeeded at tackling low- and high-level computer…

计算机视觉与模式识别 · 计算机科学 2019-02-27 Joost van Amersfoort , Wenzhe Shi , Alejandro Acosta , Francisco Massa , Johannes Totz , Zehan Wang , Jose Caballero

Recently, the remarkable success of pre-trained Vision Transformers (ViTs) from image-text matching has sparked an interest in image-to-video adaptation. However, most current approaches retain the full forward pass for each frame, leading…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Guozhen Zhang , Jingyu Liu , Shengming Cao , Xiaotong Zhao , Kevin Zhao , Kai Ma , Limin Wang

The estimation of large and extreme image rotation plays a key role in multiple computer vision domains, where the rotated images are related by a limited or a non-overlapping field of view. Contemporary approaches apply convolutional…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Shay Dekel , Yosi Keller , Martin Cadik

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Bin Zhao , Xuelong Li

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Brandon Yushan Feng , Susmija Jabbireddy , Amitabh Varshney

Single image deraining is a crucial problem because rain severely degenerates the visibility of images and affects the performance of computer vision tasks like outdoor surveillance systems and intelligent vehicles. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2021-10-11 Hao-Hsiang Yang , Chao-Han Huck Yang , Yu-Chiang Frank Wang

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Yuting Yang , Licheng Jiao , Xu Liu , Fang Liu , Shuyuan Yang , Zhixi Feng , Xu Tang

We present CSWin Transformer, an efficient and effective Transformer-based backbone for general-purpose vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute whereas local…

计算机视觉与模式识别 · 计算机科学 2022-01-11 Xiaoyi Dong , Jianmin Bao , Dongdong Chen , Weiming Zhang , Nenghai Yu , Lu Yuan , Dong Chen , Baining Guo

Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an…

计算机视觉与模式识别 · 计算机科学 2018-07-16 Huaizu Jiang , Deqing Sun , Varun Jampani , Ming-Hsuan Yang , Erik Learned-Miller , Jan Kautz

The versatility of recent machine learning approaches makes them ideal for improvement of next generation video compression solutions. Unfortunately, these approaches typically bring significant increases in computational complexity and are…

图像与视频处理 · 电气工程与系统科学 2021-06-18 Luka Murn , Saverio Blasi , Alan F. Smeaton , Marta Mrak

Conditional diffusion models can create unseen images in various settings, aiding image interpolation. Interpolation in latent spaces is well-studied, but interpolation with specific conditions like text or poses is less understood. Simple…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Qiyuan He , Jinghao Wang , Ziwei Liu , Angela Yao

Given a query patch from a novel class, one-shot object detection aims to detect all instances of that class in a target image through the semantic similarity comparison. However, due to the extremely limited guidance in the novel class as…

计算机视觉与模式识别 · 计算机科学 2021-05-03 Weidong Lin , Yuyan Deng , Yang Gao , Ning Wang , Jinghao Zhou , Lingqiao Liu , Lei Zhang , Peng Wang