English
Related papers

Related papers: Transformer-based Image and Video Inpainting: Curr…

200 papers

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Asifullah Khan , Zunaira Rauf , Anabia Sohail , Abdul Rehman , Hifsa Asif , Aqsa Asif , Umair Farooq

Traditional neural network-driven inpainting methods struggle to deliver high-quality results within the constraints of mobile device processing power and memory. Our research introduces an innovative approach to optimize memory usage by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Hoyoung Kim , Azimbek Khudoyberdiev , Seonghwan Jeong , Jihoon Ryoo

Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic images from hand-crafted scene representations. However, the…

Predicting panoramic indoor lighting from a single perspective image is a fundamental but highly ill-posed problem in computer vision and graphics. To achieve locale-aware and robust prediction, this problem can be decomposed into three…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jiayang Bai , Zhen He , Shan Yang , Jie Guo , Zhenyu Chen , Yan Zhang , Yanwen Guo

Vision language tasks, such as answering questions about or generating captions that describe an image, are difficult tasks for computers to perform. A relatively recent body of research has adapted the pretrained transformer architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Clayton Fields , Casey Kennington

We present a novel deep learning based algorithm for video inpainting. Video inpainting is a process of completing corrupted or missing regions in videos. Video inpainting has additional challenges compared to image inpainting due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Sungho Lee , Seoung Wug Oh , DaeYeun Won , Seon Joo Kim

Transformers gain huge attention since they are first introduced and have a wide range of applications. Transformers start to take over all areas of deep learning and the Vision transformers paper also proved that they can be used for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Yiğit Gündüç

Transformers have dominated the field of natural language processing, and recently impacted the computer vision area. In the field of medical image analysis, Transformers have also been successfully applied to full-stack clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Kelei He , Chen Gan , Zhuoyuan Li , Islem Rekik , Zihao Yin , Wen Ji , Yang Gao , Qian Wang , Junfeng Zhang , Dinggang Shen

This paper addresses the problem of face video inpainting. Existing video inpainting methods target primarily at natural scenes with repetitive patterns. They do not make use of any prior knowledge of the face to help retrieve…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Wenqi Yang , Zhenfang Chen , Chaofeng Chen , Guanying Chen , Kwan-Yee K. Wong

Recent advancements in deep learning techniques have spurred considerable interest in their application to hyperspectral imagery processing. This paper provides a comprehensive review of the latest developments in this field, focusing on…

Image and Video Processing · Electrical Eng. & Systems 2024-04-11 Nafiseh Ghasemi , Jon Alvarez Justo , Marco Celesti , Laurent Despoisse , Jens Nieke

3D reconstruction is a longstanding ill-posed problem, which has been explored for decades by the computer vision, computer graphics, and machine learning communities. Since 2015, image-based 3D reconstruction using convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Xian-Feng Han , Hamid Laga , Mohammed Bennamoun

The success of the transformer architecture in natural language processing has recently triggered attention in the computer vision field. The transformer has been used as a replacement for the widely used convolution operators, due to its…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jean Lahoud , Jiale Cao , Fahad Shahbaz Khan , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Ming-Hsuan Yang

Image inpainting has achieved remarkable progress and inspired abundant methods, where the critical bottleneck is identified as how to fulfill the high-frequency structure and low-frequency texture information on the masked regions with…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Haipeng Liu , Yang Wang , Meng Wang , Yong Rui

Image Super-Resolution (SR) aims to recover a high-resolution image from its low-resolution counterpart, which has been affected by a specific degradation process. This is achieved by enhancing detail and visual quality. Recent advancements…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Debasish Dutta , Deepjyoti Chetia , Neeharika Sonowal , Sanjib Kr Kalita

Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular textures while losing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Qiaole Dong , Chenjie Cao , Yanwei Fu

Image inpainting aims at restoring missing region of corrupted images, which has many applications such as image restoration and object removal. However, current GAN-based inpainting models fail to explicitly consider the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Ang Li , Jianzhong Qi , Rui Zhang , Ramamohanarao Kotagiri

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Gourav Wadhwa , Abhinav Dhall , Subrahmanyam Murala , Usman Tariq

Transient imaging has recently made a huge impact in the computer graphics and computer vision fields. By capturing, reconstructing, or simulating light transport at extreme temporal resolutions, researchers have proposed novel techniques…

Computer Vision and Pattern Recognition · Computer Science 2016-11-04 Adrian Jarabo , Belen Masia , Julio Marco , Diego Gutierrez

Deep learning-based algorithms have seen a massive popularity in different areas of remote sensing image analysis over the past decade. Recently, transformers-based architectures, originally introduced in natural language processing, have…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Abdulaziz Amer Aleissaee , Amandeep Kumar , Rao Muhammad Anwer , Salman Khan , Hisham Cholakkal , Gui-Song Xia , Fahad Shahbaz khan

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…