中文
相关论文

相关论文: Transformer-based Image and Video Inpainting: Curr…

200 篇论文

In this work, we address a challenge in video inpainting: reconstructing occluded regions in dynamic, real-world scenarios. Motivated by the need for continuous human motion monitoring in healthcare settings, where facial features are…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Zheyan Zhang , Diego Klabjan , Renee CB Manworren

Image outpainting, which is well studied with Convolution Neural Network (CNN) based framework, has recently drawn more attention in computer vision. However, CNNs rely on inherent inductive biases to achieve effective sample learning,…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Kai Yao , Penglei Gao , Xi Yang , Kaizhu Huang , Jie Sun , Rui Zhang

Global pandemic due to the spread of COVID-19 has post challenges in a new dimension on facial recognition, where people start to wear masks. Under such condition, the authors consider utilizing machine learning in image inpainting to…

计算机视觉与模式识别 · 计算机科学 2023-09-18 Zhengyang Han , Zehao Jiang , Yuan Ju

The new alternative is to use deep learning to inpaint any image by utilizing image classification and computer vision techniques. In general, image inpainting is a task of recreating or reconstructing any broken image which could be a…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Narayana Darapaneni , Vaibhav Kherde , Kameswara Rao , Deepali Nikam , Swanand Katdare , Anima Shukla , Anagha Lomate , Anwesh Reddy Paduri

Neural rendering is a new image and video generation method based on deep learning. It combines the deep learning model with the physical knowledge of computer graphics, to obtain a controllable and realistic scene model, and realize the…

图形学 · 计算机科学 2024-02-02 Xinkai Yan , Jieting Xu , Yuchi Huo , Hujun Bao

We present a generative image inpainting system to complete images with free-form mask and guidance. The system is based on gated convolutions learned from millions of images without additional labelling efforts. The proposed gated…

计算机视觉与模式识别 · 计算机科学 2019-10-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas Huang

With the improvement of the pattern recognition and feature extraction of Deep Neural Networks (DPNNs), image-based design and optimization have been widely used in multidisciplinary researches. Recently, a Reconstructive Neural Network…

其他计算机科学 · 计算机科学 2019-06-04 Yu Li , Hu Wang , Wenquan Shuai , Honghao Zhang , Yong Peng

Video inpainting, which aims to restore corrupted video content, has experienced substantial progress. Despite these advances, existing methods, whether propagating unmasked region pixels through optical flow and receptive field priors, or…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Yuxuan Bian , Zhaoyang Zhang , Xuan Ju , Mingdeng Cao , Liangbin Xie , Ying Shan , Qiang Xu

Image-based navigation is widely considered the next frontier of minimally invasive surgery. It is believed that image-based navigation will increase the access to reproducible, safe, and high-precision surgery as it may then be performed…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Mathias Unberath , Cong Gao , Yicheng Hu , Max Judish , Russell H Taylor , Mehran Armand , Robert Grupp

Image inpainting is the task of filling-in missing regions of a damaged or incomplete image. In this work we tackle this problem not only by using the available visual data but also by incorporating image semantics through the use of…

计算机视觉与模式识别 · 计算机科学 2018-12-05 Patricia Vitoria , Joan Sintes , Coloma Ballester

Many recent inpainting works have achieved impressive results by leveraging Deep Neural Networks (DNNs) to model various prior information for image restoration. Unfortunately, the performance of these methods is largely limited by the…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Chenjie Cao , Qiaole Dong , Yanwei Fu

Transformers have shown outstanding results for natural language understanding and, more recently, for image classification. We here extend this work and propose a transformer-based approach for image retrieval: we adopt vision transformers…

计算机视觉与模式识别 · 计算机科学 2021-02-11 Alaaeldin El-Nouby , Natalia Neverova , Ivan Laptev , Hervé Jégou

Face inpainting requires the model to have a precise global understanding of the facial position structure. Benefiting from the powerful capabilities of deep learning backbones, recent works in face inpainting have achieved decent…

计算机视觉与模式识别 · 计算机科学 2024-01-22 Bo Zhao , Huan Yang , Jianlong Fu

In recent years, the field of image inpainting has developed rapidly, learning based approaches show impressive results in the task of filling missing parts in an image. But most deep methods are strongly tied to the resolution of the…

图像与视频处理 · 电气工程与系统科学 2021-04-29 Andrey Moskalenko , Mikhail Erofeev , Dmitriy Vatolin

Image inpainting has earned substantial progress, owing to the encoder-and-decoder pipeline, which is benefited from the Convolutional Neural Networks (CNNs) with convolutional downsampling to inpaint the masked regions semantically from…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Haipeng Liu , Yang Wang , Biao Qian , Yong Rui , Meng Wang

Recent studies have shown the importance of modeling long-range interactions in the inpainting problem. To achieve this goal, existing approaches exploit either standalone attention techniques or transformers, but usually under a low…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Wenbo Li , Zhe Lin , Kun Zhou , Lu Qi , Yi Wang , Jiaya Jia

Image inpainting is the task of filling in missing or masked region of an image with semantically meaningful contents. Recent methods have shown significant improvement in dealing with large-scale missing regions. However, these methods…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Wanglong Lu , Xianta Jiang , Xiaogang Jin , Yong-Liang Yang , Minglun Gong , Tao Wang , Kaijie Shi , Hanli Zhao

This paper provides a comprehensive review of mechanical equipment fault diagnosis methods, focusing on the advancements brought by Transformer-based models. It details the structure, working principles, and benefits of Transformers,…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Guiran Liu , Binrong Zhu

In the current era of Machine Learning, Transformers have become the de facto approach across a variety of domains, such as computer vision and natural language processing. Transformer-based solutions are the backbone of current…

计算机视觉与模式识别 · 计算机科学 2025-01-16 Mihai Masala , Marius Leordeanu

Deep convolutional networks (CNNs) have exhibited their potential in image inpainting for producing plausible results. However, in most existing methods, e.g., context encoder, the missing parts are predicted by propagating the surrounding…

计算机视觉与模式识别 · 计算机科学 2018-04-16 Zhaoyi Yan , Xiaoming Li , Mu Li , Wangmeng Zuo , Shiguang Shan