English
Related papers

Related papers: Unbiased Multi-Modality Guidance for Image Inpaint…

200 papers

Most image labeling problems such as segmentation and image reconstruction are fundamentally ill-posed and suffer from ambiguities and noise. Higher order image priors encode high level structural dependencies between pixels and are key to…

Computer Vision and Pattern Recognition · Computer Science 2011-09-08 Alexander Shekhovtsov , Pushmeet Kohli , Carsten Rother

Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understanding what the model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

Generic image inpainting aims to complete a corrupted image by borrowing surrounding information, which barely generates novel content. By contrast, multi-modal inpainting provides more flexible and useful controls on the inpainted content,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shaoan Xie , Zhifei Zhang , Zhe Lin , Tobias Hinz , Kun Zhang

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Zecheng Liu , Jia Wei , Rui Li

Recently, text-to-image denoising diffusion probabilistic models (DDPMs) have demonstrated impressive image generation capabilities and have also been successfully applied to image inpainting. However, in practice, users often require more…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Shiyuan Yang , Xiaodong Chen , Jing Liao

In recent years, the field of image inpainting has developed rapidly, learning based approaches show impressive results in the task of filling missing parts in an image. But most deep methods are strongly tied to the resolution of the…

Image and Video Processing · Electrical Eng. & Systems 2021-04-29 Andrey Moskalenko , Mikhail Erofeev , Dmitriy Vatolin

Image inpainting has achieved fundamental advances with deep learning. However, almost all existing inpainting methods aim to process natural images, while few target Thermal Infrared (TIR) images, which have widespread applications. When…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Zeyu Wang , Haibin Shen , Changyou Men , Quan Sun , Kejie Huang

Recently, how to achieve precise image editing has attracted increasing attention, especially given the remarkable success of text-to-image generation models. To unify various spatial-aware image editing abilities into one framework, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yueru Jia , Yuhui Yuan , Aosong Cheng , Chuke Wang , Ji Li , Huizhu Jia , Shanghang Zhang

Image translation with convolutional neural networks has recently been used as an approach to multimodal change detection. Existing approaches train the networks by exploiting supervised information of the change areas, which, however, is…

While language-guided image manipulation has made remarkable progress, the challenge of how to instruct the manipulation process faithfully reflecting human intentions persists. An accurate and comprehensive description of a manipulation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Yasheng Sun , Yifan Yang , Houwen Peng , Yifei Shen , Yuqing Yang , Han Hu , Lili Qiu , Hideki Koike

When adopting a model-based formulation, solving inverse problems encountered in multiband imaging requires to define spatial and spectral regularizations. In most of the works of the literature, spectral information is extracted from the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-03 Min Zhao , Nicolas Dobigeon , Jie Chen

Completing a corrupted image with correct structures and reasonable textures for a mixed scene remains an elusive challenge. Since the missing hole in a mixed scene of a corrupted image often contains various semantic information,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Liang Liao , Jing Xiao , Zheng Wang , Chia-Wen Lin , Shin'ichi Satoh

Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yurui Ren , Xiaoming Yu , Ruonan Zhang , Thomas H. Li , Shan Liu , Ge Li

Recovering the missing regions of an image is a task that is called image inpainting. Depending on the shape of missing areas, different methods are presented in the literature. One of the challenges of this problem is extracting features…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Ghazale Ghorbanzade , Zahra Nabizadeh , Nader Karimi , Shadrokh Samavi

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

Benefiting from powerful convolutional neural networks (CNNs), learning-based image inpainting methods have made significant breakthroughs over the years. However, some nature of CNNs (e.g. local prior, spatially shared parameters) limit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ye Deng , Siqi Hui , Sanping Zhou , Deyu Meng , Jinjun Wang

Diffeomorphic deformable multi-modal image registration is a challenging task which aims to bring images acquired by different modalities to the same coordinate space and at the same time to preserve the topology and the invertibility of…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Vasiliki Sideri-Lampretsa , Georgios Kaissis , Daniel Rueckert

Recently deep neutral networks have achieved promising performance for filling large missing regions in image inpainting tasks. They usually adopted the standard convolutional architecture over the corrupted image, leading to meaningless…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Yuqing Ma , Xianglong Liu , Shihao Bai , Lei Wang , Aishan Liu , Dacheng Tao , Edwin Hancock

In this work, we introduce a challenging image restoration task, referred to as SuperInpaint, which aims to reconstruct missing regions in low-resolution images and generate completed images with arbitrarily higher resolutions. We have…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Canyu Zhang , Qing Guo , Xiaoguang Li , Renjie Wan , Hongkai Yu , Ivor Tsang , Song Wang

Over the last few years, the performance of inpainting to fill missing regions has shown significant improvements by using deep neural networks. Most of inpainting work create a visually plausible structure and texture, however, due to them…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Yejin Kim , Manri Cheon , Junwoo Lee