English
Related papers

Related papers: Deep Structured Energy-Based Image Inpainting

200 papers

Deep generative models have shown promising results in generating realistic images, but it is still non-trivial to generate images with complicated structures. The main reason is that most of the current generative models fail to explore…

Machine Learning · Computer Science 2018-07-12 Kun Xu , Haoyu Liang , Jun Zhu , Hang Su , Bo Zhang

Completing a corrupted image with correct structures and reasonable textures for a mixed scene remains an elusive challenge. Since the missing hole in a mixed scene of a corrupted image often contains various semantic information,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Liang Liao , Jing Xiao , Zheng Wang , Chia-Wen Lin , Shin'ichi Satoh

With a goal of accelerating fabrication of additively manufactured components with precise microstructures, we developed a method for structural characterization of key features in additively manufactured materials and parts. The method…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Amra Peles , Vincent C. Paquit , Ryan R. Dehoff

Although humans perform well at predicting what exists beyond the boundaries of an image, deep models struggle to understand context and extrapolation through retained information. This task is known as image outpainting and involves…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Przemek Gardias , Eric Arthur , Huaming Sun

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo

Recently, compressed sensing techniques in combination with both wavelet and directional representation systems have been very effectively applied to the problem of image inpainting. However, a mathematical analysis of these techniques…

Functional Analysis · Mathematics 2012-11-29 Emily J. King , Gitta Kutyniok , Xiaosheng Zhuang

For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two…

Machine Learning · Computer Science 2020-01-07 Colin Graber , Alexander Schwing

Convolutional neural networks have recently been used for multi-focus image fusion. However, due to the lack of labeled data for supervised training of such networks, existing methods have resorted to adding Gaussian blur in focused images…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Xiang Yan , Syed Zulqarnain Gilani , Hanlin Qin , Ajmal Mian

Deep representation learning is a crucial procedure in multimedia analysis and attracts increasing attention. Most of the popular techniques rely on convolutional neural network and require a large amount of labeled data in the training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jinghua Wang , Adrian Hilton , Jianmin Jiang

Surface reconstruction is a fundamental problem in 3D graphics. In this paper, we propose a learning-based approach for implicit surface reconstruction from raw point clouds without normals. Our method is inspired by Gauss Lemma in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Dong Xiao , Siyou Lin , Zuoqiang Shi , Bin Wang

Most of existing manifold learning methods rely on Mean Squared Error (MSE) or $\ell_2$ norm. However, for the problem of image quality assessment, these are not promising measure. In this paper, we introduce the concept of an image…

Machine Learning · Statistics 2019-08-27 Benyamin Ghojogh , Fakhri Karray , Mark Crowley

Image inpainting is a key technique in image processing task to predict the missing regions and generate realistic images. Given the advancement of existing generative inpainting models with feature extraction, propagation and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Jireh Jam , Connah Kendrick , Vincent Drouard , Kevin Walker , Moi Hoon Yap

Image inpainting is a restoration method that reconstructs missing image parts. However, a carefully selected mask of known pixels that yield a high quality inpainting can also act as a sparse image representation. This challenging spatial…

Image and Video Processing · Electrical Eng. & Systems 2022-12-05 Pascal Peter

The purpose of image inpainting is to recover scratches and damaged areas using context information from remaining parts. In recent years, thanks to the resurgence of convolutional neural networks (CNNs), image inpainting task has made…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zeyu Lu , Junjun Jiang , Junqin Huang , Gang Wu , Xianming Liu

In this paper, we present a deep-learning-based framework for audio-visual speech inpainting, i.e., the task of restoring the missing parts of an acoustic speech signal from reliable audio context and uncorrupted visual information. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-04 Giovanni Morrone , Daniel Michelsanti , Zheng-Hua Tan , Jesper Jensen

We present a lossy image compression method based on deep convolutional neural networks (CNNs), which outperforms the existing BPG, WebP, JPEG2000 and JPEG as measured via multi-scale structural similarity (MS-SSIM), at the same bit rate.…

Image and Video Processing · Electrical Eng. & Systems 2018-06-06 Haojie Liu , Tong Chen , Qiu Shen , Tao Yue , Zhan Ma

The last decade has shown a tremendous success in solving various computer vision problems with the help of deep learning techniques. Lately, many works have demonstrated that learning-based approaches with suitable network architectures…

Machine Learning · Computer Science 2019-08-21 Michael Moeller , Thomas Möllenhoff , Daniel Cremers

This paper presents a new adversarial training framework for image inpainting with segmentation confusion adversarial training (SCAT) and contrastive learning. SCAT plays an adversarial game between an inpainting generator and a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zhiwen Zuo , Lei Zhao , Ailin Li , Zhizhong Wang , Zhanjie Zhang , Jiafu Chen , Wei Xing , Dongming Lu

Image inpainting is the process of regenerating lost parts of the image. Supervised algorithm-based methods have shown excellent results but have two significant drawbacks. They do not perform well when tested with unseen data. They fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Shubham Gupta , Rahul Kunigal Ravishankar , Madhoolika Gangaraju , Poojasree Dwarkanath , Natarajan Subramanyam

We studied the ability of deep neural networks (DNNs) to restore missing audio content based on its context, a process usually referred to as audio inpainting. We focused on gaps in the range of tens of milliseconds. The proposed DNN…

Sound · Computer Science 2022-02-21 Andrés Marafioti , Nicki Holighaus , Piotr Majdak , Nathanaël Perraudin