English
Related papers

Related papers: Survey on Controlable Image Synthesis with Deep Le…

200 papers

Existing generative approaches for guided image synthesis of multi-object scenes typically rely on 2D controls in the image or text space. As a result, these methods struggle to maintain and respect consistent three-dimensional geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Léopold Maillard , Tom Durand , Adrien Ramanana Rahary , Maks Ovsjanikov

Controllable image synthesis with user scribbles is a topic of keen interest in the computer vision community. In this paper, for the first time we study the problem of photorealistic image synthesis from incomplete and primitive human…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Jaskirat Singh , Liang Zheng , Cameron Smith , Jose Echevarria

Image and video synthesis has become a blooming topic in computer vision and machine learning communities along with the developments of deep generative models, due to its great academic and application value. Many researchers have been…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zhen Jia , Zhang Zhang , Liang Wang , Tieniu Tan

Controllable image synthesis with user scribbles has gained huge public interest with the recent advent of text-conditioned latent diffusion models. The user scribbles control the color composition while the text prompt provides control…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jaskirat Singh , Stephen Gould , Liang Zheng

In the field of image processing, applying intricate semantic modifications within existing images remains an enduring challenge. This paper introduces a pioneering framework that integrates viewpoint information to enhance the control of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Jinbin Bai , Zhen Dong , Aosong Feng , Xiao Zhang , Tian Ye , Kaicheng Zhou

Existing deep learning-based low-light enhancement methods are typically trained on limited datasets with single enhancement targets, which restricts their generalization ability and controllability in real-world applications. To overcome…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yufeng Yang , Jianzhuang Liu , Jisheng Chu , Yuqi Peng , Xianfang Zeng , Jiancheng Huang , Shifeng Chen

Recently, there have been several promising methods to generate realistic imagery from deep convolutional networks. These methods sidestep the traditional computer graphics rendering pipeline and instead generate imagery at the pixel level…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Patsorn Sangkloy , Jingwan Lu , Chen Fang , Fisher Yu , James Hays

Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic images from hand-crafted scene representations. However, the…

Synthetic data is an increasingly popular tool for training deep learning models, especially in computer vision but also in other areas. In this work, we attempt to provide a comprehensive survey of the various directions in the development…

Machine Learning · Computer Science 2019-09-26 Sergey I. Nikolenko

Recent advances in deep learning have significantly increased the performance of face recognition systems. The performance and reliability of these models depend heavily on the amount and quality of the training data. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Adam Kortylewski , Andreas Schneider , Thomas Gerig , Bernhard Egger , Andreas Morel-Forster , Thomas Vetter

Controllable image synthesis models allow creation of diverse images based on text instructions or guidance from a reference image. Recently, denoising diffusion probabilistic models have been shown to generate more realistic imagery than…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Xihui Liu , Dong Huk Park , Samaneh Azadi , Gong Zhang , Arman Chopikyan , Yuxiao Hu , Humphrey Shi , Anna Rohrbach , Trevor Darrell

Despite significant progress on current state-of-the-art image generation models, synthesis of document images containing multiple and complex object layouts is a challenging task. This paper presents a novel approach, called DocSynth, to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Sanket Biswas , Pau Riba , Josep Lladós , Umapada Pal

Synthesizing accurate geometry and photo-realistic appearance of small scenes is an active area of research with compelling use cases in gaming, virtual reality, robotic-manipulation, autonomous driving, convenient product capture, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Arkadeep Narayan Chaudhury , Igor Vasiljevic , Sergey Zakharov , Vitor Guizilini , Rares Ambrus , Srinivasa Narasimhan , Christopher G. Atkeson

Controllable 3D indoor scene synthesis stands at the forefront of technological progress, offering various applications like gaming, film, and augmented/virtual reality. The capability to stylize and de-couple objects within these scenarios…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Yunfan Zhang , Hong Huang , Zhiwei Xiong , Zhiqi Shen , Guosheng Lin , Hao Wang , Nicholas Vun

Image and video inpainting is a classic problem in computer vision and computer graphics, aiming to fill in the plausible and realistic content in the missing areas of images and videos. With the advance of deep learning, this problem has…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Weize Quan , Jiaxi Chen , Yanli Liu , Dong-Ming Yan , Peter Wonka

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating visual content. An…

Human-Computer Interaction · Computer Science 2021-11-22 Forrest Huang , Eldon Schoop , David Ha , Jeffrey Nichols , John Canny

We propose a novel approach to synthesizing images that are effective for training object detectors. Starting from a small set of real images, our algorithm estimates the rendering parameters required to synthesize similar images given a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-30 Artem Rozantsev , Vincent Lepetit , Pascal Fua

Despite the remarkable progress of 3D generation, achieving controllability, i.e., ensuring consistency between generated 3D content and input conditions like edge and depth, remains a significant challenge. Existing methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Hongbin Xu , Chaohui Yu , Feng Xiao , Jiazheng Xing , Hai Ci , Weitao Chen , Fan Wang , Ming Li

Generating a description of an image is called image captioning. Image captioning requires to recognize the important objects, their attributes and their relationships in an image. It also needs to generate syntactically and semantically…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Md. Zakir Hossain , Ferdous Sohel , Mohd Fairuz Shiratuddin , Hamid Laga

Researches in novel viewpoint synthesis majorly focus on interpolation from multi-view input images. In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image. To…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Xiaodong Cun , Feng Xu , Chi-Man Pun , Hao Gao