English
Related papers

Related papers: Unsupervised Scene Sketch to Photo Synthesis

200 papers

Photo-realistic re-rendering of a human from a single image with explicit control over body pose, shape and appearance enables a wide range of applications, such as human appearance transfer, virtual try-on, motion imitation, and novel view…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Kripasindhu Sarkar , Vladislav Golyanik , Lingjie Liu , Christian Theobalt

Humans effortlessly grasp the connection between sketches and real-world objects, even when these sketches are far from realistic. Moreover, human sketch understanding goes beyond categorization -- critically, it also entails understanding…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Xuanchen Lu , Xiaolong Wang , Judith E Fan

Image generation from scene description is a cornerstone technique for the controlled generation, which is beneficial to applications such as content creation and image editing. In this work, we aim to synthesize images from scene…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Hung-Yu Tseng , Hsin-Ying Lee , Lu Jiang , Ming-Hsuan Yang , Weilong Yang

Coupling the high-fidelity generation capabilities of label-conditional image synthesis methods with the flexibility of unconditional generative models, we propose a semantic bottleneck GAN model for unconditional synthesis of complex…

Machine Learning · Computer Science 2019-11-27 Samaneh Azadi , Michael Tschannen , Eric Tzeng , Sylvain Gelly , Trevor Darrell , Mario Lucic

View synthesis aims to generate novel views from one or more given source views. Although existing methods have achieved promising performance, they usually require paired views of different poses to learn a pixel transformation. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Bingzheng Liu , Jianjun Lei , Bo Peng , Chuanbo Yu , Wanqing Li , Nam Ling

The performance of face photo-sketch translation has improved a lot thanks to deep neural networks. GAN based methods trained on paired images can produce high-quality results under laboratory settings. Such paired datasets are, however,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Chaofeng Chen , Wei Liu , Xiao Tan , Kwan-Yee K. Wong

We propose a novel approach to program synthesis, focusing on synthesizing database queries. At a high level, our proposed algorithm takes as input a sketch with soft constraints encoding user intent, and then iteratively interacts with the…

Programming Languages · Computer Science 2021-10-12 Osbert Bastani , Xin Zhang , Armando Solar-Lezama

We contribute the first large-scale dataset of scene sketches, SketchyScene, with the goal of advancing research on sketch understanding at both the object and scene level. The dataset is created through a novel and carefully designed…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Changqing Zou , Qian Yu , Ruofei Du , Haoran Mo , Yi-Zhe Song , Tao Xiang , Chengying Gao , Baoquan Chen , Hao Zhang

We present SENS, a novel method for generating and editing 3D models from hand-drawn sketches, including those of abstract nature. Our method allows users to quickly and easily sketch a shape, and then maps the sketch into the latent space…

Graphics · Computer Science 2024-02-22 Alexandre Binninger , Amir Hertz , Olga Sorkine-Hornung , Daniel Cohen-Or , Raja Giryes

Learning on synthetic data and transferring the resulting properties to their real counterparts is an important challenge for reducing costs and increasing safety in machine learning. In this work, we focus on autoencoder architectures and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

The generative AI technology offers an increasing variety of tools for generating entirely synthetic images that are increasingly indistinguishable from real ones. Unlike methods that alter portions of an image, the creation of completely…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Manos Schinas , Symeon Papadopoulos

As the quality of synthetic images improves, identifying the underlying concepts of model-generated images is becoming increasingly crucial for copyright protection and ensuring model transparency. Existing methods achieve this attribution…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Zongfang Liu , Guangyi Chen , Boyang Sun , Tongliang Liu , Kun Zhang

We propose an image synthesis approach that provides stratified navigation in the latent code space. With a tiny amount of partial or very low-resolution image, our approach can consistently out-perform state-of-the-art counterparts in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Lingzhi Zhang , Jiancong Wang , Yinshuang Xu , Jie Min , Tarmily Wen , James C. Gee , Jianbo Shi

Image smoothing represents a fundamental component of many disparate computer vision and graphics applications. In this paper, we present a unified unsupervised (label-free) learning framework that facilitates generating flexible and…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Qingnan Fan , Jiaolong Yang , David Wipf , Baoquan Chen , Xin Tong

Realistic synthetic image data rendered from 3D models can be used to augment image sets and train image classification semantic segmentation models. In this work, we explore how high quality physically-based rendering and domain…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jason W. Anderson , Marcin Ziolkowski , Ken Kennedy , Amy W. Apon

Recent scene text detection methods are almost based on deep learning and data-driven. Synthetic data is commonly adopted for pre-training due to expensive annotation cost. However, there are obvious domain discrepancies between synthetic…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Youhui Guo , Yu Zhou , Xugong Qin , Enze Xie , Weiping Wang

Learning-based image harmonization techniques are usually trained to undo synthetic random global transformations applied to a masked foreground in a single ground truth photo. This simulated data does not model many of the important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ke Wang , Michaël Gharbi , He Zhang , Zhihao Xia , Eli Shechtman

Deep neural networks have largely failed to effectively utilize synthetic data when applied to real images due to the covariate shift problem. In this paper, we show that by applying a straightforward modification to an existing…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Aysegul Dundar , Ming-Yu Liu , Ting-Chun Wang , John Zedlewski , Jan Kautz

Generating medical images from human-drawn free-hand sketches holds promise for various important medical imaging applications. Due to the extreme difficulty in collecting free-hand sketch data in the medical domain, most deep…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Quan Huu Cap , Atsushi Fukuda

Example-guided image synthesis has recently been attempted to synthesize an image from a semantic label map and an exemplary image. In the task, the additional exemplar image provides the style guidance that controls the appearance of the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Haitian Zheng , Haofu Liao , Lele Chen , Wei Xiong , Tianlang Chen , Jiebo Luo