English
Related papers

Related papers: Sketch2Human: Deep Human Generation with Disentang…

200 papers

3D model reconstruction from a single image has achieved great progress with the recent deep generative models. However, the conventional reconstruction approaches with template mesh deformation and implicit fields have difficulty in…

Graphics · Computer Science 2023-03-02 Yi He , Haoran Xie , Kazunori Miyata

While GANs can produce photo-realistic images in ideal conditions for certain domains, the generation of full-body human images remains difficult due to the diversity of identities, hairstyles, clothing, and the variance in pose. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Anna Frühstück , Krishna Kumar Singh , Eli Shechtman , Niloy J. Mitra , Peter Wonka , Jingwan Lu

In this paper, we propose a novel framework named DRL-CPG to learn disentangled latent representation for controllable person image generation, which can produce realistic person images with desired poses and human attributes (e.g., pose,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Wenju Xu , Chengjiang Long , Yongwei Nie , Guanghui Wang

We present a framework for training GANs with explicit control over generated images. We are able to control the generated image by settings exact attributes such as age, pose, expression, etc. Most approaches for editing GAN-generated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Alon Shoshan , Nadav Bhonker , Igor Kviatkovsky , Gerard Medioni

We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities…

Graphics · Computer Science 2020-09-11 Changjian Li , Hao Pan , Adrien Bousseau , Niloy J. Mitra

We present SCULPT, a novel 3D generative model for clothed and textured 3D meshes of humans. Specifically, we devise a deep neural network that learns to represent the geometry and appearance distribution of clothed human bodies. Training…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Soubhik Sanyal , Partha Ghosh , Jinlong Yang , Michael J. Black , Justus Thies , Timo Bolkart

Can a user create a deep generative model by sketching a single example? Traditionally, creating a GAN model has required the collection of a large-scale dataset of exemplars and specialized knowledge in deep learning. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Sheng-Yu Wang , David Bau , Jun-Yan Zhu

This paper proposes a new end-to-end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Thiago L. Gomes , Thiago M. Coutinho , Rafael Azevedo , Renato Martins , Erickson R. Nascimento

We introduce the first method for automatic image generation from scene-level freehand sketches. Our model allows for controllable image generation by specifying the synthesis goal via freehand sketches. The key contribution is an attribute…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Chengying Gao , Qi Liu , Qi Xu , Limin Wang , Jianzhuang Liu , Changqing Zou

Translating freehand sketches into photorealistic images remains a fundamental challenge in image synthesis, particularly due to the abstract, sparse, and stylistically diverse nature of sketches. Existing approaches, including GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Ali Zia , Muhammad Umer Ramzan , Usman Ali , Muhammad Faheem , Abdelwahed Khamis , Shahnawaz Qureshi

With the development of neural radiance fields and generative models, numerous methods have been proposed for learning 3D human generation from 2D images. These methods allow control over the pose of the generated 3D human and enable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Peng Zheng , Tao Liu , Zili Yi , Rui Ma

Achieving an effective fine-grained appearance variation over 2D facial images, whilst preserving facial identity, is a challenging task due to the high complexity and entanglement of common 2D facial feature encoding spaces. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Seyma Yucer , Amir Atapour Abarghouei , Noura Al Moubayed , Toby P. Breckon

In this paper, we investigate deep image synthesis guided by sketch, color, and texture. Previous image synthesis methods can be controlled by sketch and color strokes but we are the first to examine texture control. We allow a user to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Wenqi Xian , Patsorn Sangkloy , Varun Agrawal , Amit Raj , Jingwan Lu , Chen Fang , Fisher Yu , James Hays

Sketch is an important media for human to communicate ideas, which reflects the superiority of human intelligence. Studies on sketch can be roughly summarized into recognition and generation. Existing models on image recognition failed to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yajing Chen , Shikui Tu , Yuqi Yi , Lei Xu

Computer-aided design (CAD) is the most widely used modeling approach for technical design. The typical starting point in these designs is 2D sketches which can later be extruded and combined to obtain complex three-dimensional assemblies.…

Machine Learning · Computer Science 2021-06-08 Wamiq Reyaz Para , Shariq Farooq Bhat , Paul Guerrero , Tom Kelly , Niloy Mitra , Leonidas Guibas , Peter Wonka

Recent years have witnessed remarkable progress in generative AI, with natural language emerging as the most common conditioning input. As underlying models grow more powerful, researchers are exploring increasingly diverse conditioning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ahmed Bourouis , Mikhail Bessmeltsev , Yulia Gryaditskaya

Artificial data synthesis is currently a well studied topic with useful applications in data science, computer vision, graphics and many other fields. Generating realistic data is especially challenging since human perception is highly…

Computational Geometry · Computer Science 2019-01-23 Gil Shamai , Ron Slossberg , Ron Kimmel

Image editing using a pretrained StyleGAN generator has emerged as a powerful paradigm for facial editing, providing disentangled controls over age, expression, illumination, etc. However, the approach cannot be directly adopted for video…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Rameen Abdal , Peihao Zhu , Niloy J. Mitra , Peter Wonka

Sketch-based 3D reconstruction remains a challenging task due to the abstract and sparse nature of sketch inputs, which often lack sufficient semantic and geometric information. To address this, we propose Sketch2Symm, a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yan Zhou , Mingji Li , Xiantao Zeng , Jie Lin , Yuexia Zhou

Automatic synthesis of faces from visual attributes is an important problem in computer vision and has wide applications in law enforcement and entertainment. With the advent of deep generative convolutional neural networks (CNNs), attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xing Di , Vishal M. Patel