English
Related papers

Related papers: Sketch2Mesh: Reconstructing and Editing 3D Shapes …

200 papers

Researchers have explored various ways to generate realistic images from freehand sketches, e.g., for objects and human faces. However, how to generate realistic human body images from sketches is still a challenging problem. It is, first…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Xian Wu , Chen Wang , Hongbo Fu , Ariel Shamir , Song-Hai Zhang , Shi-Min Hu

We consider the problem of reconstructing a 3D scene from multiple sketches. We propose a pipeline which involves (1) stitching together multiple sketches through use of correspondence points, (2) converting the stitched sketch into a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Abhimanyu Talwar , Julien Laasri

Deep learning applied to the reconstruction of 3D shapes has seen growing interest. A popular approach to 3D reconstruction and generation in recent years has been the CNN encoder-decoder model usually applied in voxel space. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mateusz Michalkiewicz , Eugene Belilovsky , Mahsa Baktashmotlagh , Anders Eriksson

To see is to sketch -- free-hand sketching naturally builds ties between human and machine vision. In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process. This is an…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jifei Song , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy Hospedales

We present a new deep learning approach for matching deformable shapes by introducing {\it Shape Deformation Networks} which jointly encode 3D shapes and correspondences. This is achieved by factoring the surface representation into (i) a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

We propose a novel image-to-pencil translation method that could not only generate high-quality pencil sketches but also offer the drawing process. Existing pencil sketch algorithms are based on texture rendering rather than the direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Zhengyan Tong , Xuanhong Chen , Bingbing Ni , Xiaohang Wang

We apply style transfer on mesh reconstructions of indoor scenes. This enables VR applications like experiencing 3D environments painted in the style of a favorite artist. Style transfer typically operates on 2D images, making stylization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Lukas Höllein , Justin Johnson , Matthias Nießner

With recent advances in image-to-image translation tasks, remarkable progress has been witnessed in generating face images from sketches. However, existing methods frequently fail to generate images with details that are semantically and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Binxin Yang , Xuejin Chen , Chaoqun Wang , Chi Zhang , Zihan Chen , Xiaoyan Sun

3D shape modeling is labor-intensive, time-consuming, and requires years of expertise. To facilitate 3D shape modeling, we propose a 3D shape generation network that takes a 3D VR sketch as a condition. We assume that sketches are created…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Ling Luo , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song , Yulia Gryaditskaya

3D model reconstruction from a single image has achieved great progress with the recent deep generative models. However, the conventional reconstruction approaches with template mesh deformation and implicit fields have difficulty in…

Graphics · Computer Science 2023-03-02 Yi He , Haoran Xie , Kazunori Miyata

3D modeling of non-linear objects from stylized sketches is a challenge even for experts in Computer Graphics (CG). The extrapolation of objects parameters from a stylized sketch is a very complex and cumbersome task. In the present study,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Gilda Manfredi , Nicola Capece , Ugo Erra , Monica Gruosso

We propose a new approach for synthesizing fully detailed art-stylized images from sketches. Given a sketch, with no semantic tagging, and a reference image of a specific style, the model can synthesize meaningful details with colors and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Bingchen Liu , Kunpeng Song , Ahmed Elgammal

This paper introduces a model for producing stylized line drawings from 3D shapes. The model takes a 3D shape and a viewpoint as input, and outputs a drawing with textured strokes, with variations in stroke thickness, deformation, and color…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Difan Liu , Matthew Fisher , Aaron Hertzmann , Evangelos Kalogerakis

We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their…

Graphics · Computer Science 2024-10-28 Vishnu Sarukkai , Lu Yuan , Mia Tang , Maneesh Agrawala , Kayvon Fatahalian

3D reconstruction from a single view image is a long-standing prob-lem in computer vision. Various methods based on different shape representations(such as point cloud or volumetric representations) have been proposed. However,the 3D shape…

Graphics · Computer Science 2020-03-10 Aihua Mao , Canglan Dai , Lin Gao , Ying He , Yong-jin Liu

The emerging trend of AR/VR places great demands on 3D content. However, most existing software requires expertise and is difficult for novice users to use. In this paper, we aim to create sketch-based modeling tools for user-friendly 3D…

Human-Computer Interaction · Computer Science 2023-10-30 Tianrun Chen , Chaotao Ding , Lanyun Zhu , Ying Zang , Yiyi Liao , Zejian Li , Lingyun Sun

3D modeling based on point clouds is an efficient way to reconstruct and create detailed 3D content. However, the geometric procedure may lose accuracy due to high redundancy and the absence of an explicit structure. In this work, we…

Graphics · Computer Science 2022-01-28 Xusheng Du , Yi He , Xi Yang , Chia-Ming Chang , Haoran Xie

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

Image translation is a computer vision task that involves translating one representation of the scene into another. Various approaches have been proposed and achieved highly desirable results. Nevertheless, its accomplishment requires…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Dichao Hu

Recently, encoders like ViT (vision transformer) and ResNet have been trained on vast datasets and utilized as perceptual metrics for comparing sketches and images, as well as multi-domain encoders in a zero-shot setting. However, there has…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Gianluca Berardi , Yulia Gryaditskaya