English
Related papers

Related papers: Deep Sketch-Based 3D Modeling: A Survey

200 papers

Deep image-based modeling received lots of attention in recent years, yet the parallel problem of sketch-based modeling has only been briefly studied, often as a potential application. In this work, for the first time, we identify the main…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Yue Zhong , Yulia Gryaditskaya , Honggang Zhang , Yi-Zhe Song

3D sketches are widely used for visually representing the 3D shape and structure of objects or scenes. However, the creation of 3D sketch often requires users to possess professional artistic skills. Existing research efforts primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yibo Zhang , Lihong Wang , Changqing Zou , Tieru Wu , Rui Ma

Recently, 3D understanding has become popular to facilitate autonomous agents to perform further decisionmaking. However, existing 3D datasets and methods are often limited to specific tasks. On the other hand, recent progress in Large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mingsheng Li , Xin Chen , Chi Zhang , Sijin Chen , Hongyuan Zhu , Fukun Yin , Gang Yu , Tao Chen

Considering the existence of very large amount of available data repositories and reach to the very advanced system of hardware, systems meant for facial identification ave evolved enormously over the past few decades. Sketch recognition is…

Machine Learning · Computer Science 2019-11-20 Sukhada Chokkadi , Sannidhan M S , Sudeepa K B , Abhir Bhandary

This work enhances the ability of large language models (LLMs) to perform complex reasoning in 3D scenes. Recent work has addressed the 3D situated reasoning task by invoking tool usage through large language models. Large language models…

Artificial Intelligence · Computer Science 2025-08-22 Jiayi Song , Rui Wan , Lipeng Ma , Weidong Yang , Qingyuan Zhou , Yixuan Li , Ben Fei

While Multimodal Large Language Models (MLLMs) excel at visual understanding, they often struggle in complex scenarios that require visual planning and imagination. Inspired by how humans use sketching as a form of visual thinking to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Huanyu Zhang , Wenshan Wu , Chengzu Li , Ning Shang , Yan Xia , Yangyu Huang , Yifan Zhang , Li Dong , Zhang Zhang , Liang Wang , Tieniu Tan , Furu Wei

The "thinking with images" paradigm represents a pivotal shift in the reasoning of Vision Language Models (VLMs), moving from text-dominant chain-of-thought to image-interactive reasoning. By invoking visual tools or generating intermediate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chi Zhang , Haibo Qiu , Qiming Zhang , Zhixiong Zeng , Lin Ma , Jing Zhang

It can be easy and even fun to sketch humans in different poses. In contrast, creating those same poses on a 3D graphics "mannequin" is comparatively tedious. Yet 3D body poses are necessary for various downstream applications. We seek to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Gizem Unlu , Mohamed Sayed , Gabriel Brostow

We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities…

Graphics · Computer Science 2020-09-11 Changjian Li , Hao Pan , Adrien Bousseau , Niloy J. Mitra

Hatching is a common method used by artists to accentuate the third dimension of a sketch, and to illuminate the scene. Our system SHAD3S attempts to compete with a human at hatching generic three-dimensional (3D) shapes, and also tries to…

Graphics · Computer Science 2021-09-07 Raghav B. Venkataramaiyer , Abhishek Joshi , Saisha Narang , Vinay P. Namboodiri

As multimodal large language models (MLLMs) are increasingly integrated into early-stage design tools, it is important to understand how designers collaborate with AI during ideation. In a user study with 12 participants, we analysed…

Human-Computer Interaction · Computer Science 2026-03-03 Weiyan Shi , Kenny Tsu Wei Choo

Current direct modeling systems limit users to low-level interactions with vertices, edges, and faces, forcing designers to manage detailed geometric elements rather than focusing on high-level design intent. This paper introduces semantic…

Human-Computer Interaction · Computer Science 2025-04-22 Qiang Zou , Shuo Liu

Free-hand sketches are highly illustrative, and have been widely used by humans to depict objects or stories from ancient times to the present. The recent prevalence of touchscreen devices has made sketch creation a much easier task than…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Peng Xu , Timothy M. Hospedales , Qiyue Yin , Yi-Zhe Song , Tao Xiang , Liang Wang

Machine learning solutions, in particular those based on deep learning methods, form an underpinning of the current revolution in "artificial intelligence" that has dominated popular press headlines and is having a significant influence on…

Machine Learning · Computer Science 2019-03-28 Neil D. Lawrence

We propose GroundUp, the first sketch-based ideation tool for 3D city massing of urban areas. We focus on early-stage urban design, where sketching is a common tool and the design starts from balancing building volumes (masses) and open…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Gizem Esra Unlu , Mohamed Sayed , Yulia Gryaditskaya , Gabriel Brostow

User Interface (UI) prototyping is a necessary step in the early stages of application development. Transforming sketches of a Graphical User Interface (UI) into a coded UI application is an uninspired but time-consuming task performed by a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Vanita Jain , Piyush Agrawal , Subham Banga , Rishabh Kapoor , Shashwat Gulyani

Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical…

Numerical Analysis · Mathematics 2022-01-12 Shady E. Ahmed , Omer San , Diana A. Bistrian , Ionel M. Navon

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches,…

Human-Computer Interaction · Computer Science 2024-05-24 Kristen M. Edwards , Brandon Man , Faez Ahmed

We present SENS, a novel method for generating and editing 3D models from hand-drawn sketches, including those of abstract nature. Our method allows users to quickly and easily sketch a shape, and then maps the sketch into the latent space…

Graphics · Computer Science 2024-02-22 Alexandre Binninger , Amir Hertz , Olga Sorkine-Hornung , Daniel Cohen-Or , Raja Giryes

Face sketch to digital image matching is an important challenge of face recognition that involves matching across different domains. Current research efforts have primarily focused on extracting domain invariant representations or learning…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Shruti Nagpal , Maneet Singh , Richa Singh , Mayank Vatsa , Afzel Noore , Angshul Majumdar