English
Related papers

Related papers: Magic3DSketch: Create Colorful 3D Models From Sket…

200 papers

The creation of complex 3D scenes tailored to user specifications has been a tedious and challenging task with traditional 3D modeling tools. Although some pioneering methods have achieved automatic text-to-3D generation, they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xiuyu Yang , Yunze Man , Jun-Kun Chen , Yu-Xiong Wang

Generating 3D faces from textual descriptions has a multitude of applications, such as gaming, movie, and robotics. Recent progresses have demonstrated the success of unconditional 3D face generation and text-to-3D shape generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Cuican Yu , Guansong Lu , Yihan Zeng , Jian Sun , Xiaodan Liang , Huibin Li , Zongben Xu , Songcen Xu , Wei Zhang , Hang Xu

Direct manipulation interfaces provide intuitive and interactive features to a broad range of users, but they often exhibit two limitations: the built-in features cannot possibly cover all use cases, and the internal representation of the…

Human-Computer Interaction · Computer Science 2019-07-26 Brian Hempel , Ravi Chugh

Sketches are a natural and accessible medium for UI designers to conceptualize early-stage ideas. However, existing research on UI/UX automation often requires high-fidelity inputs like Figma designs or detailed screenshots, limiting…

Computation and Language · Computer Science 2024-10-22 Ryan Li , Yanzhe Zhang , Diyi Yang

In the context of a classroom lesson, concepts must be visualized and organized in many ways depending on the needs of the teacher and students. Traditional presentation media such as the blackboard or electronic whiteboard allow for static…

Human-Computer Interaction · Computer Science 2018-09-20 Ken Perlin , Zhenyi He , Karl Rosenberg

Large language models (LLMs) represented by GPT family have achieved remarkable success. The characteristics of LLMs lie in their ability to accommodate a wide range of tasks through a generative approach. However, the flexibility of their…

Computation and Language · Computer Science 2024-09-06 Xin Jiang , Xiang Li , Wenjia Ma , Xuezhi Fang , Yiqun Yao , Naitong Yu , Xuying Meng , Peng Han , Jing Li , Aixin Sun , Yequan Wang

The emergence of virtual reality has necessitated the generation of detailed and customizable 3D hand models for interaction in the virtual world. However, the current methods for 3D hand model generation are both expensive and cumbersome,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Green Rosh , Prateek Kukreja , Vishakha SR , Pawan Prasad B H

3D-aware portrait editing has a wide range of applications in multiple fields. However, current approaches are limited due that they can only perform mask-guided or text-based editing. Even by fusing the two procedures into a model, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kangneng Zhou , Daiheng Gao , Xuan Wang , Jie Zhang , Peng Zhang , Xusen Sun , Longhao Zhang , Shiqi Yang , Bang Zhang , Liefeng Bo , Yaxing Wang , Ming-Ming Cheng

Designing high-quality indoor 3D scenes is important in many practical applications, such as room planning or game development. Conventionally, this has been a time-consuming process which requires both artistic skill and familiarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Başak Melis Öcal , Maxim Tatarchenko , Sezer Karaoglu , Theo Gevers

We present CoGS, a novel method for the style-conditioned, sketch-driven synthesis of images. CoGS enables exploration of diverse appearance possibilities for a given sketched object, enabling decoupled control over the structure and the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Cusuh Ham , Gemma Canet Tarres , Tu Bui , James Hays , Zhe Lin , John Collomosse

In this paper we investigate image generation guided by hand sketch. When the input sketch is badly drawn, the output of common image-to-image translation follows the input edges due to the hard condition imposed by the translation process.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yongyi Lu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

User Interface (UI) prototyping is a necessary step in the early stages of application development. Transforming sketches of a Graphical User Interface (UI) into a coded UI application is an uninspired but time-consuming task performed by a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Vanita Jain , Piyush Agrawal , Subham Banga , Rishabh Kapoor , Shashwat Gulyani

In the past decade, advances in artificial intelligence have revolutionized sketch-based 3D modeling, leading to a new paradigm known as Deep Sketch-Based 3D Modeling (DS-3DM). DS-3DM offers data-driven methods that address the…

If a picture is worth thousand words, a moving 3d shape must be worth a million. We build upon the success of recent generative methods that create images fitting the semantics of a text prompt, and extend it to the controlled generation of…

Machine Learning · Computer Science 2021-09-28 Nikolay Jetchev

Text-guided image editing is widely needed in daily life, ranging from personal use to professional applications such as Photoshop. However, existing methods are either zero-shot or trained on an automatically synthesized dataset, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Kai Zhang , Lingbo Mo , Wenhu Chen , Huan Sun , Yu Su

Recently, text-to-image generation has exhibited remarkable advancements, with the ability to produce visually impressive results. In contrast, text-to-3D generation has not yet reached a comparable level of quality. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Enabling agents to understand and interact with complex 3D scenes is a fundamental challenge for embodied artificial intelligence systems. While Multimodal Large Language Models (MLLMs) have achieved significant progress in 2D image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Haoyuan Li , Rui Liu , Hehe Fan , Yi Yang

For designing a wide range of everyday objects, the design process should be aware of both the human body and the underlying semantics of the design specification. However, these two objectives present significant challenges to the current…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Michelle Guo , Mia Tang , Hannah Cha , Ruohan Zhang , C. Karen Liu , Jiajun Wu

Sketching provides an intuitive way to convey dynamic intent in animation authoring (i.e., how elements change over time and space), making it a natural medium for automatic content creation. Yet existing approaches often constrain sketches…

Human-Computer Interaction · Computer Science 2026-01-29 Boyu Li , Lin-Ping Yuan , Zeyu Wang , Hongbo Fu

3D face reconstruction from a single sketch is a critical yet underexplored task with significant practical applications. The primary challenges stem from the substantial modality gap between 2D sketches and 3D facial structures, including:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Liting Wen , Zimo Yang , Xianlin Zhang , Chi Ding , Mingdao Wang , Xueming Li