English
Related papers

Related papers: MS2Mesh-XR: Multi-modal Sketch-to-Mesh Generation …

200 papers

Sketching is an important activity in any design process. Designers and stakeholders share their ideas through hand-drawn sketches. These sketches are further used to create 3D models. Current methods to generate 3D models from sketches are…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Nitish Bhardwaj , Dhornala Bharadwaj , Alpana Dubey

3D meshes are a fundamental representation widely used in computer science and engineering. In robotics, they are particularly valuable because they capture objects in a form that aligns directly with how robots interact with the physical…

Robotics · Computer Science 2026-01-01 Qian Wang , Omar Abdellall , Tony Gao , Xiatao Sun , Daniel Rakita

VR sketching lets users explore and iterate on ideas directly in 3D, offering a faster and more intuitive alternative to conventional CAD tools. However, existing sketch-to-shape models ignore the temporal ordering of strokes, discarding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yizi Chen , Sidi Wu , Tianyi Xiao , Nina Wiedemann , Loic Landrieu

Converting hand-drawn sketches into structured 3D geometries remains challenging due to the difficulty of representing non-Euclidean surfaces and maintaining topological consistency. Existing generative models such as GANs, NeRFs, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wenda Wang , Anqi Liu , Junqi Yang , Lei He , Luying Wang , Jiachen Lu , Weixin Huang

Recent developments in 3D generative AI enable users to create bespoke 3D models from text or image prompts. However, these approaches provide limited control over spatial structure, making them ill suited for tasks requiring precise…

Human-Computer Interaction · Computer Science 2026-05-21 Faraz Faruqi , Demircan Tas , Arthur Caetano , Niccolò Meniconi , Oğuz Arslan , Misha Sra , Ruofei Du , Stefanie Mueller , Mustafa Doga Dogan

The emerging trend of AR/VR places great demands on 3D content. However, most existing software requires expertise and is difficult for novice users to use. In this paper, we aim to create sketch-based modeling tools for user-friendly 3D…

Human-Computer Interaction · Computer Science 2023-10-30 Tianrun Chen , Chaotao Ding , Lanyun Zhu , Ying Zang , Yiyi Liao , Zejian Li , Lingyun Sun

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

Animation of 2D hand-drawn sketches provides an effective medium for visual communication. However, these sketches pose challenges, particularly in handling occlusions and accurately mapping motion. While 3D animation naturally addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gaurav Rai , Ojaswa Sharma

We introduce Scan2Mesh, a novel data-driven generative approach which transforms an unstructured and potentially incomplete range scan into a structured 3D mesh representation. The main contribution of this work is a generative neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Angela Dai , Matthias Nießner

We propose a mesh-based neural network (MESH2IR) to generate acoustic impulse responses (IRs) for indoor 3D scenes represented using a mesh. The IRs are used to create a high-quality sound experience in interactive applications and audio…

Sound · Computer Science 2022-07-13 Anton Ratnarajah , Zhenyu Tang , Rohith Chandrashekar Aralikatti , Dinesh Manocha

We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities…

Graphics · Computer Science 2020-09-11 Changjian Li , Hao Pan , Adrien Bousseau , Niloy J. Mitra

We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However,…

Human-Computer Interaction · Computer Science 2020-08-21 Ryo Suzuki , Rubaiat Habib Kazi , Li-Yi Wei , Stephen DiVerdi , Wilmot Li , Daniel Leithinger

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches,…

Human-Computer Interaction · Computer Science 2024-05-24 Kristen M. Edwards , Brandon Man , Faez Ahmed

Traditional rendering pipelines rely on complex assets, accurate materials and lighting, and substantial computational resources to produce realistic imagery, yet they still face challenges in scalability and realism for populated dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Gonzalo Gomez-Nogales , Yicong Hong , Chongjian Ge , Peiye Zhuang , Marc Comino-Trinidad , Dan Casas , Yi Zhou

Remarkable advances have been achieved recently in learning neural representations that characterize object geometry, while generating textured objects suitable for downstream applications and 3D rendering remains at an early stage. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Alexey Bokhovkin , Shubham Tulsiani , Angela Dai

Recent deep image-to-image translation techniques allow fast generation of face images from freehand sketches. However, existing solutions tend to overfit to sketches, thus requiring professional sketches or even edge maps as input. To…

Graphics · Computer Science 2020-06-09 Shu-Yu Chen , Wanchao Su , Lin Gao , Shihong Xia , Hongbo Fu

We present an end-to-end framework for generating artist-style meshes from noisy or incomplete point clouds, such as those captured by real-world sensors like LiDAR or mobile RGB-D cameras. Artist-created meshes are crucial for commercial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yao He , Youngjoong Kwon , Wenxiao Cai , Ehsan Adeli

3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel deep-learning based approach for automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yongzhi Xu , Yonhon Ng , Yifu Wang , Inkyu Sa , Yunfei Duan , Zhenhong Sun , Yang Li , Pan Ji , Hongdong Li

We present SpatialPrompt, an Extended Reality(XR) system that turns spatial sketches into executable constraints for controllable 3D generation. Users draw rough structures with a 3D pen and add voice prompts for semantic and stylistic…

Human-Computer Interaction · Computer Science 2026-05-11 Yichen Andy Yu , Wanru Li , Qiaoran Wang , Jymon Ross , Gavin Johnson , Mandy Lui , Qiao Jin

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao
‹ Prev 1 2 3 10 Next ›