English
Related papers

Related papers: Diff3DS: Generating View-Consistent 3D Sketch via …

200 papers

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Ongoing advancements in the fields of 3D modelling and digital archiving have led to an outburst in the amount of data stored digitally. Consequently, several retrieval systems have been developed depending on the type of data stored in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Bharadwaj Manda , Shubham Dhayarkar , Sai Mitheran , V. K. Viekash , Ramanathan Muthuganapathy

Sketching is a direct and inexpensive means of visual expression. Though image-based sketching has been well studied, video-based sketch animation generation is still very challenging due to the temporal coherence requirement. In this…

Graphics · Computer Science 2026-03-19 Xinding Zhu , Xinye Yang , Shuyang Zheng , Zhexin Zhang , Fei Gao , Jing Huang , Jiazhou Chen

Realistic hair strand generation is crucial for applications like computer graphics and virtual reality. While diffusion models can generate hairstyles from text or images, these inputs lack precision and user-friendliness. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Na Zhang , Moran Li , Chengming Xu , Han Feng , Xiaobin Hu , Jiangning Zhang , Weijian Cao , Chengjie Wang , Yanwei Fu

Generating high-quality textures for 3D scenes is crucial for applications in interior design, gaming, and augmented/virtual reality (AR/VR). Although recent advancements in 3D generative models have enhanced content creation, significant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Yunfan Zhang , Zhiwei Xiong , Zhiqi Shen , Guosheng Lin , Hao Wang , Nicolas Vun

The field of multiple view geometry has seen tremendous progress in reconstruction and calibration due to methods for extracting reliable point features and key developments in projective geometry. Point features, however, are not available…

Computer Vision and Pattern Recognition · Computer Science 2016-04-29 Ricardo Fabbri , Benjamin Kimia

Guided synthesis of high-quality 3D scenes is a challenging task. Diffusion models have shown promise in generating diverse data, including 3D scenes. However, current methods rely directly on text embeddings for controlling the generation,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Mohammad Naanaa , Katharina Schmid , Yinyu Nie

Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applications by abstracting the scene context in a compact manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Guangyao Zhai , Evin Pınar Örnek , Shun-Cheng Wu , Yan Di , Federico Tombari , Nassir Navab , Benjamin Busam

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating visual content. An…

Human-Computer Interaction · Computer Science 2021-11-22 Forrest Huang , Eldon Schoop , David Ha , Jeffrey Nichols , John Canny

Realistic 3D indoor scene synthesis is vital for embodied AI and digital content creation. It can be naturally divided into two subtasks: object generation and layout generation. While recent generative models have significantly advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Xingjian Ran , Yixuan Li , Linning Xu , Mulin Yu , Bo Dai

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

We introduce Drag4D, an interactive framework that integrates object motion control within text-driven 3D scene generation. This framework enables users to define 3D trajectories for the 3D objects generated from a single image, seamlessly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Minjun Kang , Inkyu Shin , Taeyeop Lee , In So Kweon , Kuk-Jin Yoon

We present the first fine-grained dataset of 1,497 3D VR sketch and 3D shape pairs of a chair category with large shapes diversity. Our dataset supports the recent trend in the sketch community on fine-grained data analysis, and extends it…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Ling Luo , Yulia Gryaditskaya , Yongxin Yang , Tao Xiang , Yi-Zhe Song

We study the practical task of fine-grained 3D-VR-sketch-based 3D shape retrieval. This task is of particular interest as 2D sketches were shown to be effective queries for 2D images. However, due to the domain gap, it remains hard to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Ling Luo , Yulia Gryaditskaya , Tao Xiang , Yi-Zhe Song

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

We present a method to automatically compute correct gradients with respect to geometric scene parameters in neural SDF renderers. Recent physically-based differentiable rendering techniques for meshes have used edge-sampling to handle…

We tackle the task of learning dynamic 3D semantic radiance fields given a single monocular video as input. Our learned semantic radiance field captures per-point semantics as well as color and geometric properties for a dynamic 3D scene,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Isaac Labe , Noam Issachar , Itai Lang , Sagie Benaim

In this paper, we tackle a new task of 3D object synthesis, where a 3D model is composited with another object category to create a novel 3D model. However, most existing text/image/3D-to-3D methods struggle to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zeren Xiong , Zikun Chen , Zedong Zhang , Xiang Li , Ying Tai , Jian Yang , Jun Li

We present DriveGen3D, a novel framework for generating high-quality and highly controllable dynamic 3D driving scenes that addresses critical limitations in existing methodologies. Current approaches to driving scene synthesis either…