English
Related papers

Related papers: Progressive3D: Progressively Local Editing for Tex…

200 papers

This paper proposes ProEdit - a simple yet effective framework for high-quality 3D scene editing guided by diffusion distillation in a novel progressive manner. Inspired by the crucial observation that multi-view inconsistency in scene…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Jun-Kun Chen , Yu-Xiong Wang

Text-guided 3D editing aims to modify existing 3D assets using natural-language instructions. Current methods struggle to jointly understand complex prompts, automatically localize edits in 3D, and preserve unedited content. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yankuan Chi , Xiang Li , Zixuan Huang , James M. Rehg

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

It is highly desirable to obtain a model that can generate high-quality 3D meshes from text prompts in just seconds. While recent attempts have adapted pre-trained text-to-image diffusion models, such as Stable Diffusion (SD), into…

Graphics · Computer Science 2025-03-28 Zhiyuan Ma , Xinyue Liang , Rongyuan Wu , Xiangyu Zhu , Zhen Lei , Lei Zhang

In recent years, advancements in generative models have significantly expanded the capabilities of text-to-3D generation. Many approaches rely on Score Distillation Sampling (SDS) technology. However, SDS struggles to accommodate…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jiahui Yang , Donglin Di , Baorui Ma , Xun Yang , Yongjia Ma , Wenzhang Sun , Wei Chen , Jianxun Cui , Zhou Xue , Meng Wang , Yebin Liu

We propose Prefix-Adaptive Decoding (PREADD), a flexible method for controlled text generation. Unlike existing methods that use auxiliary expert models to control for attributes, PREADD does not require an external model, instead relying…

Computation and Language · Computer Science 2023-07-10 Jonathan Pei , Kevin Yang , Dan Klein

Manually creating 3D environments for AR/VR applications is a complex process requiring expert knowledge in 3D modeling software. Pioneering works facilitate this process by generating room meshes conditioned on textual style descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Jonas Schult , Sam Tsai , Lukas Höllein , Bichen Wu , Jialiang Wang , Chih-Yao Ma , Kunpeng Li , Xiaofang Wang , Felix Wimbauer , Zijian He , Peizhao Zhang , Bastian Leibe , Peter Vajda , Ji Hou

Recent progress in the text-driven 3D stylization of a single object has been considerably promoted by CLIP-based methods. However, the stylization of multi-object 3D scenes is still impeded in that the image-text pairs used for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Xuying Zhang , Bo-Wen Yin , Yuming Chen , Zheng Lin , Yunheng Li , Qibin Hou , Ming-Ming Cheng

The diffusion transformer (DiT) architecture has attracted significant attention in image generation, achieving better fidelity, performance, and diversity. However, most existing DiT - based image generation methods focus on global - aware…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhen Xiong , Yuqi Li , Chuanguang Yang , Tiao Tan , Zhihong Zhu , Siyuan Li , Yue Ma

Natural language interaction is a promising direction for democratizing 3D shape design. However, existing methods for text-driven 3D shape editing face challenges in producing decoupled, local edits to 3D shapes. We address this problem by…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Ian Huang , Panos Achlioptas , Tianyi Zhang , Sergey Tulyakov , Minhyuk Sung , Leonidas Guibas

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Significant progress has been made in text-to-video generation through the use of powerful generative models and large-scale internet data. However, substantial challenges remain in precisely controlling individual concepts within the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Hanxin Zhu , Tianyu He , Anni Tang , Junliang Guo , Zhibo Chen , Jiang Bian

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

The wayward quality of continuous prompts stresses the importance of their interpretability as unexpected and unpredictable behaviors appear following training, especially in the context of large language models automating people-sensitive…

Computation and Language · Computer Science 2024-02-15 Pascal Passigan , Kidus Yohannes , Joshua Pereira

Vision-language models (VLMs) pre-trained on web-scale data exhibit promising zero-shot generalization but often suffer from semantic misalignment due to domain gaps between pre-training and downstream tasks. Existing approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xiaojie Yin , Qilong Wang , Qinghua Hu

Drag-based editing has become popular in 2D content creation, driven by the capabilities of image generative models. However, extending this technique to 3D remains a challenge. Existing 3D drag-based editing methods, whether employing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Honghua Chen , Yushi Lan , Yongwei Chen , Yifan Zhou , Xingang Pan

Text-to-3D generation has shown great promise in generating novel 3D content based on given text prompts. However, existing generative methods mostly focus on geometric or visual plausibility while ignoring precise physics perception for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Qingshan Xu , Jiao Liu , Melvin Wong , Caishun Chen , Yew-Soon Ong

Generative models have achieved significant progress in advancing 2D image editing, demonstrating exceptional precision and realism. However, they often struggle with consistency and object identity preservation due to their inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yuhuan Xie , Aoxuan Pan , Ming-Xian Lin , Wei Huang , Yi-Hua Huang , Xiaojuan Qi

Image-to-3D generation faces inherent semantic ambiguity under occlusion, where partial observation alone is often insufficient to determine object category. In this work, we formalize text-driven amodal 3D generation, where text prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiayin Zhu , Guoji Fu , Xiaolu Liu , Qiyuan He , Yicong Li , Angela Yao