English
Related papers

Related papers: Progressive3D: Progressively Local Editing for Tex…

200 papers

The current advances in generative AI for learning large neural network models with the capability to produce essays, images, music and even 3D assets from text prompts create opportunities for a manifold of disciplines. In the present…

Computation and Language · Computer Science 2023-07-06 Thiago Rios , Stefan Menzel , Bernhard Sendhoff

Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Linhao Zhong , Yan Hong , Wentao Chen , Binglin Zhou , Yiyi Zhang , Jianfu Zhang , Liqing Zhang

Designing complex 3D scenes has been a tedious, manual process requiring domain expertise. Emerging text-to-3D generative models show great promise for making this task more intuitive, but existing approaches are limited to object-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ryan Po , Gordon Wetzstein

Recent innovations on text-to-3D generation have featured Score Distillation Sampling (SDS), which enables the zero-shot learning of implicit 3D models (NeRF) by directly distilling prior knowledge from 2D diffusion models. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yang Chen , Yingwei Pan , Haibo Yang , Ting Yao , Tao Mei

The notable gap between user-provided and model-preferred prompts poses a significant challenge for generating high-quality images with text-to-image models, compelling the need for prompt engineering. Current studies on prompt engineering…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shiyu Wu , Mingzhen Sun , Weining Wang , Yequan Wang , Jing Liu

In recent years Generative Machine Learning systems have advanced significantly. A current wave of generative systems use text prompts to create complex imagery, video, even 3D datasets. The creators of these systems claim a revolution in…

Computers and Society · Computer Science 2023-02-03 Jon McCormack , Camilo Cruz Gambardella , Nina Rajcic , Stephen James Krol , Maria Teresa Llano , Meng Yang

Building on the success of text-to-image diffusion models (DPMs), image editing is an important application to enable human interaction with AI-generated content. Among various editing methods, editing within the prompt space gains more…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Aosong Feng , Weikang Qiu , Jinbin Bai , Xiao Zhang , Zhen Dong , Kaicheng Zhou , Rex Ying , Leandros Tassiulas

In this paper, we democratise 3D content creation, enabling precise generation of 3D shapes from abstract sketches while overcoming limitations tied to drawing skills. We introduce a novel part-level modelling and alignment framework that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Hmrishav Bandyopadhyay , Subhadeep Koley , Ayan Das , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Plain text has become a prevalent interface for text-to-image synthesis. However, its limited customization options hinder users from accurately describing desired outputs. For example, plain text makes it hard to specify continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Songwei Ge , Taesung Park , Jun-Yan Zhu , Jia-Bin Huang

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Recent work on image content manipulation based on vision-language pre-training models has been effectively extended to text-driven 3D scene editing. However, existing schemes for 3D scene editing still exhibit certain shortcomings,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Shuangkang Fang , Yufeng Wang , Yi-Hsuan Tsai , Yi Yang , Wenrui Ding , Shuchang Zhou , Ming-Hsuan Yang

Current text-to-image (T2I) benchmarks evaluate models on rigid prompts, potentially underestimating true generative capabilities due to prompt sensitivity and creating biases that favor certain models while disadvantaging others. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haosheng Gan , Berk Tinaz , Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

Image composition and generation are processes where the artists need control over various parts of the generated images. However, the current state-of-the-art generation models, like Stable Diffusion, cannot handle fine-grained part-level…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Harsh Rangwani , Aishwarya Agarwal , Kuldeep Kulkarni , R. Venkatesh Babu , Srikrishna Karanam

Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict…

Graphics · Computer Science 2026-03-25 Saar Huberman , Or Patashnik , Omer Dahary , Ron Mokady , Daniel Cohen-Or

Recently, sparsely-supervised 3D object detection has gained great attention, achieving performance close to fully-supervised 3D objectors while requiring only a few annotated instances. Nevertheless, these methods suffer challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shijia Zhao , Qiming Xia , Xusheng Guo , Pufan Zou , Maoji Zheng , Hai Wu , Chenglu Wen , Cheng Wang

Despite the progress in text-to-image generation, semantic image editing remains a challenge. Inversion-based algorithms unavoidably introduce reconstruction errors, while instruction-based models mainly suffer from limited dataset quality…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 En Ci , Shanyan Guan , Yanhao Ge , Yilin Zhang , Wei Li , Zhenyu Zhang , Jian Yang , Ying Tai

Recent CLIP-guided 3D optimization methods, such as DreamFields and PureCLIPNeRF, have achieved impressive results in zero-shot text-to-3D synthesis. However, due to scratch training and random initialization without prior knowledge, these…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jiale Xu , Xintao Wang , Weihao Cheng , Yan-Pei Cao , Ying Shan , Xiaohu Qie , Shenghua Gao

Traditional methods for 3D object compression operate only on structural information within the object vertices, polygons, and textures. These methods are effective at compression rates up to 10x for standard object sizes but quickly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jordan Dotzel , Tony Montes , Mohamed S. Abdelfattah , Zhiru Zhang

Prompt compression methods enhance the efficiency of Large Language Models (LLMs) and minimize the cost by reducing the length of input context. The goal of prompt compression is to shorten the LLM prompt while maintaining a high generation…

Computation and Language · Computer Science 2025-08-25 Tinghui Zhang , Yifan Wang , Daisy Zhe Wang

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li