中文
相关论文

相关论文: DreamEdit3D: Personalization of Multi-View Diffusi…

200 篇论文

We propose CatVersion, an inversion-based method that learns the personalized concept through a handful of examples. Subsequently, users can utilize text prompts to generate images that embody the personalized concept, thereby achieving…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Ruoyu Zhao , Mingrui Zhu , Shiyin Dong , Nannan Wang , Xinbo Gao

Text-driven image and video diffusion models have recently achieved unprecedented generation realism. While diffusion models have been successfully applied for image editing, very few works have done so for video editing. We present the…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Eyal Molad , Eliahu Horwitz , Dani Valevski , Alex Rav Acha , Yossi Matias , Yael Pritch , Yaniv Leviathan , Yedid Hoshen

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

Recently, text-guided 3D generative methods have made remarkable advancements in producing high-quality textures and geometry, capitalizing on the proliferation of large vision-language and image diffusion models. However, existing methods…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Xiao Han , Yukang Cao , Kai Han , Xiatian Zhu , Jiankang Deng , Yi-Zhe Song , Tao Xiang , Kwan-Yee K. Wong

The recent success of pre-trained diffusion models unlocks the possibility of the automatic generation of textures for arbitrary 3D meshes in the wild. However, these models are trained in the screen space, while converting them to a…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Hongkun Zhang , Zherong Pan , Congyi Zhang , Lifeng Zhu , Xifeng Gao

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

Audio-driven emotional 3D facial animation encounters two significant challenges: (1) reliance on single-modal control signals (videos, text, or emotion labels) without leveraging their complementary strengths for comprehensive emotion…

多媒体 · 计算机科学 2025-06-13 Kangwei Liu , Junwu Liu , Xiaowei Yi , Jinlin Guo , Yun Cao

Text-to-Image (T2I) diffusion models have recently gained traction for their versatility and user-friendliness in 2D content generation and editing. However, training a diffusion model specifically for 3D scene editing is challenging due to…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Nazmul Karim , Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Despite the recent success of multi-view diffusion models for text/image-based 3D asset generation, instruction-based editing of 3D assets lacks surprisingly far behind the quality of generation models. The main reason is that recent…

图形学 · 计算机科学 2025-12-15 Maria Parelli , Michael Oechsle , Michael Niemeyer , Federico Tombari , Andreas Geiger

Recent advancements in text-to-3D generation have significantly contributed to the automation and democratization of 3D content creation. Building upon these developments, we aim to address the limitations of current methods in blending…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Yeongtak Oh , Jooyoung Choi , Yongsung Kim , Minjun Park , Chaehun Shin , Sungroh Yoon

Customized generation using diffusion models has made impressive progress in image generation, but remains unsatisfactory in the challenging video generation task, as it requires the controllability of both subjects and motions. To that…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Yujie Wei , Shiwei Zhang , Zhiwu Qing , Hangjie Yuan , Zhiheng Liu , Yu Liu , Yingya Zhang , Jingren Zhou , Hongming Shan

We propose a diffusion-based approach for Text-to-Image (T2I) generation with consistent and interactive 3D layout control and editing. While prior methods improve spatial adherence using 2D cues or iterative copy-warp-paste strategies,…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Andrea Rigo , Luca Stornaiuolo , Weijie Wang , Mauro Martino , Bruno Lepri , Nicu Sebe

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Weiwei Cai , Shuangkang Fang , Weicai Ye , Xin Dong , Yunhan Yang , Xuanyang Zhang , Wei Cheng , Yanpei Cao , Gang Yu , Tao Chen

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Texture editing is a crucial task in 3D modeling that allows users to automatically manipulate the surface materials of 3D models. However, the inherent complexity of 3D models and the ambiguous text description lead to the challenge in…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Shengqi Liu , Zhuo Chen , Jingnan Gao , Yichao Yan , Wenhan Zhu , Jiangjing Lyu , Xiaokang Yang

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Text-guided diffusion models have revolutionized image generation and editing, offering exceptional realism and diversity. Specifically, in the context of diffusion-based editing, where a source image is edited according to a target prompt,…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Xuan Ju , Ailing Zeng , Yuxuan Bian , Shaoteng Liu , Qiang Xu

Recently, text-to-image (T2I) editing has been greatly pushed forward by applying diffusion models. Despite the visual promise of the generated images, inconsistencies with the expected textual prompt remain prevalent. This paper aims to…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Aoxue Li , Mingyang Yi , Zhenguo Li

Generating high-quality 360-degree views of human heads from single-view images is essential for enabling accessible immersive telepresence applications and scalable personalized content creation. While cutting-edge methods for full head…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Yuming Gu , Phong Tran , Yujian Zheng , Hongyi Xu , Heyuan Li , Adilbek Karmanov , Hao Li