中文
相关论文

相关论文: Towards Scalable and Consistent 3D Editing

200 篇论文

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

The 3D Morphable Model (3DMM) is a powerful statistical tool for representing 3D face shapes. To build a 3DMM, a training set of face scans in full point-to-point correspondence is required, and its modeling capabilities directly depend on…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Claudio Ferrari , Stefano Berretti , Pietro Pala , Alberto Del Bimbo

Drag-based editing has become popular in 2D content creation, driven by the capabilities of image generative models. However, extending this technique to 3D remains a challenge. Existing 3D drag-based editing methods, whether employing…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Honghua Chen , Yushi Lan , Yongwei Chen , Yifan Zhou , Xingang Pan

Large diffusion transformers (DiTs) follow global editing instructions well but consistently leak local edits into unrelated regions, because joint-attention architectures offer no explicit channel telling the network where to apply the…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Honghao Cai , Xiangyuan Wang , Yunhao Bai , Haohua Chen , Tianze Zhou , Runqi Wang , Wei Zhu , Yibo Chen , Xu Tang , Yao Hu , Zhen Li

We introduce neuralCAD-Edit, the first benchmark for editing 3D CAD models collected from expert CAD engineers. Instead of text conditioning as in prior works, we collect realistic CAD editing requests by capturing videos of professional…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Toby Perrett , Matthew Bouchard , William McCarthy

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

计算机视觉与模式识别 · 计算机科学 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Visual autoregressive (VAR) models have recently emerged as a promising family of generative models, enabling a wide range of downstream vision tasks such as text-guided image editing. By shifting the editing paradigm from noise…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Tao Xia , Jiawei Liu , Yukun Zhang , Ting Liu , Wei Wang , Lei Zhang

We present Assembler, a scalable and generalizable framework for 3D part assembly that reconstructs complete objects from input part meshes and a reference image. Unlike prior approaches that mostly rely on deterministic part pose…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Wang Zhao , Yan-Pei Cao , Jiale Xu , Yuejiang Dong , Ying Shan

Recent progress in robot learning has been driven by large-scale datasets and powerful visuomotor policy architectures, yet policy robustness remains limited by the substantial cost of collecting diverse demonstrations, particularly for…

机器人学 · 计算机科学 2026-03-24 Yujie Zhao , Hongwei Fan , Di Chen , Shengcong Chen , Liliang Chen , Xiaoqi Li , Guanghui Ren , Hao Dong

Image spatial editing performs geometry-driven transformations, allowing precise control over object layout and camera viewpoints. Current models are insufficient for fine-grained spatial manipulations, motivating a dedicated assessment…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Yicheng Xiao , Wenhu Zhang , Lin Song , Yukang Chen , Wenbo Li , Nan Jiang , Tianhe Ren , Haokun Lin , Wei Huang , Haoyang Huang , Xiu Li , Nan Duan , Xiaojuan Qi

Text-conditioned image editing has greatly benefitted from the advancements in Image Diffusion Models. However, extending these techniques to facial video editing introduces challenges in preserving facial identity throughout the source…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Huanghao Yin , Shenkun Xu , Kanle Shi , Junhai Yong , Bin Wang

Text-based 2D diffusion models have demonstrated impressive capabilities in image generation and editing. Meanwhile, the 2D diffusion models also exhibit substantial potentials for 3D editing tasks. However, how to achieve consistent edits…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Ruihuang Li , Liyi Chen , Zhengqiang Zhang , Varun Jampani , Vishal M. Patel , Lei Zhang

Language-driven 3D Gaussian Splatting (3DGS) editing provides a more convenient approach for modifying complex scenes in VR/AR. Standard pipelines typically adopt a two-stage strategy: first editing multiple 2D views, and then optimizing…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Yanhui Chen , Jiahong Li , Jingchao Wang , Junyi Lin , Zixin Zeng , Yang Shi

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

We propose ClipFace, a novel self-supervised approach for text-guided editing of textured 3D morphable model of faces. Specifically, we employ user-friendly language prompts to enable control of the expressions as well as appearance of 3D…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Shivangi Aneja , Justus Thies , Angela Dai , Matthias Nießner

We present Image Sculpting, a new framework for editing 2D images by incorporating tools from 3D geometry and graphics. This approach differs markedly from existing methods, which are confined to 2D spaces and typically rely on textual…

图形学 · 计算机科学 2024-01-04 Jiraphon Yenphraphai , Xichen Pan , Sainan Liu , Daniele Panozzo , Saining Xie

Visual-prompt-guided edit transfer aims to learn image transformations directly from example pairs, offering more precise and controllable editing than purely text-driven approaches. However, existing diffusion transformer-based methods…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Lan Chen , Qi Mao , Yiren Song , Yuchao Gu , Siwei Ma

Despite significant strides in the field of 3D scene editing, current methods encounter substantial challenge, particularly in preserving 3D consistency in multi-view editing process. To tackle this challenge, we propose a progressive 3D…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Chaofan Luo , Donglin Di , Xun Yang , Yongjia Ma , Zhou Xue , Chen Wei , Yebin Liu

3D editing has shown remarkable capability in editing scenes based on various instructions. However, existing methods struggle with achieving intuitive, localized editing, such as selectively making flowers blossom. Drag-style editing has…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Chenghao Gu , Zhenzhe Li , Zhengqi Zhang , Yunpeng Bai , Shuzhao Xie , Zhi Wang

Generating 3D models has traditionally been a complex task requiring specialized expertise. While recent advances in generative AI have sought to automate this process, existing methods produce non-editable representation, such as meshes or…

图形学 · 计算机科学 2026-01-21 Fadlullah Raji , Stefano Petrangeli , Matheus Gadelha , Yu Shen , Uttaran Bhattacharya , Gang Wu