English
Related papers

Related papers: Perturb-and-Revise: Flexible 3D Editing with Gener…

200 papers

Creating visually appealing composites requires optimizing both text and background for compatibility. Previous methods have focused on simple design strategies, such as changing text color or adding background shapes for contrast. These…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Marian Lupascu , Ionut Mironica , Mihai-Sorin Stupariu

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

Graphics · Computer Science 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

We propose a novel approach for 3D mesh reconstruction from multi-view images. Our method takes inspiration from large reconstruction models like LRM that use a transformer-based triplane generator and a Neural Radiance Field (NeRF) model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Peiye Zhuang , Songfang Han , Chaoyang Wang , Aliaksandr Siarohin , Jiaxu Zou , Michael Vasilkovsky , Vladislav Shakhrai , Sergey Korolev , Sergey Tulyakov , Hsin-Ying Lee

Learning radiance fields (NeRF) with powerful 2D diffusion models has garnered popularity for text-to-3D generation. Nevertheless, the implicit 3D representations of NeRF lack explicit modeling of meshes and textures over surfaces, and such…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Zuxuan Wu , Yu-Gang Jiang , Tao Mei

While convolutional neural networks (CNNs) have found wide adoption as state-of-the-art models for image-related tasks, their predictions are often highly sensitive to small input perturbations, which the human vision is robust against.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Stefan Sietzen , Mathias Lechner , Judy Borowski , Ramin Hasani , Manuela Waldner

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

Synthetic data has emerged as a practical alternative to authentic face datasets for training face recognition (FR) systems, especially as privacy and legal concerns increasingly restrict the use of real biometric data. Recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Fadi Boutros , Eduarda Caldeira , Tahar Chettaoui , Naser Damer

Advances in NERFs have allowed for 3D scene reconstructions and novel view synthesis. Yet, efficiently editing these representations while retaining photorealism is an emerging challenge. Recent methods face three primary limitations:…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Alessio Mazzucchelli , Adrian Garcia-Garcia , Elena Garces , Fernando Rivas-Manzaneque , Francesc Moreno-Noguer , Adrian Penate-Sanchez

With the popularity of implicit neural representations, or neural radiance fields (NeRF), there is a pressing need for editing methods to interact with the implicit 3D models for tasks like post-processing reconstructed scenes and 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Xiangyu Wang , Jingsen Zhu , Qi Ye , Yuchi Huo , Yunlong Ran , Zhihua Zhong , Jiming Chen

The increasing demand for high-quality 3D content creation has motivated the development of automated methods for creating 3D object models from a single image and/or from a text prompt. However, the reconstructed 3D objects using…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Hoigi Seo , Hayeon Kim , Gwanghyun Kim , Se Young Chun

Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jan-Niklas Dihlmann , Andreas Engelhardt , Hendrik Lensch

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Creating 3D textured meshes using generative artificial intelligence has garnered significant attention recently. While existing methods support text-based generative texture generation or editing on 3D meshes, they often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yudi Zhang , Qi Xu , Lei Zhang

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Jianhui Li , Shilong Liu , Zidong Liu , Yikai Wang , Kaiwen Zheng , Jinghui Xu , Jianmin Li , Jun Zhu

We tackle the task of text-to-3D creation with pre-trained latent-based NeRFs (NeRFs that generate 3D objects given input latent code). Recent works such as DreamFusion and Magic3D have shown great success in generating 3D content using…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yu-Jhe Li , Tao Xu , Ji Hou , Bichen Wu , Xiaoliang Dai , Albert Pumarola , Peizhao Zhang , Peter Vajda , Kris Kitani

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Object manipulation in images aims to not only edit the object's presentation but also gift objects with motion. Previous methods encountered challenges in concurrently handling static editing and dynamic generation, while also struggling…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Ruisi Zhao , Zechuan Zhang , Zongxin Yang , Yi Yang

Despite the great success in 2D editing using user-friendly tools, such as Photoshop, semantic strokes, or even text prompts, similar capabilities in 3D areas are still limited, either relying on 3D modeling skills or allowing editing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Chong Bao , Yinda Zhang , Bangbang Yang , Tianxing Fan , Zesong Yang , Hujun Bao , Guofeng Zhang , Zhaopeng Cui