中文
相关论文

相关论文: MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes…

200 篇论文

Recent advancements in 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have achieved impressive results in real-time 3D reconstruction and novel view synthesis. However, these methods struggle in large-scale, unconstrained…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Niluthpol Chowdhury Mithun , Tuan Pham , Qiao Wang , Ben Southall , Kshitij Minhas , Bogdan Matei , Stephan Mandt , Supun Samarasekera , Rakesh Kumar

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Liangchen Song , Liangliang Cao , Jiatao Gu , Yifan Jiang , Junsong Yuan , Hao Tang

The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios. Existing techniques often require significant…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Sen Wang , Qing Cheng , Stefano Gasperini , Wei Zhang , Shun-Cheng Wu , Niclas Zeller , Daniel Cremers , Nassir Navab

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

We propose NeRFiller, an approach that completes missing portions of a 3D capture via generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a captured 3D scene or object are missing due to mesh…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Ethan Weber , Aleksander Hołyński , Varun Jampani , Saurabh Saxena , Noah Snavely , Abhishek Kar , Angjoo Kanazawa

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

We propose InNeRF360, an automatic system that accurately removes text-specified objects from 360-degree Neural Radiance Fields (NeRF). The challenge is to effectively remove objects while inpainting perceptually consistent content for the…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Dongqing Wang , Tong Zhang , Alaa Abboud , Sabine Süsstrunk

3D Gaussians have recently emerged as an efficient representation for novel view synthesis. This work studies its editability with a particular focus on the inpainting task, which aims to supplement an incomplete set of 3D Gaussians with…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Zhiheng Liu , Hao Ouyang , Qiuyu Wang , Ka Leong Cheng , Jie Xiao , Kai Zhu , Nan Xue , Yu Liu , Yujun Shen , Yang Cao

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

We present MVD-Fusion: a method for single-view 3D inference via generative modeling of multi-view-consistent RGB-D images. While recent methods pursuing 3D inference advocate learning novel-view generative models, these generations are not…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Hanzhe Hu , Zhizhuo Zhou , Varun Jampani , Shubham Tulsiani

We introduce ShowRoom3D, a three-stage approach for generating high-quality 3D room-scale scenes from texts. Previous methods using 2D diffusion priors to optimize neural radiance fields for generating room-scale scenes have shown…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Weijia Mao , Yan-Pei Cao , Jia-Wei Liu , Zhongcong Xu , Mike Zheng Shou

Generating high-quality textures for 3D assets is a challenging task. Existing multiview texture generation methods suffer from the multiview inconsistency and missing textures on unseen parts, while UV inpainting texture methods do not…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zheng Zhang , Qinchuan Zhang , Yuteng Ye , Zhi Chen , Penglei Ji , Mengfei Li , Wenxiao Zhang , Yuan Liu

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

We introduce a novel framework for solving inverse problems using NeRF-style generative models. We are interested in the problem of 3-D scene reconstruction given a single 2-D image and known camera parameters. We show that naively…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Giannis Daras , Wen-Sheng Chu , Abhishek Kumar , Dmitry Lagun , Alexandros G. Dimakis

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Neural radiance fields (NeRF) encode a scene into a neural representation that enables photo-realistic rendering of novel views. However, a successful reconstruction from RGB images requires a large number of input views taken under static…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Barbara Roessle , Jonathan T. Barron , Ben Mildenhall , Pratul P. Srinivasan , Matthias Nießner

Current 3D inpainting and object removal methods are largely limited to front-facing scenes, facing substantial challenges when applied to diverse, "unconstrained" scenes where the camera orientation and trajectory are unrestricted. To…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Zhihao Shi , Dong Huo , Yuhongze Zhou , Kejia Yin , Yan Min , Juwei Lu , Xinxin Zuo