English
Related papers

Related papers: NeRFDeformer: NeRF Transformation from a Single Vi…

200 papers

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

No significant work has been done to directly merge two partially overlapping scenes using NeRF representations. Given pre-trained NeRF models of a 3D scene with partial overlapping, this paper aligns them with a rigid transform, by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Han Jiang , Ruoxuan Li , Haosen Sun , Yu-Wing Tai , Chi-Keung Tang

The proposal introduces an innovative drone swarm perception system that aims to solve problems related to computational limitations and low-bandwidth communication, and real-time scene reconstruction. The framework enables efficient…

Artificial Intelligence · Computer Science 2025-08-05 Massoud Pourmandi

3D facial avatar reconstruction has been a significant research topic in computer graphics and computer vision, where photo-realistic rendering and flexible controls over poses and expressions are necessary for many related applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Wangbo Yu , Yanbo Fan , Yong Zhang , Xuan Wang , Fei Yin , Yunpeng Bai , Yan-Pei Cao , Ying Shan , Yang Wu , Zhongqian Sun , Baoyuan Wu

In this paper, we introduce an innovative method of safeguarding user privacy against the generative capabilities of Neural Radiance Fields (NeRF) models. Our novel poisoning attack method induces changes to observed views that are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yihan Wu , Brandon Y. Feng , Heng Huang

In this paper, we address the problem of simultaneous relighting and novel view synthesis of a complex scene from multi-view images with a limited number of light sources. We propose an analysis-synthesis approach called Relit-NeuLF.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zhong Li , Liangchen Song , Zhang Chen , Xiangyu Du , Lele Chen , Junsong Yuan , Yi Xu

Novel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts. We introduce Deceptive-NeRF/3DGS to enhance sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinhang Liu , Jiaben Chen , Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

Neural Radiance Fields (NeRFs) have emerged as a standard framework for representing 3D scenes and objects, introducing a novel data type for information exchange and storage. Concurrently, significant progress has been made in multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Francesco Ballerini , Pierluigi Zama Ramirez , Roberto Mirabella , Samuele Salti , Luigi Di Stefano

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Li Ma , Xiaoyu Li , Jing Liao , Qi Zhang , Xuan Wang , Jue Wang , Pedro V. Sander

We present NeSF, a method for producing 3D semantic fields from posed RGB images alone. In place of classical 3D representations, our method builds on recent work in implicit neural scene representations wherein 3D structure is captured by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Suhani Vora , Noha Radwan , Klaus Greff , Henning Meyer , Kyle Genova , Mehdi S. M. Sajjadi , Etienne Pot , Andrea Tagliasacchi , Daniel Duckworth

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

Recent advances in 3D scene representation and novel view synthesis have witnessed the rise of Neural Radiance Fields (NeRFs). Nevertheless, it is not trivial to exploit NeRF for the photorealistic 3D scene stylization task, which aims to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zicheng Zhang , Yinglu Liu , Congying Han , Yingwei Pan , Tiande Guo , Ting Yao

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov

This paper proposes a Diffusion Model-Optimized Neural Radiance Field (DT-NeRF) method, aimed at enhancing detail recovery and multi-view consistency in 3D scene reconstruction. By combining diffusion models with Transformers, DT-NeRF…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Bo Liu , Runlong Li , Li Zhou , Yan Zhou

Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging. The generic reconstruction methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Sandika Biswas , Qianyi Wu , Biplab Banerjee , Hamid Rezatofighi

We propose GazeNeRF, a 3D-aware method for the task of gaze redirection. Existing gaze redirection methods operate on 2D images and struggle to generate 3D consistent results. Instead, we build on the intuition that the face region and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Alessandro Ruzzi , Xiangwei Shi , Xi Wang , Gengyan Li , Shalini De Mello , Hyung Jin Chang , Xucong Zhang , Otmar Hilliges