中文
相关论文

相关论文: FreeDriveRF: Monocular RGB Dynamic NeRF without Po…

200 篇论文

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

Neural Radiance Fields (NeRFs) have demonstrated prominent performance in novel view synthesis. However, their input heavily relies on image acquisition under normal light conditions, making it challenging to learn accurate scene…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Min Wang , Xin Huang , Guoqing Zhou , Qifeng Guo , Qing Wang

This paper proposes a new approach for monocular dense 3D reconstruction of a complex dynamic scene from two perspective frames. By applying superpixel over-segmentation to the image, we model a generically dynamic (hence non-rigid) scene…

计算机视觉与模式识别 · 计算机科学 2017-12-21 Suryansh Kumar , Yuchao Dai , Hongdong Li

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

We present a method for reconstructing a clear Neural Radiance Field (NeRF) even with fast camera motions. To address blur artifacts, we leverage both (blurry) RGB images and event camera data captured in a binocular configuration.…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Wei Zhi Tang , Daniel Rebain , Kostantinos G. Derpanis , Kwang Moo Yi

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Li Ma , Xiaoyu Li , Jing Liao , Qi Zhang , Xuan Wang , Jue Wang , Pedro V. Sander

We introduce GNeRF, a framework to marry Generative Adversarial Networks (GAN) with Neural Radiance Field (NeRF) reconstruction for the complex scenarios with unknown and even randomly initialized camera poses. Recent NeRF-based advances…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Quan Meng , Anpei Chen , Haimin Luo , Minye Wu , Hao Su , Lan Xu , Xuming He , Jingyi Yu

We present a novel non-rigid reconstruction method using a moving RGB-D camera. Current approaches use only non-rigid part of the scene and completely ignore the rigid background. Non-rigid parts often lack sufficient geometric and…

计算机视觉与模式识别 · 计算机科学 2018-05-31 Shafeeq Elanattil , Peyman Moghadam , Sridha Sridharan , Clinton Fookes , Mark Cox

In this paper, we study the problem of 3D scene geometry decomposition and manipulation from 2D views. By leveraging the recent implicit neural representation techniques, particularly the appealing neural radiance fields, we introduce an…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Bing Wang , Lu Chen , Bo Yang

Humans effortlessly retrieve objects in cluttered, partially observable environments by combining visual reasoning, active viewpoint adjustment, and physical interaction-with only a single pair of eyes. In contrast, most existing robotic…

机器人学 · 计算机科学 2025-08-19 Hecheng Wang , Jiankun Ren , Jia Yu , Lizhe Qi , Yunquan Sun

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

We present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations. The segmented 3D objects are represented using separate Neural Radiance…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Shengnan Liang , Yichen Liu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

We present STaR, a novel method that performs Self-supervised Tracking and Reconstruction of dynamic scenes with rigid motion from multi-view RGB videos without any manual annotation. Recent work has shown that neural networks are…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Wentao Yuan , Zhaoyang Lv , Tanner Schmidt , Steven Lovegrove

Neural Radiance Field (NeRF) has enabled novel view synthesis with high fidelity given images and camera poses. Subsequent works even succeeded in eliminating the necessity of pose priors by jointly optimizing NeRF and camera pose. However,…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Injae Kim , Minhyuk Choi , Hyunwoo J. Kim

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Takayuki Hara , Tatsuya Harada

Monocular 3D reconstruction for categorical objects heavily relies on accurately perceiving each object's pose. While gradient-based optimization in a NeRF framework updates the initial pose, this paper highlights that scale-depth ambiguity…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Yuliang Guo , Abhinav Kumar , Cheng Zhao , Ruoyu Wang , Xinyu Huang , Liu Ren

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu