English
Related papers

Related papers: Self-Aligning Depth-regularized Radiance Fields fo…

200 papers

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

Most existing trackers based on discriminative correlation filters (DCF) try to introduce predefined regularization term to improve the learning of target objects, e.g., by suppressing background learning or by restricting change rate of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Yiming Li , Changhong Fu , Fangqiang Ding , Ziyuan Huang , Geng Lu

There have been significant advancements in dynamic novel view synthesis in recent years. However, current deep learning models often require (1) prior models (e.g., SMPL human models), (2) heavy pre-processing, or (3) per-scene…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Shengze Wang , YoungJoong Kwon , Yuan Shen , Qian Zhang , Andrei State , Jia-Bin Huang , Henry Fuchs

Estimating 3D hand pose directly from RGB imagesis challenging but has gained steady progress recently bytraining deep models with annotated 3D poses. Howeverannotating 3D poses is difficult and as such only a few 3Dhand pose datasets are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Liangjian Chen , Shih-Yao Lin , Yusheng Xie , Yen-Yu Lin , Xiaohui Xie

2D face recognition encounters challenges in unconstrained environments due to varying illumination, occlusion, and pose. Recent studies focus on RGB-D face recognition to improve robustness by incorporating depth information. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zijian Chen , Mei Wang , Weihong Deng , Hongzhi Shi , Dongchao Wen , Yingjie Zhang , Xingchen Cui , Jian Zhao

We present a method to synthesize novel views from a single $360^\circ$ panorama image based on the neural radiance field (NeRF). Prior studies in a similar setting rely on the neighborhood interpolation capability of multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shreyas Kulkarni , Peng Yin , Sebastian Scherer

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

In this work we consider UAVs as cooperative agents supporting human users in their operations. In this context, the 3D localisation of the UAV assistant is an important task that can facilitate the exchange of spatial information between…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Georgios Albanis , Nikolaos Zioulis , Anastasios Dimou , Dimitrios Zarpalas , Petros Daras

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

Modeling Neural Radiance Fields for fast-moving deformable objects from visual data alone is a challenging problem. A major issue arises due to the high deformation and low acquisition rates. To address this problem, we propose to use event…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Qi Ma , Danda Pani Paudel , Ajad Chhatkuli , Luc Van Gool

Precise 6D pose estimation of rigid objects from RGB images is a critical but challenging task in robotics, augmented reality and human-computer interaction. To address this problem, we propose DeepRM, a novel recurrent network architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Alexander Avery , Andreas Savakis

The operating room (OR) is an environment of interest for the development of sensing systems, enabling the detection of people, objects, and their semantic relations. Due to frequent occlusions in the OR, these systems often rely on input…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Beerend G. A. Gerats , Jelmer M. Wolterink , Ivo A. M. J. Broeders

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Shilei Sun , Ming Liu , Zhongyi Fan , Yuxue Liu , Chengwei Lv , Liquan Dong , Lingqin Kong

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

General object grasping is an important yet unsolved problem in the field of robotics. Most of the current methods either generate grasp poses with few DoF that fail to cover most of the success grasps, or only take the unstable depth image…

Robotics · Computer Science 2021-03-04 Minghao Gou , Hao-Shu Fang , Zhanda Zhu , Sheng Xu , Chenxi Wang , Cewu Lu

An autonomous system's perception engine must provide an accurate understanding of the environment for it to make decisions. Deep learning based object detection networks experience degradation in the performance and robustness for small…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Hemant Kumawat , Saibal Mukhopadhyay

We consider the problem of human pose estimation. While much recent work has focused on the RGB domain, these techniques are inherently under-constrained since there can be many 3D configurations that explain the same 2D projection. To this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Ren Li , Changjiang Cai , Georgios Georgakis , Srikrishna Karanam , Terrence Chen , Ziyan Wu

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanxin Zhu , Tianyu He , Zhibo Chen