English
Related papers

Related papers: Acoustic Neural 3D Reconstruction Under Pose Drift

200 papers

We introduce a method that can learn to predict scene-level implicit functions for 3D reconstruction from posed RGBD data. At test time, our system maps a previously unseen RGB image to a 3D reconstruction of a scene via implicit functions.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Nilesh Kulkarni , Linyi Jin , Justin Johnson , David F. Fouhey

Neural implicit functions have emerged as a powerful representation for surfaces in 3D. Such a function can encode a high quality surface with intricate details into the parameters of a deep neural network. However, optimizing for the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Wang Yifan , Shihao Wu , Cengiz Oztireli , Olga Sorkine-Hornung

Accurately reconstructing dense and semantically annotated 3D meshes from monocular images remains a challenging task due to the lack of geometry guidance and imperfect view-dependent 2D priors. Though we have witnessed recent advancements…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhenhua Du , Binbin Xu , Haoyu Zhang , Kai Huo , Shuaifeng Zhi

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin

We consider the problem of category-level 6D pose estimation from a single RGB image. Our approach represents an object category as a cuboid mesh and learns a generative model of the neural feature activations at each mesh vertex to perform…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Wufei Ma , Angtian Wang , Alan Yuille , Adam Kortylewski

In this paper, we introduce neural texture learning for 6D object pose estimation from synthetic data and a few unlabelled real images. Our major contribution is a novel learning scheme which removes the drawbacks of previous works, namely…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Hanzhi Chen , Fabian Manhardt , Nassir Navab , Benjamin Busam

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

Neural surface reconstruction is sensitive to the camera pose noise, even if state-of-the-art pose estimators like COLMAP or ARKit are used. More importantly, existing Pose-NeRF joint optimisation methods have struggled to improve pose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Jia-Wang Bian , Wenjing Bian , Victor Adrian Prisacariu , Philip Torr

Estimating relative camera poses between images has been a central problem in computer vision. Methods that find correspondences and solve for the fundamental matrix offer high precision in most cases. Conversely, methods predicting pose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Chris Rockwell , Nilesh Kulkarni , Linyi Jin , Jeong Joon Park , Justin Johnson , David F. Fouhey

Robotic applications require a comprehensive understanding of the scene. In recent years, neural fields-based approaches that parameterize the entire environment have become popular. These approaches are promising due to their continuous…

Robotics · Computer Science 2024-12-31 Evgenii Kruzhkov , Alena Savinykh , Sven Behnke

The research on neural radiance fields for new view synthesis has experienced explosive growth with the development of new models and extensions. The NERF algorithm, suitable for underwater scenes or scattering media, is also evolving.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Zhuoyifan Zhang , Lu Zhang , Liang Wang , Haoming Wu

Reconstructing an accurate 3D object model from a few image observations remains a challenging problem in computer vision. State-of-the-art approaches typically assume accurate camera poses as input, which could be difficult to obtain in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zhenpei Yang , Zhile Ren , Miguel Angel Bautista , Zaiwei Zhang , Qi Shan , Qixing Huang

Representing 3D objects and scenes with neural radiance fields has become very popular over the last years. Recently, surface-based representations have been proposed, that allow to reconstruct 3D objects from simple photographs. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Sarthak Gupta , Patrik Huber

This paper presents a new system to obtain dense object reconstructions along with 6-DoF poses from a single image. Geared towards high fidelity reconstruction, several recent approaches leverage implicit surface representations and deep…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Aniket Pokale , Aditya Aggarwal , K. Madhava Krishna

How can we effectively utilise the 2D monocular image information for recovering the 6D pose (6-DoF) of the visual objects? Deep learning has shown to be effective for robust and real-time monocular pose estimation. Oftentimes, the network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Di Wu , Yihao Chen , Xianbiao Qi , Yongjian Yu , Weixuan Chen , Rong Xiao

3D scene reconstruction is a long-standing vision task. Existing approaches can be categorized into geometry-based and learning-based methods. The former leverages multi-view geometry but can face catastrophic failures due to the reliance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Zhao

6-DoF object pose estimation from a monocular image is challenging, and a post-refinement procedure is generally needed for high-precision estimation. In this paper, we propose a framework based on a recurrent neural network (RNN) for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Yan Xu , Kwan-Yee Lin , Guofeng Zhang , Xiaogang Wang , Hongsheng Li

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have…

Robotics · Computer Science 2023-03-01 Dongyu Yan , Xiaoyang Lyu , Jieqi Shi , Yi Lin

Current 6D object pose methods consist of deep CNN models fully optimized for a single object but with its architecture standardized among objects with different shapes. In contrast to previous works, we explicitly exploit each object's…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Pedro Castro , Anil Armagan , Tae-Kyun Kim

We propose SirenPose, a novel loss function that combines the periodic activation properties of sinusoidal representation networks with geometric priors derived from keypoint structures to improve the accuracy of dynamic 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Tian Guo , Hui Yuan , Philip Xu , David Elizondo