English
Related papers

Related papers: IFFNeRF: Initialisation Free and Fast 6DoF pose es…

200 papers

We introduce Diff-DOPE, a 6-DoF pose refiner that takes as input an image, a 3D textured model of an object, and an initial pose of the object. The method uses differentiable rendering to update the object pose to minimize the visual error…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jonathan Tremblay , Bowen Wen , Valts Blukis , Balakumar Sundaralingam , Stephen Tyree , Stan Birchfield

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Axel Levy , Mark Matthews , Matan Sela , Gordon Wetzstein , Dmitry Lagun

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

Accurate camera pose estimation is a fundamental requirement for numerous applications, such as autonomous driving, mobile robotics, and augmented reality. In this work, we address the problem of estimating the global 6 DoF camera pose from…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mohammad Altillawi

Neural Radiance Field (NeRF) and its variants have exhibited great success on representing 3D scenes and synthesizing photo-realistic novel views. However, they are generally based on the pinhole camera model and assume all-in-focus inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zijin Wu , Xingyi Li , Juewen Peng , Hao Lu , Zhiguo Cao , Weicai Zhong

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Six degree of freedom (6DoF) pose estimation for novel objects is a critical task in computer vision, yet it faces significant challenges in high-speed and low-light scenarios where standard RGB cameras suffer from motion blur. While event…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Huiming Yang , Linglin Liao , Fei Ding , Sibo Wang , Zijian Zeng

6D pose estimation of textureless objects is a valuable but challenging task for many robotic applications. In this work, we propose a framework to address this challenge using only RGB images acquired from multiple viewpoints. The core…

Robotics · Computer Science 2023-02-23 Jun Yang , Wenjie Xue , Sahar Ghavidel , Steven L. Waslander

Most successful approaches to estimate the 6D pose of an object typically train a neural network by supervising the learning with annotated poses in real world images. These annotations are generally expensive to obtain and a common…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Juil Sock , Guillermo Garcia-Hernando , Anil Armagan , Tae-Kyun Kim

Six degrees-of-freedom (6-DoF) video provides telepresence by enabling users to move around in the captured scene with a wide field of regard. Compared to methods requiring sophisticated camera setups, the image-based rendering method based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Rongsen Chen , Fang-Lue Zhang , Simon Finnie , Andrew Chalmers , Teahyun Rhee

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zeyang Zhang , Hui Li , Tianyang Xu , Xiaojun Wu , Josef Kittler

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

In recent years, the development of Neural Radiance Fields has enabled a previously unseen level of photo-realistic 3D reconstruction of scenes and objects from multi-view camera data. However, previous methods use an oversimplified pinhole…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yi Hua , Christoph Lassner , Carsten Stoll , Iain Matthews

Compared to frame-based methods, computational neuromorphic imaging using event cameras offers significant advantages, such as minimal motion blur, enhanced temporal resolution, and high dynamic range. The multi-view consistency of Neural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chaoran Feng , Wangbo Yu , Xinhua Cheng , Zhenyu Tang , Junwu Zhang , Li Yuan , Yonghong Tian

Compared to 2D object bounding-box labeling, it is very difficult for humans to annotate 3D object poses, especially when depth images of scenes are unavailable. This paper investigates whether we can estimate the object poses effectively…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zongxin Yang , Xin Yu , Yi Yang

Neural Radiance Fields (NeRF) have recently gained a surge of interest within the computer vision community for its power to synthesize photorealistic novel views of real-world scenes. One limitation of NeRF, however, is its requirement of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Chen-Hsuan Lin , Wei-Chiu Ma , Antonio Torralba , Simon Lucey

We introduce a novel neural volumetric pose feature, termed PoseMap, designed to enhance camera localization by encapsulating the information between images and the associated camera poses. Our framework leverages an Absolute Pose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jingyu Lin , Jiaqi Gu , Bojian Wu , Lubin Fan , Renjie Chen , Ligang Liu , Jieping Ye

We propose a method which, given a sequence of stereo foggy images, estimates the parameters of a fog model and updates them dynamically. In contrast with previous approaches, which estimate the parameters sequentially and thus are prone to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yining Ding , João F. C. Mota , Andrew M. Wallace , Sen Wang

State-of-the-art research of traditional computer vision is increasingly leveraged in the surgical domain. A particular focus in computer-assisted surgery is to replace marker-based tracking systems for instrument localization with pure…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Jonas Hein , Nicola Cavalcanti , Daniel Suter , Lukas Zingg , Fabio Carrillo , Lilian Calvet , Mazda Farshad , Marc Pollefeys , Nassir Navab , Philipp Fürnstahl