English
Related papers

Related papers: EP2P-Loc: End-to-End 3D Point to 2D Pixel Localiza…

200 papers

We propose a novel learning-based formulation for visual localization of vehicles that can operate in real-time in city-scale environments. Visual localization algorithms determine the position and orientation from which an image has been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Arthur Moreau , Thomas Gilles , Nathan Piasco , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Visual localization is the problem of estimating the camera pose of a given query image within a known scene. Most state-of-the-art localization approaches follow the structure-based paradigm and use 2D-3D matches between pixels in a query…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Vojtech Panek , Torsten Sattler , Zuzana Kukelova

We present a method for localizing a single camera with respect to a point cloud map in indoor and outdoor scenes. The problem is challenging because correspondences of local invariant features are inconsistent across the domains between…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Peng Yin , Lingyun Xu , Ji Zhang , Howie Choset , Sebastian Scherer

Image-to-point cloud registration aims to determine the relative camera pose between an RGB image and a reference point cloud, serving as a general solution for locating 3D objects from 2D observations. Matching individual points with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Gongxin Yao , Yixin Xuan , Yiwei Chen , Yu Pan

3D Point cloud registration is still a very challenging topic due to the difficulty in finding the rigid transformation between two point clouds with partial correspondences, and it's even harder in the absence of any initial estimation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Zhijian Qiao , Huanshu Wei , Zhe Liu , Chuanzhe Suo , Hesheng Wang

This paper proposes a novel concept to directly match feature descriptors extracted from 2D images with feature descriptors extracted from 3D point clouds. We use this concept to directly localize images in a 3D point cloud. We generate a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Uzair Nadeem , Mohammed Bennamoun , Roberto Togneri , Ferdous Sohel

Point cloud based retrieval for place recognition is still a challenging problem due to drastic appearance and illumination changes of scenes in changing environments. Existing deep learning based global descriptors for the retrieval task…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Le Hui , Mingmei Cheng , Jin Xie , Jian Yang

Point cloud completion aims to recover partial geometric and topological shapes caused by equipment defects or limited viewpoints. Current methods either solely rely on the 3D coordinates of the point cloud to complete it or incorporate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Feng Zhou , Qi Zhang , Ju Dai , Lei Li , Qing Fan , Junliang Xing

Motivated by the intuition that the critical step of localizing a 2D image in the corresponding 3D point cloud is establishing 2D-3D correspondence between them, we propose the first feature-based dense correspondence framework for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Siyu Ren , Yiming Zeng , Junhui Hou , Xiaodong Chen

Camera pose estimation in known scenes is a 3D geometry task recently tackled by multiple learning algorithms. Many regress precise geometric quantities, like poses or 3D points, from an input image. This either fails to generalize to new…

Visual localization, i.e., the problem of camera pose estimation, is a central component of applications such as autonomous robots and augmented reality systems. A dominant approach in the literature, shown to scale to large scenes and to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Vojtech Panek , Zuzana Kukelova , Torsten Sattler

Blind Perspective-n-Point (PnP) is the problem of estimating the position and orientation of a camera relative to a scene, given 2D image points and 3D scene points, without prior knowledge of the 2D-3D correspondences. Solving for pose and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Dylan Campbell , Liu Liu , Stephen Gould

We tackle the problem of getting a full 6-DOF pose estimation of a query image inside a given point cloud. This technical report re-evaluates the algorithms proposed by Y. Li et al. "Worldwide Pose Estimation using 3D Point Cloud". Our code…

Computer Vision and Pattern Recognition · Computer Science 2015-11-05 Fabian Tschopp , Marco Zorzi

We propose a new method for estimating the relative pose between two images, where we jointly learn keypoint detection, description extraction, matching and robust pose estimation. While our architecture follows the traditional pipeline for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Antoine Fond , Luca Del Pero , Nikola Sivacki , Marco Paladini

Event cameras have emerged as a promising vision sensor in recent years due to their unparalleled temporal resolution and dynamic range. While registration of 2D RGB images to 3D point clouds is a long-standing problem in computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiuhong Lin , Changjie Qiu , Zhipeng Cai , Siqi Shen , Yu Zang , Weiquan Liu , Xuesheng Bian , Matthias Müller , Cheng Wang

Accurate registration of 2D imagery with point clouds is a key technology for image-LiDAR point cloud fusion, camera to laser scanner calibration and camera localization. Despite continuous improvements, automatic registration of 2D and 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Huai Yu , Weikun Zhen , Wen Yang , Sebastian Scherer

Large-scale pre-trained models have shown promising open-world performance for both vision and language tasks. However, their transferred capacity on 3D point clouds is still limited and only constrained to the classification task. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Xiangyang Zhu , Renrui Zhang , Bowei He , Ziyu Guo , Ziyao Zeng , Zipeng Qin , Shanghang Zhang , Peng Gao

We tackle the problem of localizing 3D point cloud submaps using complex and diverse natural language descriptions, and present Text2Loc++, a novel neural network designed for effective cross-modal alignment between language and point…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yan Xia , Letian Shi , Yilin Di , Joao F. Henriques , Daniel Cremers

Localizing predefined 3D keypoints in a 2D image is an effective way to establish 3D-2D correspondences for instance-level 6DoF object pose estimation. However, unreliable localization results of invisible keypoints degrade the quality of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Ruyi Lian , Yuewei Lin , Longin Jan Latecki , Haibin Ling

Visual localization refers to the process of determining camera poses and orientation within a known scene representation. This task is often complicated by factors such as changes in illumination and variations in viewing angles. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhongyan Niu , Zhen Tan , Jinpu Zhang , Xueliang Yang , Dewen Hu