English
Related papers

Related papers: Learning to Localize in New Environments from Synt…

200 papers

The ability to plan for multi-step manipulation tasks in unseen situations is crucial for future home robots. But collecting sufficient experience data for end-to-end learning is often infeasible in the real world, as deploying robots in…

Robotics · Computer Science 2022-05-18 Chen Wang , Danfei Xu , Li Fei-Fei

In this work we present a novel approach to joint semantic localisation and scene understanding. Our work is motivated by the need for localisation algorithms which not only predict 6-DoF camera pose but also simultaneously recognise…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Ignas Budvytis , Marvin Teichmann , Tomas Vojir , Roberto Cipolla

Intelligent robots require object-level scene understanding to reason about possible tasks and interactions with the environment. Moreover, many perception tasks such as scene reconstruction, image retrieval, or place recognition can…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Cathrin Elich , Iro Armeni , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

Learning-based visual relocalizers exhibit leading pose accuracy, but require hours or days of training. Since training needs to happen on each new scene again, long training times make learning-based relocalization impractical for most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Eric Brachmann , Tommaso Cavallari , Victor Adrian Prisacariu

Image-based localization, or camera relocalization, is a fundamental problem in computer vision and robotics, and it refers to estimating camera pose from an image. Recent state-of-the-art approaches use learning based methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Xiaotian Li , Juha Ylioinas , Juho Kannala

Cross-view self-localization is a challenging scenario of visual place recognition in which database images are provided from sparse viewpoints. Recently, an approach for synthesizing database images from unseen viewpoints using NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Ryogo Yamamoto , Kanji Tanaka

Traditional place categorization approaches in robot vision assume that training and test images have similar visual appearance. Therefore, any seasonal, illumination and environmental changes typically lead to severe degradation in…

Robotics · Computer Science 2018-05-31 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Visual place recognition is a critical task in computer vision, especially for localization and navigation systems. Existing methods often rely on contrastive learning: image descriptors are trained to have small distance for similar images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 María Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov

Developing deep neural networks to generate 3D scenes is a fundamental problem in neural synthesis with immediate applications in architectural CAD, computer graphics, as well as in generating virtual robot training environments. This task…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Haitao Yang , Zaiwei Zhang , Siming Yan , Haibin Huang , Chongyang Ma , Yi Zheng , Chandrajit Bajaj , Qixing Huang

Visual localization is critical to many applications in computer vision and robotics. To address single-image RGB localization, state-of-the-art feature-based methods match local descriptors between a query image and a pre-built 3D model.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Shuzhe Wang , Zakaria Laskar , Iaroslav Melekhov , Xiaotian Li , Yi Zhao , Giorgos Tolias , Juho Kannala

We address the visual relocalization problem of predicting the location and camera orientation or pose (6DOF) of the given input scene. We propose a method based on how humans determine their location using the visible landmarks. We define…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Soham Saha , Girish Varma , C. V. Jawahar

We propose a vision-based method that localizes a ground vehicle using publicly available satellite imagery as the only prior knowledge of the environment. Our approach takes as input a sequence of ground-level images acquired by the…

Robotics · Computer Science 2022-03-08 Dong-Ki Kim , Matthew R. Walter

Camera localization aims to estimate 6 DoF camera poses from RGB images. Traditional methods detect and match interest points between a query image and a pre-built 3D model. Recent learning-based approaches encode scene structures into a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shitao Tang , Chengzhou Tang , Rui Huang , Siyu Zhu , Ping Tan

Outdoor visual localization is a crucial component to many computer vision systems. We propose an approach to localization from images that is designed to explicitly handle the strong variations in appearance happening between daytime and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Hugo Germain , Guillaume Bourmaud , Vincent Lepetit

Learning on synthetic data and transferring the resulting properties to their real counterparts is an important challenge for reducing costs and increasing safety in machine learning. In this work, we focus on autoencoder architectures and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

Visual localization is critical to many applications in computer vision and robotics. To address single-image RGB localization, state-of-the-art feature-based methods match local descriptors between a query image and a pre-built 3D model.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Xiaotian Li , Shuzhe Wang , Yi Zhao , Jakob Verbeek , Juho Kannala

Can we relocalize in a scene represented by a single reference image? Standard visual relocalization requires hundreds of images and scale calibration to build a scene-specific 3D map. In contrast, we propose Map-free Relocalization, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Eduardo Arnold , Jamie Wynn , Sara Vicente , Guillermo Garcia-Hernando , Áron Monszpart , Victor Adrian Prisacariu , Daniyar Turmukhambetov , Eric Brachmann

We address the problem of camera pose estimation in visual localization. Current regression-based methods for pose estimation are trained and evaluated scene-wise. They depend on the coordinate frame of the training dataset and show a low…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Boris Chidlovskii , Assem Sadek

In this paper, we present a novel and efficient architecture for addressing computer vision problems that use `Analysis by Synthesis'. Analysis by synthesis involves the minimization of the reconstruction error which is typically a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-21 Julien Valentin , Angela Dai , Matthias Nießner , Pushmeet Kohli , Philip Torr , Shahram Izadi , Cem Keskin

This paper provides an insight into the possibility of scene recognition from a video sequence with a small set of repeated shooting locations (such as in television series) using artificial neural networks. The basic idea of the presented…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Lukáš Korel , Petr Pulc , Jiří Tumpach , Martin Holeňa