English
Related papers

Related papers: Camera Pose Auto-Encoders for Improving Pose Regre…

200 papers

This paper presents a framework that combines traditional keypoint-based camera pose optimization with an invertible neural rendering mechanism. Our proposed 3D scene representation, Nerfels, is locally dense yet globally sparse. As opposed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Gil Avraham , Julian Straub , Tianwei Shen , Tsun-Yi Yang , Hugo Germain , Chris Sweeney , Vasileios Balntas , David Novotny , Daniel DeTone , Richard Newcombe

Inference for Variational Autoencoders (VAEs) consists of learning two models: (1) a generative model, which transforms a simple distribution over a latent space into the distribution over observed data, and (2) an inference model, which…

Machine Learning · Statistics 2024-06-14 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

We address the task of estimating 6D camera poses from sparse-view image sets (2-8 images). This task is a vital pre-processing stage for nearly all contemporary (neural) reconstruction algorithms but remains challenging given sparse views,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Amy Lin , Jason Y. Zhang , Deva Ramanan , Shubham Tulsiani

This work proposes a novel pose estimation model for object categories that can be effectively transferred to previously unseen environments. The deep convolutional network models (CNN) for pose estimation are typically trained and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Negar Nejatishahidin , Pooya Fayyazsanavi , Jana Kosecka

Transformers have demonstrated outstanding performance in many applications of deep learning. When applied to time series data, transformers require effective position encoding to capture the ordering of the time series data. The efficacy…

Machine Learning · Computer Science 2024-02-21 Navid Mohammadi Foumani , Chang Wei Tan , Geoffrey I. Webb , Mahsa Salehi

The advances in attention-based encoder-decoder (AED) networks have brought great progress to end-to-end (E2E) automatic speech recognition (ASR). One way to further improve the performance of AED-based E2E ASR is to introduce an extra text…

Sound · Computer Science 2021-10-26 Wei Wang , Shuo Ren , Yao Qian , Shujie Liu , Yu Shi , Yanmin Qian , Michael Zeng

This paper presents a new algorithm to estimate absolute camera pose given an axis of the camera's rotation matrix. Current algorithms solve the problem via algebraic solutions on limited input domains. This paper shows that the problem can…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Akshay Chandrasekhar

The aim of this work is to use Variational Autoencoder (VAE) to learn a representation of an indoor environment that can be used for robot navigation. We use images extracted from a video, in which a camera takes a tour around a house, for…

Robotics · Computer Science 2018-09-18 Kaixin Hu , Peter O'Connor

Autonomous driving systems rely on accurate perception and localization of the ego car to ensure safety and reliability in challenging real-world driving scenarios. Public datasets play a vital role in benchmarking and guiding advancement…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Bingbing Liu , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Pedestrian Attribute Recognition (PAR) focuses on identifying various attributes in pedestrian images, with key applications in person retrieval, suspect re-identification, and soft biometrics. However, Deep Neural Networks (DNNs) for PAR…

Today's Mixed Reality head-mounted displays track the user's head pose in world space as well as the user's hands for interaction in both Augmented Reality and Virtual Reality scenarios. While this is adequate to support user input, it…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Jiaxi Jiang , Paul Streli , Huajian Qiu , Andreas Fender , Larissa Laich , Patrick Snape , Christian Holz

Recently, category-level 6D object pose estimation has achieved significant improvements with the development of reconstructing canonical 3D representations. However, the reconstruction quality of existing methods is still far from…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Zhaoxin Fan , Zhengbo Song , Jian Xu , Zhicheng Wang , Kejian Wu , Hongyan Liu , Jun He

Recent progress in learning-based image compression has demonstrated that end-to-end optimization can substantially outperform traditional codecs by jointly learning compact latent representations and probabilistic entropy models. However,…

Image and Video Processing · Electrical Eng. & Systems 2026-03-12 Sofia Iliopoulou , Dimitris Ampeliotis , Athanassios Skodras

Understanding terrain topology at long-range is crucial for the success of off-road robotic missions, especially when navigating at high-speeds. LiDAR sensors, which are currently heavily relied upon for geometric mapping, provide sparse…

Visual place recognition (VPR) in condition-varying environments is still an open problem. Popular solutions are CNN-based image descriptors, which have been shown to outperform traditional image descriptors based on hand-crafted visual…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Hanjing Ye , Weinan Chen , Jingwen Yu , Li He , Yisheng Guan , Hong Zhang

Tensor networks, a model that originated from quantum physics, has been gradually generalized as efficient models in machine learning in recent years. However, in order to achieve exact contraction, only tree-like tensor networks such as…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Song Cheng , Lei Wang , Pan Zhang

We investigate the performance of image-based pose regressor models in underwater environments for relocalization. Leveraging PoseNet and PoseLSTM, we regress a 6-degree-of-freedom pose from single RGB images with high accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Luyuan Peng , Hari Vishnu , Mandar Chitre , Yuen Min Too , Bharath Kalyan , Rajat Mishra

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have emerged as powerful tools for 3D reconstruction and SLAM tasks. However, their performance depends heavily on accurate camera pose priors. Existing approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Camera pose estimation is an important problem in computer vision. Common techniques either match the current image against keyframes with known poses, directly regress the pose, or establish correspondences between keypoints in the image…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Tommaso Cavallari , Stuart Golodetz , Nicholas A. Lord , Julien Valentin , Victor A. Prisacariu , Luigi Di Stefano , Philip H. S. Torr

We introduce Neural Parameter Regression (NPR), a novel framework specifically developed for learning solution operators in Partial Differential Equations (PDEs). Tailored for operator learning, this approach surpasses traditional DeepONets…

Machine Learning · Computer Science 2024-03-20 Konrad Mundinger , Max Zimmer , Sebastian Pokutta