English
Related papers

Related papers: DualRefine: Self-Supervised Depth and Pose Estimat…

200 papers

Finding local features that are repeatable across multiple views is a cornerstone of sparse 3D reconstruction. The classical image matching paradigm detects keypoints per-image once and for all, which can yield poorly-localized features and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Philipp Lindenberger , Paul-Edouard Sarlin , Viktor Larsson , Marc Pollefeys

Multi-frame human pose estimation in complicated situations is challenging. Although state-of-the-art human joints detectors have demonstrated remarkable results for static images, their performances come short when we apply these models to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Zhenguang Liu , Haoming Chen , Runyang Feng , Shuang Wu , Shouling Ji , Bailin Yang , Xun Wang

Accurate extrinsic calibration between LiDAR and camera sensors is important for reliable perception in autonomous systems. In this paper, we present a novel multi-objective optimization framework that jointly minimizes the geometric…

Robotics · Computer Science 2025-06-26 Venkat Karramreddy , Rangarajan Ramanujam

In autonomous driving, monocular sequences contain lots of information. Monocular depth estimation, camera ego-motion estimation and optical flow estimation in consecutive frames are high-profile concerns recently. By analyzing tasks above,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Guangming Wang , Chi Zhang , Hesheng Wang , Jingchuan Wang , Yong Wang , Xinlei Wang

The conventional methods for estimating camera poses and scene structures from severely blurry or low resolution images often result in failure. The off-the-shelf deblurring or super-resolution methods may show visually pleasing results.…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Haesol Park , Kyoung Mu Lee

We present a system for keyframe-based dense camera tracking and depth map estimation that is entirely learned. For tracking, we estimate small pose increments between the current camera image and a synthetic viewpoint. This significantly…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Huizhong Zhou , Benjamin Ummenhofer , Thomas Brox

Unsupervised depth learning takes the appearance difference between a target view and a view synthesized from its adjacent frame as supervisory signal. Since the supervisory signal only comes from images themselves, the resolution of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Junsheng Zhou , Yuwang Wang , Kaihuai Qin , Wenjun Zeng

Person re identification is a challenging retrieval task that requires matching a person's acquired image across non overlapping camera views. In this paper we propose an effective approach that incorporates both the fine and coarse pose…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 M. Saquib Sarfraz , Arne Schumann , Andreas Eberle , Rainer Stiefelhagen

The typical bottom-up human pose estimation framework includes two stages, keypoint detection and grouping. Most existing works focus on developing grouping algorithms, e.g., associative embedding, and pixel-wise keypoint regression that we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Ke Sun , Zigang Geng , Depu Meng , Bin Xiao , Dong Liu , Zhaoxiang Zhang , Jingdong Wang

Self-supervised methods have showed promising results on depth estimation task. However, previous methods estimate the target depth map and camera ego-motion simultaneously, underusing multi-frame correlation information and ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Songchun Zhang , Chunhui Zhao

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much less on the ground-truth data. In this paper, we address the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tianwei Shen , Lei Zhou , Zixin Luo , Yao Yao , Shiwei Li , Jiahui Zhang , Tian Fang , Long Quan

We address the task of 6D multi-object pose: given a set of known 3D objects and an RGB or RGB-D input image, we detect and estimate the 6D pose of each object. We propose a new approach to 6D object pose estimation which consists of an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Lahav Lipson , Zachary Teed , Ankit Goyal , Jia Deng

Odometry is a critical task for autonomous systems for self-localization and navigation. We propose a novel LiDAR-Visual odometry framework that integrates LiDAR point clouds and images for accurate and robust pose estimation. Our method…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 JunYing Huang , Ao Xu , DongSun Yong , KeRen Li , YuanFeng Wang , Qi Qin

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

In this paper we consider the task of image-guided depth completion where our system must infer the depth at every pixel of an input image based on the image content and a sparse set of depth measurements. We propose a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Chao Qu , Ty Nguyen , Camillo J. Taylor

Many real-world applications require the estimation of human body joints for higher-level tasks as, for example, human behaviour understanding. In recent years, depth sensors have become a popular approach to obtain three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Manuel J. Marin-Jimenez , Francisco J. Romero-Ramirez , Rafael Muñoz-Salinas , Rafael Medina-Carnicer

This paper introduces a novel multi-view 6 DoF object pose refinement approach focusing on improving methods trained on synthetic data. It is based on the DPOD detector, which produces dense 2D-3D correspondences between the model vertices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ivan Shugurov , Ivan Pavlov , Sergey Zakharov , Slobodan Ilic

We present three multi-scale similarity learning architectures, or DeepSim networks. These models learn pixel-level matching with a contrastive loss and are agnostic to the geometry of the considered scene. We establish a middle ground…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Mohamed Ali Chebbi , Ewelina Rupnik , Marc Pierrot-Deseilligny , Paul Lopes

Fast and accurate upper-body and head pose estimation is a key task for automatic monitoring of driver attention, a challenging context characterized by severe illumination changes, occlusions and extreme poses. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Guido Borghi , Marco Venturelli , Roberto Vezzani , Rita Cucchiara