English
Related papers

Related papers: Deep Non-rigid Structure-from-Motion Revisited: Ca…

200 papers

While dense non-rigid structure from motion (NRSfM) has been extensively studied from the perspective of the reconstructability problem over the recent years, almost no attempts have been undertaken to bring it into the practical realm. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Vladislav Golyanik , André Jonas , Didier Stricker , Christian Theobalt

We propose PR-RRN, a novel neural-network based method for Non-rigid Structure-from-Motion (NRSfM). PR-RRN consists of Residual-Recursive Networks (RRN) and two extra regularization losses. RRN is designed to effectively recover 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Haitian Zeng , Yuchao Dai , Xin Yu , Xiaohan Wang , Yi Yang

Non-rigid structure-from-motion (NRSfM) has so far been mostly studied for recovering 3D structure of a single non-rigid/deforming object. To handle the real world challenging multiple deforming objects scenarios, existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Suryansh Kumar , Yuchao Dai , Hongdong Li

A recent trend in Non-Rigid Structure-from-Motion (NRSfM) is to express local, differential constraints between pairs of images, from which the surface normal at any point can be obtained by solving a system of polynomial equations. The…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Shaifali Parashar , Yuxuan Long , Mathieu Salzmann , Pascal Fua

We propose a novel framework for training neural networks which is capable of learning 3D information of non-rigid objects when only 2D annotations are available as ground truths. Recently, there have been some approaches that incorporate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Sungheon Park , Minsik Lee , Nojun Kwak

The Structure from Motion (SfM) challenge in computer vision is the process of recovering the 3D structure of a scene from a series of projective measurements that are calculated from a collection of 2D images, taken from different…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Joseph Rowell

Two-view structure-from-motion (SfM) is the cornerstone of 3D reconstruction and visual SLAM. Existing deep learning-based approaches formulate the problem by either recovering absolute pose scales from two consecutive frames or predicting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jianyuan Wang , Yiran Zhong , Yuchao Dai , Stan Birchfield , Kaihao Zhang , Nikolai Smolyanskiy , Hongdong Li

This paper addresses the problem of Structure from Motion (SfM) for indoor panoramic image streams, extremely challenging even for the state-of-the-art due to the lack of textures and minimal parallax. The key idea is the fusion of…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Satoshi Ikehata , Ivaylo Boyadzhiev , Qi Shan , Yasutaka Furukawa

Recovery of articulated 3D structure from 2D observations is a challenging computer vision problem with many applications. Current learning-based approaches achieve state-of-the-art accuracy on public benchmarks but are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Onorina Kovalenko , Vladislav Golyanik , Jameel Malik , Ahmed Elhayek , Didier Stricker

Current Structure-from-Motion (SfM) methods typically follow a two-stage pipeline, combining learned or geometric pairwise reasoning with a subsequent global optimization step. In contrast, we propose a data-driven multi-view reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Qitao Zhao , Amy Lin , Jeff Tan , Jason Y. Zhang , Deva Ramanan , Shubham Tulsiani

Structure from motion (SfM) is an essential computer vision problem which has not been well handled by deep learning. One of the promising trends is to apply explicit structural constraint, e.g. 3D cost volume, into the network. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Xingkui Wei , Yinda Zhang , Zhuwen Li , Yanwei Fu , Xiangyang Xue

Image-based 3D reconstruction is one of the most important tasks in Computer Vision with many solutions proposed over the last few decades. The objective is to extract metric information i.e. the geometry of scene objects directly from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Qiao Chen , Charalambos Poullis

We propose to learn a 3D pose estimator by distilling knowledge from Non-Rigid Structure from Motion (NRSfM). Our method uses solely 2D landmark annotations. No 3D data, multi-view/temporal footage, or object specific prior is required.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Chaoyang Wang , Chen Kong , Simon Lucey

The structure from motion (SfM) problem in computer vision is the problem of recovering the three-dimensional ($3$D) structure of a stationary scene from a set of projective measurements, represented as a collection of two-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Onur Ozyesil , Vladislav Voroninski , Ronen Basri , Amit Singer

Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Pascal Fua

Structure-from-Motion (SfM) has become a ubiquitous tool for camera calibration and scene reconstruction with many downstream applications in computer vision and beyond. While the state-of-the-art SfM pipelines have reached a high level of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Shaohui Liu , Yidan Gao , Tianyi Zhang , Rémi Pautrat , Johannes L. Schönberger , Viktor Larsson , Marc Pollefeys

Reasoning the 3D structure of a non-rigid dynamic scene from a single moving camera is an under-constrained problem. Inspired by the remarkable progress of neural radiance fields (NeRFs) in photo-realistic novel view synthesis of static…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sameera Ramasinghe , Violetta Shevchenko , Gil Avraham , Anton Van Den Hengel

Structure-from-Motion is a technology used to obtain scene structure through image collection, which is a fundamental problem in computer vision. For unordered Internet images, SfM is very slow due to the lack of prior knowledge about image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zhichao Ye , Chong Bao , Xin Zhou , Haomin Liu , Hujun Bao , Guofeng Zhang

Visual localization is a critical task in mobile robotics, and researchers are continuously developing new approaches to enhance its efficiency. In this article, we propose a novel approach to improve the accuracy of visual localization…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Artem Nenashev , Mikhail Kurenkov , Andrei Potapov , Iana Zhura , Maksim Katerishich , Dzmitry Tsetserukou

In recent years, there have been significant advancements in 3D reconstruction and dense RGB-D SLAM systems. One notable development is the application of Neural Radiance Fields (NeRF) in these systems, which utilizes implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Tianchen Deng , Yanbo Wang , Hongle Xie , Hesheng Wang , Jingchuan Wang , Danwei Wang , Weidong Chen