English
Related papers

Related papers: Self-supervised Dense 3D Reconstruction from Monoc…

200 papers

Although considerable advancements have been attained in self-supervised depth estimation from monocular videos, most existing methods often treat all objects in a video as static entities, which however violates the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xiuzhe Wu , Xiaoyang Lyu , Qihao Huang , Yong Liu , Yang Wu , Ying Shan , Xiaojuan Qi

Current monocular 3D scene reconstruction (3DR) works are either fully-supervised, or not generalizable, or implicit in 3D representation. We propose a novel framework - MonoSelfRecon that for the first time achieves explicit 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Runfa Li , Upal Mahbub , Vasudev Bhaskaran , Truong Nguyen

Monocular 3D reconstruction of articulated object categories is challenging due to the lack of training data and the inherent ill-posedness of the problem. In this work we use video self-supervision, forcing the consistency of consecutive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Filippos Kokkinos , Iasonas Kokkinos

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

Estimating precise metric depth and scene reconstruction from monocular endoscopy is a fundamental task for surgical navigation in robotic surgery. However, traditional stereo matching adopts binocular images to perceive the depth…

Robotics · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Fangxun Zhong , Yonghao Long , Qi Dou , Yun-Hui Liu , Dong Sun

UAVs have become an essential photogrammetric measurement as they are affordable, easily accessible and versatile. Aerial images captured from UAVs have applications in small and large scale texture mapping, 3D modelling, object detection…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Logambal Madhuanand , Francesco Nex , Michael Ying Yang

This paper describes how to obtain accurate 3D body models and texture of arbitrary people from a single, monocular video in which a person is moving. Based on a parametric body model, we present a robust processing pipeline achieving 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

Our work aims to obtain 3D reconstruction of hands and manipulated objects from monocular videos. Reconstructing hand-object manipulations holds a great potential for robotics and learning from human demonstrations. The supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yana Hasson , Gül Varol , Ivan Laptev , Cordelia Schmid

Egocentric videos provide valuable insights into human interactions with the physical world, which has sparked growing interest in the computer vision and robotics communities. A critical challenge in fully understanding the geometry and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Chengbo Yuan , Geng Chen , Li Yi , Yang Gao

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

3D object detection from monocular images is an ill-posed problem due to the projective entanglement of depth and scale. To overcome this ambiguity, we present a novel self-supervised method for textured 3D shape reconstruction and pose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Deniz Beker , Hiroharu Kato , Mihai Adrian Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon

Incrementally recovering 3D dense structures from monocular videos is of paramount importance since it enables various robotics and AR applications. Feature volumes have recently been shown to enable efficient and accurate incremental dense…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Xingxing Zuo , Nan Yang , Nathaniel Merrill , Binbin Xu , Stefan Leutenegger

3D scene reconstruction from stereo endoscopic video data is crucial for advancing surgical interventions. In this work, we present an online framework for online, dense 3D scene reconstruction and tracking, aimed at enhancing surgical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Michel Hayoz , Christopher Hahne , Thomas Kurmann , Max Allan , Guido Beldi , Daniel Candinas , ablo Márquez-Neila , Raphael Sznitman

Video generation models have demonstrated great capabilities of producing impressive monocular videos, however, the generation of 3D stereoscopic video remains under-explored. We propose a pose-free and training-free approach for generating…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Peng Dai , Feitong Tan , Qiangeng Xu , David Futschik , Ruofei Du , Sean Fanello , Xiaojuan Qi , Yinda Zhang

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Boyi Jiang , Yang Hong , Hujun Bao , Juyong Zhang

We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single monocular image. We build our work upon the recent advances of DNN-based auto-encoders with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Abdallah Dib , Junghyun Ahn , Cedric Thebault , Philippe-Henri Gosselin , Louis Chevallier

This paper proposes a new approach for monocular dense 3D reconstruction of a complex dynamic scene from two perspective frames. By applying superpixel over-segmentation to the image, we model a generically dynamic (hence non-rigid) scene…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Suryansh Kumar , Yuchao Dai , Hongdong Li

This paper presents a probabilistic approach for online dense reconstruction using a single monocular camera moving through the environment. Compared to spatial stereo, depth estimation from motion stereo is challenging due to insufficient…

Robotics · Computer Science 2019-03-27 Yonggen Ling , Kaixuan Wang , Shaojie Shen

Three-dimensional electron microscopy (3DEM) is an essential technique to investigate volumetric tissue ultra-structure. Due to technical limitations and high imaging costs, samples are often imaged anisotropically, where resolution in the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Mohammad Khateri , Morteza Ghahremani , Alejandra Sierra , Jussi Tohka