English
Related papers

Related papers: Deep Non-rigid Structure-from-Motion: A Sequence-t…

200 papers

We present a novel framework named NeuralRecon for real-time 3D scene reconstruction from a monocular video. Unlike previous methods that estimate single-view depth maps separately on each key-frame and fuse them later, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jiaming Sun , Yiming Xie , Linghao Chen , Xiaowei Zhou , Hujun Bao

Self-supervised methods have showed promising results on depth estimation task. However, previous methods estimate the target depth map and camera ego-motion simultaneously, underusing multi-frame correlation information and ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Songchun Zhang , Chunhui Zhao

This paper deals with the highly challenging problem of reconstructing the shape of a refracting object from a single image of its resulting caustic. Due to the ubiquity of transparent refracting objects in everyday life, reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Marc Kassubeck , Moritz Kappel , Susana Castillo , Marcus Magnor

Monocular dense 3D reconstruction of deformable objects is a hard ill-posed problem in computer vision. Current techniques either require dense correspondences and rely on motion and deformation cues, or assume a highly accurate…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Vladislav Golyanik , Soshi Shimada , Kiran Varanasi , Didier Stricker

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiahua Chen , Qihong Tang , Weinong Wang , Qi Fan

In architecture and computer-aided design, wireframes (i.e., line-based models) are widely used as basic 3D models for design evaluation and fast design iterations. However, unlike a full design file, a wireframe model lacks critical…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yuan Xue , Zihan Zhou , Xiaolei Huang

We propose a method for in-hand 3D scanning of an unknown object with a monocular camera. Our method relies on a neural implicit surface representation that captures both the geometry and the appearance of the object, however, by contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shreyas Hampali , Tomas Hodan , Luan Tran , Lingni Ma , Cem Keskin , Vincent Lepetit

This paper introduces a unified framework for video action segmentation via sequence to sequence (seq2seq) translation in a fully and timestamp supervised setup. In contrast to current state-of-the-art frame-level prediction methods, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Nadine Behrmann , S. Alireza Golestaneh , Zico Kolter , Juergen Gall , Mehdi Noroozi

A reliable estimation of 3D parameters is a must for several applications like planning and control. Included in the latter is the Image-Based Visual Servoing, whose control scheme depends directly on 3D parameters e.g. depth of points, and…

Robotics · Computer Science 2018-12-13 André Mateus , Omar Tahri , Pedro Miraldo

Remarkable progress has been made in 3D reconstruction of rigid structures from a video or a collection of images. However, it is still challenging to reconstruct nonrigid structures from RGB inputs, due to its under-constrained nature.…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Gengshan Yang , Deqing Sun , Varun Jampani , Daniel Vlasic , Forrester Cole , Huiwen Chang , Deva Ramanan , William T. Freeman , Ce Liu

3D reconstruction, which aims to recover the dense three-dimensional structure of a scene, is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics. While traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Wei Zhang , Yihang Wu , Songhua Li , Wenjie Ma , Xin Ma , Qiang Li , Qi Wang

Reconstructing 3D shapes from a sequence of images has long been a problem of interest in computer vision. Classical Structure from Motion (SfM) methods have attempted to solve this problem through projected point displacement \& bundle…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Rui Zhu , Chaoyang Wang , Chen-Hsuan Lin , Ziyan Wang , Simon Lucey

Video compression artifact reduction aims to recover high-quality videos from low-quality compressed videos. Most existing approaches use a single neighboring frame or a pair of neighboring frames (preceding and/or following the target…

Image and Video Processing · Electrical Eng. & Systems 2019-10-29 Yi Xu , Longwen Gao , Kai Tian , Shuigeng Zhou , Huyang Sun

We present "Humans and Structure from Motion" (HSfM), a method for jointly reconstructing multiple human meshes, scene point clouds, and camera parameters in a metric world coordinate system from a sparse set of uncalibrated multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Lea Müller , Hongsuk Choi , Anthony Zhang , Brent Yi , Jitendra Malik , Angjoo Kanazawa

A novel non-rigid image registration algorithm is built upon fully convolutional networks (FCNs) to optimize and learn spatial transformations between pairs of images to be registered in a self-supervised learning framework. Different from…

Computer Vision and Pattern Recognition · Computer Science 2018-01-15 Hongming Li , Yong Fan

Dense indoor scene modeling from 2D images has been bottlenecked due to the absence of depth information and cluttered occlusions. We present an automatic indoor scene modeling approach using deep features from neural networks. Given a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Yinyu Nie , Shihui Guo , Jian Chang , Xiaoguang Han , Jiahui Huang , Shi-Min Hu , Jian Jun Zhang

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yusen Wang , Zongcheng Li , Yu Jiang , Kaixuan Zhou , Tuo Cao , Yanping Fu , Chunxia Xiao

In this paper we tackle the problem of learning Structure-from-Motion (SfM) through the use of graph attention networks. SfM is a classic computer vision problem that is solved though iterative minimization of reprojection errors, referred…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Lucas Brynte , José Pedro Iglesias , Carl Olsson , Fredrik Kahl

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Luoxi Zhang , Pragyan Shrestha , Yu Zhou , Chun Xie , Itaru Kitahara

Recovering 3D structure and camera motion from images has been a long-standing focus of computer vision research and is known as Structure-from-Motion (SfM). Solutions to this problem are categorized into incremental and global approaches.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Linfei Pan , Dániel Baráth , Marc Pollefeys , Johannes L. Schönberger