English
Related papers

Related papers: DeepDeform: Learning Non-rigid RGB-D Reconstructio…

200 papers

We present a minimalistic but effective neural network that computes dense facial correspondences in highly unconstrained RGB images. Our network learns a per-pixel flow and a matchability mask between 2D input photographs of a person and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Ronald Yu , Shunsuke Saito , Haoxiang Li , Duygu Ceylan , Hao Li

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

Non-Rigid Structure from Motion (NRSfM) refers to the problem of reconstructing cameras and the 3D point cloud of a non-rigid object from an ensemble of images with 2D correspondences. Current NRSfM algorithms are limited from two…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Chen Kong , Simon Lucey

Scene reconstruction from unorganized RGB images is an important task in many computer vision applications. Multi-view Stereo (MVS) is a common solution in photogrammetry applications for the dense reconstruction of a static scene. The…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Matthias Innmann , Kihwan Kim , Jinwei Gu , Matthias Niessner , Charles Loop , Marc Stamminger , Jan Kautz

Unsupervised learning of feature representations is a challenging yet important problem for analyzing a large collection of multimedia data that do not have semantic labels. Recently proposed neural network-based unsupervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Takahiko Furuya , Ryutarou Ohbuchi

Reconstruction of the shape and motion of humans from RGB-D is a challenging problem, receiving much attention in recent years. Recent approaches for full-body reconstruction use a statistic shape model, which is built upon accurate…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Ryosuke Kimura , Akihiko Sayo , Fabian Lorenzo Dayrit , Yuta Nakashima , Hiroshi Kawasaki , Ambrosio Blanco , Katsushi Ikeuchi

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

This work presents dense stereo reconstruction using high-resolution images for infrastructure inspections. The state-of-the-art stereo reconstruction methods, both learning and non-learning ones, consume too much computational resource on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yaoyu Hu , Weikun Zhen , Sebastian Scherer

Deep convolutional networks (CNN) can achieve impressive results on RGB scene recognition thanks to large datasets such as Places. In contrast, RGB-D scene recognition is still underdeveloped in comparison, due to two limitations of RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Xinhang Song , Shuqiang Jiang , Luis Herranz , Chengpeng Chen

We propose DynamicSurf, a model-free neural implicit surface reconstruction method for high-fidelity 3D modelling of non-rigid surfaces from monocular RGB-D video. To cope with the lack of multi-view cues in monocular sequences of deforming…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Mirgahney Mohamed , Lourdes Agapito

Most camera images are rendered and saved in the standard RGB (sRGB) format by the camera's hardware. Due to the in-camera photo-finishing routines, nonlinear sRGB images are undesirable for computer vision tasks that assume a direct…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Seonghyeon Nam , Abhijith Punnappurath , Marcus A. Brubaker , Michael S. Brown

All current non-rigid structure from motion (NRSfM) algorithms are limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Chen Kong , Simon Lucey

Deep learning approaches have achieved highly accurate face recognition by training the models with very large face image datasets. Unlike the availability of large 2D face image datasets, there is a lack of large 3D face datasets available…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Meng-Tzu Chiu , Hsun-Ying Cheng , Chien-Yi Wang , Shang-Hong Lai

Shape correspondence is a fundamental problem in computer graphics and vision, with applications in various problems including animation, texture mapping, robotic vision, medical imaging, archaeology and many more. In settings where the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Or Litany , Emanuele Rodolà , Alex Bronstein , Michael Bronstein , Daniel Cremers

Deep learning (DL) has emerged as a tool for improving accelerated MRI reconstruction. A common strategy among DL methods is the physics-based approach, where a regularized iterative algorithm alternating between data consistency and a…

Image and Video Processing · Electrical Eng. & Systems 2020-07-03 Burhaneddin Yaman , Seyed Amir Hossein Hosseini , Steen Moeller , Jutta Ellermann , Kâmil Uǧurbil , Mehmet Akçakaya

We propose a new deep learning architecture for the tasks of semantic segmentation and depth prediction from RGB-D images. We revise the state of art based on the RGB and depth feature fusion, where both modalities are assumed to be…

Artificial Intelligence · Computer Science 2018-12-18 Giorgio Giannone , Boris Chidlovskii

Most of the existing handcrafted and learning-based local descriptors are still at best approximately invariant to affine image transformations, often disregarding deformable surfaces. In this paper, we take one step further by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Guilherme Potje , Renato Martins , Felipe Cadar , Erickson R. Nascimento

We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Our method does not require a pre-defined shape template to start with and builds up the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Matthias Innmann , Michael Zollhöfer , Matthias Nießner , Christian Theobalt , Marc Stamminger

Non-rigid registration computes an alignment between a source surface with a target surface in a non-rigid manner. In the past decade, with the advances in 3D sensing technologies that can measure time-varying surfaces, non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Bailin Deng , Yuxin Yao , Roberto M. Dyke , Juyong Zhang

Pre-training general-purpose visual features with convolutional neural networks without relying on annotations is a challenging and important task. Most recent efforts in unsupervised feature learning have focused on either small or highly…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Mathilde Caron , Piotr Bojanowski , Julien Mairal , Armand Joulin