English
Related papers

Related papers: Unsupervised Learning of 3D Structure from Images

200 papers

Actions as simple as grasping an object or navigating around it require a rich understanding of that object's 3D shape from a given viewpoint. In this paper we repurpose powerful learning machinery, originally developed for object…

Computer Vision and Pattern Recognition · Computer Science 2015-11-26 Shubham Tulsiani , Abhishek Kar , Qixing Huang , João Carreira , Jitendra Malik

Understanding the 3D world is a fundamental problem in computer vision. However, learning a good representation of 3D objects is still an open problem due to the high dimensionality of the data and many factors of variation involved. In…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Xinchen Yan , Jimei Yang , Ersin Yumer , Yijie Guo , Honglak Lee

Deep neural networks are efficient learning machines which leverage upon a large amount of manually labeled data for learning discriminative features. However, acquiring substantial amount of supervised data, especially for videos can be a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Sujoy Paul , Sourya Roy , Amit K. Roy-Chowdhury

Visual scenes are extremely diverse, not only because there are infinite possible combinations of objects and backgrounds but also because the observations of the same scene may vary greatly with the change of viewpoints. When observing a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jinyang Yuan , Tonglin Chen , Zhimeng Shen , Bin Li , Xiangyang Xue

Our goal is to extract meaningful transformations from raw images, such as varying the thickness of lines in handwriting or the lighting in a portrait. We propose an unsupervised approach to learn such transformations by attempting to…

Machine Learning · Statistics 2017-11-08 Tatsunori B. Hashimoto , John C. Duchi , Percy Liang

Brain image registration transforms a pair of images into one system with the matched imaging contents, which is of essential importance for brain image analysis. This paper presents a novel framework for unsupervised 3D brain image…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Lihao Liu , Xiaowei Hu , Lei Zhu , Pheng-Ann Heng

Unsupervised learning with generative models has the potential of discovering rich representations of 3D scenes. While geometric deep learning has explored 3D-structure-aware representations of scene geometry, these models typically require…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Vincent Sitzmann , Michael Zollhöfer , Gordon Wetzstein

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

We propose an approach to self-supervised representation learning based on maximizing mutual information between features extracted from multiple views of a shared context. For example, one could produce multiple views of a local…

Machine Learning · Computer Science 2019-07-09 Philip Bachman , R Devon Hjelm , William Buchwalter

Recent 3D face reconstruction methods reconstruct the entire head compared to earlier approaches which only model the face. Although these methods accurately reconstruct facial features, they do not explicitly regulate the upper part of the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Sohan Anisetty , Varsha Saravanabavan , Cai Yiyu

In this paper, we consider the problem of reconstructing a dense 3D model using images captured from different views. Recent methods based on convolutional neural networks (CNN) allow learning the entire task from data. However, they do not…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Despoina Paschalidou , Ali Osman Ulusoy , Carolin Schmitt , Luc van Gool , Andreas Geiger

Unsupervised learning and supervised learning are key research topics in deep learning. However, as high-capacity supervised neural networks trained with a large amount of labels have achieved remarkable success in many computer vision…

Machine Learning · Computer Science 2017-04-18 Yuting Zhang , Kibok Lee , Honglak Lee

In recent years, deep generative models have gained significance due to their ability to synthesize natural-looking images with applications ranging from virtual reality to data augmentation for training computer vision models. While…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Paul Sanzenbacher , Lars Mescheder , Andreas Geiger

We propose an unsupervised method for 3D geometry-aware representation learning of articulated objects, in which no image-pose pairs or foreground masks are used for training. Though photorealistic images of articulated objects can be…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

In this paper a semi-supervised deep framework is proposed for the problem of 3D shape inverse rendering from a single 2D input image. The main structure of proposed framework consists of unsupervised pre-trained components which…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Shima Kamyab , S. Zohreh Azimifar

A visual system has to learn both which features to extract from images and how to group locations into (proto-)objects. Those two aspects are usually dealt with separately, although predictability is discussed as a cue for both. To…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Heiko H. Schütt , Wei Ji Ma

The 3D-zoom operation is the positive translation of the camera in the Z-axis, perpendicular to the image plane. In contrast, the optical zoom changes the focal length and the digital zoom is used to enlarge a certain region of an image to…

Image and Video Processing · Electrical Eng. & Systems 2019-10-03 Juan Luis Gonzalez Bello , Munchurl Kim

In this work, we propose a new unsupervised image segmentation approach based on mutual information maximization between different constructed views of the inputs. Taking inspiration from autoregressive generative models that predict the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yassine Ouali , Céline Hudelot , Myriam Tami

Many surface cues support three-dimensional shape perception, but people can sometimes still see shape when these features are missing -- in extreme cases, even when an object is completely occluded, as when covered with a draped cloth. We…

Neurons and Cognition · Quantitative Biology 2023-01-11 Ilker Yildirim , Max H. Siegel , Amir A. Soltani , Shraman Ray Chaudhari , Joshua B. Tenenbaum

It is widely believed that the success of deep convolutional networks is based on progressively discarding uninformative variability about the input with respect to the problem at hand. This is supported empirically by the difficulty of…

Machine Learning · Computer Science 2018-06-25 Jörn-Henrik Jacobsen , Arnold Smeulders , Edouard Oyallon