English
Related papers

Related papers: Self-Supervised 2D Image to 3D Shape Translation w…

200 papers

Every recent image-to-image translation model inherently requires either image-level (i.e. input-output pairs) or set-level (i.e. domain labels) supervision. However, even set-level supervision can be a severe bottleneck for data collection…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Kyungjune Baek , Yunjey Choi , Youngjung Uh , Jaejun Yoo , Hyunjung Shim

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

This paper proposes the first self-supervised 6D object pose prediction from multimodal RGB+polarimetric images. The novel training paradigm comprises 1) a physical model to extract geometric information of polarized light, 2) a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Patrick Ruhkamp , Daoyi Gao , Nassir Navab , Benjamin Busam

Models trained on datasets with texture bias usually perform poorly on out-of-distribution samples since biased representations are embedded into the model. Recently, various image translation and debiasing methods have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Myeongkyun Kang , Dongkyu Won , Miguel Luna , Philip Chikontwe , Kyung Soo Hong , June Hong Ahn , Sang Hyun Park

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

With increasing focus on augmented and virtual reality applications (XR) comes the demand for algorithms that can lift objects from images and videos into representations that are suitable for a wide variety of related 3D tasks. Large-scale…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Felix Wimbauer , Shangzhe Wu , Christian Rupprecht

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

Remote sensing change detection, identifying changes between scenes of the same location, is an active area of research with a broad range of applications. Recent advances in multimodal self-supervised pretraining have resulted in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Isaac Corley , Peyman Najafirad

We present a self-supervised method to learn dynamic 3D deformations of garments worn by parametric human bodies. State-of-the-art data-driven approaches to model 3D garment deformations are trained using supervised strategies that require…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Igor Santesteban , Miguel A. Otaduy , Dan Casas

Representation learning aims to discover individual salient features of a domain in a compact and descriptive form that strongly identifies the unique characteristics of a given sample respective to its domain. Existing works in visual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Dan Ruta , Gemma Canet Tarres , Alexander Black , Andrew Gilbert , John Collomosse

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

This work presents a new unsupervised framework for training deep learning models for super-resolution of Sentinel-2 images by fusion of its 10-m and 20-m bands. The proposed scheme avoids the resolution downgrade process needed to generate…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Matteo Ciotola , Mario Ragosta , Giovanni Poggi , Giuseppe Scarpa

Visual place recognition is a key to unlocking spatial navigation for animals, humans and robots. While state-of-the-art approaches are trained in a supervised manner and therefore hardly capture the information needed for generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mohamed Adel Musallam , Vincent Gaudillière , Djamila Aouada

Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Maren Awiszus , Hanno Ackermann , Bodo Rosenhahn

It is challenging to disentangle an object into two orthogonal spaces of content and style since each can influence the visual observation differently and unpredictably. It is rare for one to have access to a large number of data to help…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Wayne Wu , Kaidi Cao , Cheng Li , Chen Qian , Chen Change Loy

We aim to obtain an interpretable, expressive, and disentangled scene representation that contains comprehensive structural and textural information for each object. Previous scene representations learned by neural networks are often…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Shunyu Yao , Tzu Ming Harry Hsu , Jun-Yan Zhu , Jiajun Wu , Antonio Torralba , William T. Freeman , Joshua B. Tenenbaum

We propose a method to learn 3D deformable object categories from raw single-view images, without external supervision. The method is based on an autoencoder that factors each input image into depth, albedo, viewpoint and illumination. In…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Shangzhe Wu , Christian Rupprecht , Andrea Vedaldi

Recent vision-language models outperform vision-only models on many image classification tasks. However, because of the absence of paired text/image descriptions, it remains difficult to fine-tune these models for fine-grained image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Kathleen M. Lewis , Emily Mu , Adrian V. Dalca , John Guttag

Semantic image parsing, which refers to the process of decomposing images into semantic regions and constructing the structure representation of the input, has recently aroused widespread interest in the field of computer vision. The recent…

Computer Vision and Pattern Recognition · Computer Science 2018-10-11 Lili Huang , Jiefeng Peng , Ruimao Zhang , Guanbin Li , Liang Lin

We present SILT, a Self-supervised Implicit Lighting Transfer method. Unlike previous research on scene relighting, we do not seek to apply arbitrary new lighting configurations to a given scene. Instead, we wish to transfer the lighting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Nikolina Kubiak , Armin Mustafa , Graeme Phillipson , Stephen Jolly , Simon Hadfield