English
Related papers

Related papers: Self-Supervised 2D Image to 3D Shape Translation w…

200 papers

Semantic Image Synthesis (SIS) is a subclass of image-to-image translation where a photorealistic image is synthesized from a segmentation mask. SIS has mostly been addressed as a supervised problem. However, state-of-the-art methods depend…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 George Eskandar , Mohamed Abdelsamad , Karim Armanious , Bin Yang

Recent image-to-image translation works have been transferred from supervised to unsupervised settings due to the expensive cost of capturing or labeling large amounts of paired data. However, current unsupervised methods using the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Pan Zhang , Jianmin Bao , Ting Zhang , Dong Chen , Fang Wen

Parametric models of humans, faces, hands and animals have been widely used for a range of tasks such as image-based reconstruction, shape correspondence estimation, and animation. Their key strength is the ability to factor surface…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Keyang Zhou , Bharat Lal Bhatnagar , Gerard Pons-Moll

Unsupervised image translation aims to learn the transformation from a source domain to another target domain given unpaired training data. Several state-of-the-art works have yielded impressive results in the GANs-based unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Taewon Kang , Kwang Hee Lee

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not necessitate 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xueting Li , Sifei Liu , Kihwan Kim , Shalini De Mello , Varun Jampani , Ming-Hsuan Yang , Jan Kautz

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Liming Jiang , Changxu Zhang , Mingyang Huang , Chunxiao Liu , Jianping Shi , Chen Change Loy

We present a method to learn single-view reconstruction of the 3D shape, pose, and texture of objects from categorized natural images in a self-supervised manner. Since this is a severely ill-posed problem, carefully designing a training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Hiroharu Kato , Tatsuya Harada

Self-supervised learning has achieved remarkable success in learning visual representations from clean data, yet remains challenging when clean observations are sparse or not available at all. In this paper, we demonstrate that pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Konstantinos Alexis , Giorgos Giannopoulos , Dimitrios Gunopulos

We introduce an unsupervised feature learning approach that embeds 3D shape information into a single-view image representation. The main idea is a self-supervised training objective that, given only a single 2D image, requires all unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Dinesh Jayaraman , Ruohan Gao , Kristen Grauman

The objective of this paper is 3D shape understanding from single and multiple images. To this end, we introduce a new deep-learning architecture and loss function, SilNet, that can handle multiple views in an order-agnostic manner. The…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Olivia Wiles , Andrew Zisserman

In recent years, more and more attention has been paid to the learning of 3D human representation. However, the complexity of lots of hand-defined human body constraints and the absence of supervision data limit that the existing works…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Lu Wang , Xishuai Peng , S. Kevin Zhou

In this paper a semi-supervised deep framework is proposed for the problem of 3D shape inverse rendering from a single 2D input image. The main structure of proposed framework consists of unsupervised pre-trained components which…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Shima Kamyab , S. Zohreh Azimifar

Learning to reconstruct 3D shapes using 2D images is an active research topic, with benefits of not requiring expensive 3D data. However, most work in this direction requires multi-view images for each object instance as training…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Bo Peng , Wei Wang , Jing Dong , Tieniu Tan

Recovering the 3D structure of an object from a single image is a challenging task due to its ill-posed nature. One approach is to utilize the plentiful photos of the same object category to learn a strong 3D shape prior for the object.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Long-Nhat Ho , Anh Tuan Tran , Quynh Phung , Minh Hoai

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari

We propose a method for self-supervised image representation learning under the guidance of 3D geometric consistency. Our intuition is that 3D geometric consistency priors such as smooth regions and surface discontinuities may imply…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Nenglun Chen , Lei Chu , Hao Pan , Yan Lu , Wenping Wang

Unpaired Image-to-image Translation is a new rising and challenging vision problem that aims to learn a mapping between unaligned image pairs in diverse domains. Recent advances in this field like MUNIT and DRIT mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Zhiqiang Shen , Mingyang Huang , Jianping Shi , Xiangyang Xue , Thomas Huang

We infer and generate three-dimensional (3D) scene information from a single input image and without supervision. This problem is under-explored, with most prior work relying on supervision from, e.g., 3D ground-truth, multiple images of a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Sai Rajeswar , Fahim Mannan , Florian Golemo , Jérôme Parent-Lévesque , David Vazquez , Derek Nowrouzezahrai , Aaron Courville

3D shape matching is a long-standing problem in computer vision and computer graphics. While deep neural networks were shown to lead to state-of-the-art results in shape matching, existing learning-based approaches are limited in the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Dongliang Cao , Florian Bernard

Image translation for change detection or classification in bi-temporal remote sensing images is unique. Although it can acquire paired images, it is still unsupervised. Moreover, strict semantic preservation in translation is always needed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sheng Fang , Kaiyu Li , Zhe Li , Jianli Zhao , Xingli Zhang