English
Related papers

Related papers: Viewmaker Networks: Learning Views for Unsupervise…

200 papers

We present a representation learning method that learns features at multiple different levels of scale. Working within the unsupervised framework of denoising autoencoders, we observe that when the input is heavily corrupted during…

Machine Learning · Computer Science 2015-04-14 Krzysztof J. Geras , Charles Sutton

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they provide an explicit…

Machine Learning · Computer Science 2020-09-15 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Unsupervised learning enables modeling complex images without the need for annotations. The representation learned by such models can facilitate any subsequent analysis of large image datasets. However, some generative factors that cause…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Maxime W. Lafarge , Josien P. W. Pluim , Mitko Veta

Our work focuses on unsupervised and generative methods that address the following goals: (a) learning unsupervised generative representations that discover latent factors controlling image semantic attributes, (b) studying how this ability…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 William Paul , I-Jeng Wang , Fady Alajaji , Philippe Burlina

We present a two-stage framework for deep one-class classification. We first learn self-supervised representations from one-class data, and then build one-class classifiers on learned representations. The framework not only allows to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Kihyuk Sohn , Chun-Liang Li , Jinsung Yoon , Minho Jin , Tomas Pfister

We propose a novel study of generating unseen arbitrary viewpoints for infrared imagery in the non-linear feature subspace . Current methods use synthetic images and often result in blurry and distorted outputs. Our approach on the contrary…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Maliha Arif , Abhijit Mahalanobis

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

We train a network to generate mappings between training sets and classification policies (a 'classifier generator') by conditioning on the entire training set via an attentional mechanism. The network is directly optimized for test set…

Machine Learning · Computer Science 2018-04-02 Nicholas Guttenberg , Ryota Kanai

This paper addresses unsupervised representation learning on tabular data containing multiple views generated by distinct sources of measurement. Traditional methods, which tackle this problem using the multi-view framework, are constrained…

Machine Learning · Computer Science 2023-06-01 Tennison Liu , Jeroen Berrevoets , Zhaozhi Qian , Mihaela van der Schaar

Self-supervised learning of deep neural networks has become a prevalent paradigm for learning representations that transfer to a variety of downstream tasks. Similar to proposed models of the ventral stream of biological vision, it is…

Machine Learning · Computer Science 2023-06-26 Kion Fallah , Alec Helbling , Kyle A. Johnsen , Christopher J. Rozell

In self-supervised learning (SSL), representations are learned via an auxiliary task without annotated labels. A common task is to classify augmentations or different modalities of the data, which share semantic content (e.g. an object in…

Machine Learning · Computer Science 2024-10-16 Alice Bizeul , Bernhard Schölkopf , Carl Allen

Transcribed datasets typically contain speaker identity for each instance in the data. We investigate two ways to incorporate this information during training: Multi-Task Learning and Adversarial Learning. In multi-task learning, the goal…

Machine Learning · Computer Science 2019-02-15 Yossi Adi , Neil Zeghidour , Ronan Collobert , Nicolas Usunier , Vitaliy Liptchinsky , Gabriel Synnaeve

Input space reconstruction is an attractive representation learning paradigm. Despite interpretability of the reconstruction and generation, we identify a misalignment between learning by reconstruction, and learning for perception. We show…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Randall Balestriero , Yann LeCun

Self-supervised representation learning~(SSRL) has advanced considerably by exploiting the transformation invariance assumption under artificially designed data augmentations. While augmentation-based SSRL algorithms push the boundaries of…

Machine Learning · Computer Science 2024-03-22 Yi Sui , Tongzi Wu , Jesse C. Cresswell , Ga Wu , George Stein , Xiao Shi Huang , Xiaochen Zhang , Maksims Volkovs

Convolutional neural networks provide visual features that perform remarkably well in many computer vision applications. However, training these networks requires significant amounts of supervision. This paper introduces a generic framework…

Machine Learning · Statistics 2017-04-19 Piotr Bojanowski , Armand Joulin

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. In this work, we propose \textbf{ViewCrafter}, a novel method for synthesizing high-fidelity novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Wangbo Yu , Jinbo Xing , Li Yuan , Wenbo Hu , Xiaoyu Li , Zhipeng Huang , Xiangjun Gao , Tien-Tsin Wong , Ying Shan , Yonghong Tian

Allowing effective inference of latent vectors while training GANs can greatly increase their applicability in various downstream tasks. Recent approaches, such as ALI and BiGAN frameworks, develop methods of inference of latent variables…

Machine Learning · Computer Science 2020-12-22 Yatin Dandi , Homanga Bharadhwaj , Abhishek Kumar , Piyush Rai

In sequence-to-sequence learning, e.g., natural language generation, the decoder relies on the attention mechanism to efficiently extract information from the encoder. While it is common practice to draw information from only the last…

Computation and Language · Computer Science 2022-08-30 Fenglin Liu , Xuancheng Ren , Guangxiang Zhao , Chenyu You , Xuewei Ma , Xian Wu , Xu Sun

Self-supervised learning has achieved remarkable success in acquiring high-quality representations from unlabeled data. The widely adopted contrastive learning framework aims to learn invariant representations by minimizing the distance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Xiaojie Li , Yibo Yang , Xiangtai Li , Jianlong Wu , Yue Yu , Bernard Ghanem , Min Zhang