English
Related papers

Related papers: Unsupervised Representation Learning by Discoverin…

200 papers

Learning representations for semantic relations is important for various tasks such as analogy detection, relational search, and relation classification. Although there have been several proposals for learning representations for individual…

Computation and Language · Computer Science 2015-05-04 Danushka Bollegala , Takanori Maehara , Ken-ichi Kawarabayashi

Self-supervised learning in computer vision aims to leverage the inherent structure and relationships within data to learn meaningful representations without explicit human annotation, enabling a holistic understanding of visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Prakash Chandra Chhipa , Johan Rodahl Holmgren , Kanjar De , Rajkumar Saini , Marcus Liwicki

Recent progress in image recognition has stimulated the deployment of vision systems at an unprecedented scale. As a result, visual data are now often consumed not only by humans but also by machines. Existing image processing methods only…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zhuang Liu , Hung-Ju Wang , Tinghui Zhou , Zhiqiang Shen , Bingyi Kang , Evan Shelhamer , Trevor Darrell

While visual imitation learning offers one of the most effective ways of learning from visual demonstrations, generalizing from them requires either hundreds of diverse demonstrations, task specific priors, or large, hard-to-train…

Robotics · Computer Science 2021-12-07 Jyothish Pari , Nur Muhammad Shafiullah , Sridhar Pandian Arunachalam , Lerrel Pinto

As digital medical imaging becomes more prevalent and archives increase in size, representation learning exposes an interesting opportunity for enhanced medical decision support systems. On the other hand, medical imaging data is often…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Eduardo Pinho , Carlos Costa

We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Gary B Huang , Huei-Fang Yang , Shin-ya Takemura , Pat Rivlin , Stephen M Plaza

Most current super-resolution methods rely on low and high resolution image pairs to train a network in a fully supervised manner. However, such image pairs are not available in real-world applications. Instead of directly addressing this…

Image and Video Processing · Electrical Eng. & Systems 2019-09-23 Andreas Lugmayr , Martin Danelljan , Radu Timofte

The present phase of Machine Learning is characterized by supervised learning algorithms relying on large sets of labeled examples ($n \to \infty$). The next phase is likely to focus on algorithms capable of learning from very few labeled…

Computer Vision and Pattern Recognition · Computer Science 2014-03-12 Fabio Anselmi , Joel Z. Leibo , Lorenzo Rosasco , Jim Mutch , Andrea Tacchetti , Tomaso Poggio

Discriminative self-supervised learning allows training models on any random group of internet images, and possibly recover salient information that helps differentiate between the images. Applied to ImageNet, this leads to object centric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Priya Goyal , Quentin Duval , Isaac Seessel , Mathilde Caron , Ishan Misra , Levent Sagun , Armand Joulin , Piotr Bojanowski

After four decades of research there still exists a Classification accuracy gap of about 20% between our best Unsupervisedly Learned Representations methods and the accuracy rates achieved by intelligent animals. It thus may well be that we…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

In recent years, discriminative self-supervised methods have made significant strides in advancing various visual tasks. The central idea of learning a data encoder that is robust to data distortions/augmentations is straightforward yet…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yuewei Yang , Hai Li , Yiran Chen

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Danilo Jimenez Rezende , S. M. Ali Eslami , Shakir Mohamed , Peter Battaglia , Max Jaderberg , Nicolas Heess

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of expensive annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Chengxu Zhuang , Alex Lin Zhai , Daniel Yamins

The keep-growing content of Web images may be the next important data source to scale up deep neural networks, which recently obtained a great success in the ImageNet classification challenge and related tasks. This prospect, however, has…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Phong D. Vo , Alexandru Ginsca , Hervé Le Borgne , Adrian Popescu

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

Learning with complete or partial supervision is powerful but relies on ever-growing human annotation efforts. As a way to mitigate this serious problem, as well as to serve specific applications, unsupervised learning has emerged as an…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Huy V. Vo , Francis Bach , Minsu Cho , Kai Han , Yann LeCun , Patrick Perez , Jean Ponce

While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging endeavor for artificial intelligence. In this work, we propose…

Machine Learning · Computer Science 2019-01-23 Aaron van den Oord , Yazhe Li , Oriol Vinyals

Part-based image classification aims at representing categories by small sets of learned discriminative parts, upon which an image representation is built. Considered as a promising avenue a decade ago, this direction has been neglected…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Ronan Sicre , Yannis Avrithis , Ewa Kijak , Frederic Jurie

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Daniel Shalam , Simon Korman

Learning causal relationships in high-dimensional data (images, videos) is a hard task, as they are often defined on low dimensional manifolds and must be extracted from complex signals dominated by appearance, lighting, textures and also…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Steeven Janny , Fabien Baradel , Natalia Neverova , Madiha Nadri , Greg Mori , Christian Wolf