English
Related papers

Related papers: TransformNet: Self-supervised representation learn…

200 papers

Recent work has proven that training large language models with self-supervised tasks and fine-tuning these models to complete new tasks in a transfer learning setting is a powerful idea, enabling the creation of models with many…

Machine Learning · Computer Science 2024-11-25 Matthew Spellings , Maya Martirossyan , Julia Dshemuchadse

As an agent moves through the world, the apparent motion of scene elements is (usually) inversely proportional to their depth. It is natural for a learning agent to associate image patterns with the magnitude of their displacement over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Huaizu Jiang , Erik Learned-Miller , Gustav Larsson , Michael Maire , Greg Shakhnarovich

Although deep convolutional neural network has been proved to efficiently eliminate coding artifacts caused by the coarse quantization of traditional codec, it's difficult to train any neural network in front of the encoder for gradient's…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Lijun Zhao , Huihui Bai , Anhong Wang , Yao Zhao

Convolutional Neural Networks (CNNs) are commonly thought to recognise objects by learning increasingly complex representations of object shapes. Some recent studies suggest a more important role of image textures. We here put these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Robert Geirhos , Patricia Rubisch , Claudio Michaelis , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

In this work, we introduce a self-supervised feature representation learning framework DreamTeacher that utilizes generative networks for pre-training downstream image backbones. We propose to distill knowledge from a trained generative…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Daiqing Li , Huan Ling , Amlan Kar , David Acuna , Seung Wook Kim , Karsten Kreis , Antonio Torralba , Sanja Fidler

Recent advances in deep learning have achieved promising performance for medical image analysis, while in most cases ground-truth annotations from human experts are necessary to train the deep model. In practice, such annotations are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Jianbo Jiao , Richard Droste , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

Object Pose Estimation is a crucial component in robotic grasping and augmented reality. Learning based approaches typically require training data from a highly accurate CAD model or labeled training data acquired using a complex setup. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Shishir Reddy Vutukur , Heike Brock , Benjamin Busam , Tolga Birdal , Andreas Hutter , Slobodan Ilic

This paper introduces an unsupervised framework to extract semantically rich features for video representation. Inspired by how the human visual system groups objects based on motion cues, we propose a deep convolutional neural network that…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Xunyu Lin , Victor Campos , Xavier Giro-i-Nieto , Jordi Torres , Cristian Canton Ferrer

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

Deep learning has been successful in automating the design of features in machine learning pipelines. However, the algorithms optimizing neural network parameters remain largely hand-designed and computationally inefficient. We study if we…

Machine Learning · Computer Science 2021-10-26 Boris Knyazev , Michal Drozdzal , Graham W. Taylor , Adriana Romero-Soriano

Deformable shapes provide important and complex geometric features of objects presented in images. However, such information is oftentimes missing or underutilized as implicit knowledge in many image analysis tasks. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Jian Wang , Miaomiao Zhang

Monocular 3D object parsing is highly desirable in various scenarios including occlusion reasoning and holistic scene interpretation. We present a deep convolutional neural network (CNN) architecture to localize semantic parts in 2D image…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Chi Li , M. Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Gregory D. Hager , Manmohan Chandraker

The difficulties in both data acquisition and annotation substantially restrict the sample sizes of training datasets for 3D medical imaging applications. As a result, constructing high-performance 3D convolutional neural networks from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Shu Zhang , Zihao Li , Hong-Yu Zhou , Jiechao Ma , Yizhou Yu

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

Deep convolutional neural networks accurately classify a diverse range of natural images, but may be easily deceived when designed, imperceptible perturbations are embedded in the images. In this paper, we design a multi-pronged training,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Nathaniel Dean , Dilip Sarkar

Feature representations, both hand-designed and learned ones, are often hard to analyze and interpret, even when they are extracted from visual data. We propose a new approach to study image representations by inverting them with an…

Neural and Evolutionary Computing · Computer Science 2016-04-28 Alexey Dosovitskiy , Thomas Brox

Scene labeling is a challenging classification problem where each input image requires a pixel-level prediction map. Recently, deep-learning-based methods have shown their effectiveness on solving this problem. However, we argue that the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-12 Zhe Wang , Hongsheng Li , Wanli Ouyang , Xiaogang Wang

Most of the approaches for discovering visual attributes in images demand significant supervision, which is cumbersome to obtain. In this paper, we aim to discover visual attributes in a weakly supervised setting that is commonly…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Sukrit Shankar , Vikas K. Garg , Roberto Cipolla

Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered…

Machine Learning · Computer Science 2021-06-21 Maytus Piriyajitakonkij , Sirawaj Itthipuripat , Theerawit Wilaiprasitporn , Nat Dilokthanakul

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers