English
Related papers

Related papers: Capsule Network based Contrastive Learning of Unsu…

200 papers

We introduce Cluster Contrast (CueCo), a novel approach to unsupervised visual representation learning that effectively combines the strengths of contrastive learning and clustering methods. Inspired by recent advancements, CueCo is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Nikolaos Giakoumoglou , Tania Stathaki

Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Shohreh Deldari , Hao Xue , Aaqib Saeed , Daniel V. Smith , Flora D. Salim

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in…

Instrumentation and Methods for Astrophysics · Physics 2019-05-29 V. Lukic , M. Brüggen , B. Mingo , J. H. Croston , G. Kasieczka , P. N. Best

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Capsule networks promise significant benefits over convolutional networks by storing stronger internal representations, and routing information based on the agreement between intermediate representations' projections. Despite this, their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Rodney Lalonde , Naji Khosravan , Ulas Bagci

Capsule Networks preserve the hierarchical spatial relationships between objects, and thereby bears a potential to surpass the performance of traditional Convolutional Neural Networks (CNNs) in performing tasks like image classification. A…

Machine Learning · Computer Science 2019-05-27 Alberto Marchisio , Giorgio Nanfa , Faiq Khalid , Muhammad Abdullah Hanif , Maurizio Martina , Muhammad Shafique

In open set recognition, a classifier has to detect unknown classes that are not known at training time. In order to recognize new categories, the classifier has to project the input samples of known classes in very compact and separated…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yunrui Guo , Guglielmo Camporese , Wenjing Yang , Alessandro Sperduti , Lamberto Ballan

Geometric transformations of the training data as well as the test data present challenges to the use of deep neural networks to vision-based learning tasks. In order to address this issue, we present a deep neural network model that…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Sai Raam Venkataraman , S. Balasubramanian , R. Raghunatha Sarma

The outputs of a trained neural network contain much richer information than just an one-hot classifier. For example, a neural network might give an image of a dog the probability of one in a million of being a cat but it is still much…

Machine Learning · Computer Science 2016-05-24 Yao Lu

The recent advances in representation learning inspire us to take on the challenging problem of unsupervised image classification tasks in a principled way. We propose ContraCluster, an unsupervised image classification method that combines…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seongho Joe , Byoungjip Kim , Hoyoung Kang , Kyoungwon Park , Bogun Kim , Jaeseon Park , Joonseok Lee , Youngjune Gwon

Feature representation via self-supervised learning has reached remarkable success in image-level contrastive learning, which brings impressive performances on image classification tasks. While image-level feature representation mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Junwei Yang , Ke Zhang , Zhaolin Cui , Jinming Su , Junfeng Luo , Xiaolin Wei

Capsule Networks (CapsNets), recently proposed by the Google Brain team, have superior learning capabilities in machine learning tasks, like image classification, compared to the traditional CNNs. However, CapsNets require extremely intense…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Beatrice Bussolino , Alessio Colucci , Maurizio Martina , Guido Masera , Muhammad Shafique

Capsule networks are a neural network architecture specialized for visual scene recognition. Features and pose information are extracted from a scene and then dynamically routed through a hierarchy of vector-valued nodes called 'capsules'…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alex B. Kiefer , Beren Millidge , Alexander Tschantz , Christopher L. Buckley

We present Generative Adversarial Capsule Network (CapsuleGAN), a framework that uses capsule networks (CapsNets) instead of the standard convolutional neural networks (CNNs) as discriminators within the generative adversarial network (GAN)…

Machine Learning · Statistics 2018-10-03 Ayush Jaiswal , Wael AbdAlmageed , Yue Wu , Premkumar Natarajan

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present…

Machine Learning · Statistics 2019-06-10 Taylor Killian , Justin Goodwin , Olivia Brown , Sung-Hyun Son

A key component to the success of deep learning is the availability of massive amounts of training data. Building and annotating large datasets for solving medical image classification problems is today a bottleneck for many applications.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Amelia Jiménez-Sánchez , Shadi Albarqouni , Diana Mateus

Image classification is a fundamental task in computer vision with diverse applications, ranging from autonomous systems to medical imaging. The CIFAR-10 dataset is a widely used benchmark to evaluate the performance of classification…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xiaoran Yang , Shuhan Yu , Wenxi Xu

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee