English
Related papers

Related papers: Capsule Network based Contrastive Learning of Unsu…

200 papers

In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which an input feature…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Liheng Zhang , Marzieh Edraki , Guo-Jun Qi

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Standard Convolutional Neural Networks (CNNs) can be easily fooled by images with small quasi-imperceptible artificial perturbations. As alternatives to CNNs, the recently proposed Capsule Networks (CapsNets) are shown to be more robust to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Jindong Gu , Baoyuan Wu , Volker Tresp

In recent years, there has been a growing trend in accelerating computationally complex non-real-time beamforming algorithms in ultrasound imaging using deep learning models. However, due to the large size and complexity these…

Hardware Architecture · Computer Science 2025-09-04 Abdul Rahoof , Vivek Chaturvedi , Mahesh Raveendranatha Panicker , Muhammad Shafique

Semi-supervised learning is a sound measure to relieve the strict demand of abundant annotated datasets, especially for challenging multi-organ segmentation . However, most existing SSL methods predict pixels in a single image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lu Wen , Zhenghao Feng , Yun Hou , Peng Wang , Xi Wu , Jiliu Zhou , Yan Wang

Capsule networks (CapsNets) aim to parse images into a hierarchy of objects, parts, and their relations using a two-step process involving part-whole transformation and hierarchical component routing. However, this hierarchical relationship…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Pourya Shamsolmoali , Masoumeh Zareapoor , Swagatam Das , Eric Granger , Salvador Garcia

(Very early draft)Traditional supervised learning keeps pushing convolution neural network(CNN) achieving state-of-art performance. However, lack of large-scale annotation data is always a big problem due to the high cost of it, even…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Zhibo Wang , Shen Yan , Xiaoyu Zhang , Niels Lobo

Constructing an organized dataset comprised of a large number of images and several captions for each image is a laborious task, which requires vast human effort. On the other hand, collecting a large number of images and sentences…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Dong-Jin Kim , Jinsoo Choi , Tae-Hyun Oh , In So Kweon

Multilabel image categorization has drawn interest recently because of its numerous computer vision applications. The proposed work introduces a novel method for classifying multilabel images using the COCO-2014 dataset and a modified…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Lokender Singh , Saksham Kumar , Chandan Kumar

We propose a novel deep learning framework based on Vision Transformers (ViT) for one-class classification. The core idea is to use zero-centered Gaussian noise as a pseudo-negative class for latent space representation and then train the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Prerana Mukherjee , Chandan Kumar Roy , Swalpa Kumar Roy

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

Consistency training, which exploits both supervised and unsupervised learning with different augmentations on image, is an effective method of utilizing unlabeled data in semi-supervised learning (SSL) manner. Here, we present another…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Juyong Lee , Seunghyuk Cho

The accumulation of time-series data and the absence of labels make time-series Anomaly Detection (AD) a self-supervised deep learning task. Single-normality-assumption-based methods, which reveal only a certain aspect of the whole…

Machine Learning · Computer Science 2023-04-18 Rui Wang , Chongwei Liu , Xudong Mou , Kai Gao , Xiaohui Guo , Pin Liu , Tianyu Wo , Xudong Liu

Unsupervised Domain Adaptation (UDA) makes predictions for the target domain data while manual annotations are only available in the source domain. Previous methods minimize the domain discrepancy neglecting the class information, which may…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Guoliang Kang , Lu Jiang , Yi Yang , Alexander G Hauptmann

The global outbreak of the novel corona virus (COVID-19) disease has drastically impacted the world and led to one of the most challenging crisis across the globe since World War II. The early diagnosis and isolation of COVID-19 positive…

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Convolutional neural networks (CNN) have proven to be state of the art methods for many image classification tasks and their use is rapidly increasing in remote sensing problems. One of their major strengths is that, when enough data is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Gonzalo Mateo-García , Luis Gómez-Chova , Gustau Camps-Valls

Contrastive learning is commonly applied to self-supervised learning, and has been shown to outperform traditional approaches such as the triplet loss and N-pair loss. However, the requirement of large batch sizes and memory banks has made…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Rishab Balasubramanian , Rupashree Dey , Kunal Rathore

Image-level contrastive representation learning has proven to be highly effective as a generic model for transfer learning. Such generality for transfer learning, however, sacrifices specificity if we are interested in a certain downstream…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Fangyun Wei , Yue Gao , Zhirong Wu , Han Hu , Stephen Lin