English
Related papers

Related papers: Efficient Self-Supervision using Patch-based Contr…

200 papers

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiquan Li , Xianzhong Long , Yun Li

In this study, we use a self-explaining neural network (SENN), which learns unsupervised concepts, to acquire concepts that are easy for people to understand automatically. In concept learning, the hidden layer retains verbalizable features…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Yoshihide Sawada , Keigo Nakamura

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

A common shortfall of supervised learning for medical imaging is the greedy need for human annotations, which is often expensive and time-consuming to obtain. This paper proposes a semi-supervised classification method for three kinds of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Yanni Ren , Hangyu Deng , Hao Jiang , Jinglu Hu

Recent advances in self-supervised contrastive learning yield good image-level representation, which favors classification tasks but usually neglects pixel-level detailed information, leading to unsatisfactory transfer performance to dense…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Feng Wang , Huiyu Wang , Chen Wei , Alan Yuille , Wei Shen

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

Machine Learning · Computer Science 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

This paper presents a novel unsupervised segmentation method for 3D medical images. Convolutional neural networks (CNNs) have brought significant advances in image segmentation. However, most of the recent methods rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Takayasu Moriya , Holger R. Roth , Shota Nakamura , Hirohisa Oda , Kai Nagara , Masahiro Oda , Kensaku Mori

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

In the realms of computer vision, it is evident that deep neural networks perform better in a supervised setting with a large amount of labeled data. The representations learned with supervision are not only of high quality but also helps…

Machine Learning · Computer Science 2020-09-28 Souradip Chakraborty , Aritra Roy Gosthipaty , Sayak Paul

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuanze Lin , Xun Guo , Yan Lu

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

We present compositional nearest neighbors (CompNN), a simple approach to visually interpreting distributed representations learned by a convolutional neural network (CNN) for pixel-level tasks (e.g., image synthesis and segmentation). It…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Victor Fragoso , Chunhui Liu , Aayush Bansal , Deva Ramanan

A two-stage training paradigm consisting of sequential pre-training and meta-training stages has been widely used in current few-shot learning (FSL) research. Many of these methods use self-supervised learning and contrastive learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Zhanyuan Yang , Jinghua Wang , Yingying Zhu

Contrastive learning predicts whether two images belong to the same category by training a model to make their feature representations as close or as far away as possible. In this paper, we rethink how to mine samples in contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Hengkui Dong , Xianzhong Long , Yun Li

Deep convolutional neural networks (CNNs) have demonstrated remarkable success in computer vision by supervisedly learning strong visual feature representations. However, training CNNs relies heavily on the availability of exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Jiabo Huang , Qi Dong , Shaogang Gong , Xiatian Zhu

Fully convolutional networks (FCN) have achieved great success in human parsing in recent years. In conventional human parsing tasks, pixel-level labeling is required for guiding the training, which usually involves enormous human labeling…

Computer Vision and Pattern Recognition · Computer Science 2018-09-17 Zhonghua Wu , Guosheng Lin , Jianfei Cai

Self-supervised learning enables networks to learn discriminative features from massive data itself. Most state-of-the-art methods maximize the similarity between two augmentations of one image based on contrastive learning. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-05 Jidong Ge , Yuxiang Liu , Jie Gui , Lanting Fang , Ming Lin , James Tin-Yau Kwok , LiGuo Huang , Bin Luo

This paper proposes an efficient system for classifying cervical cancer cells using pre-trained convolutional neural networks (CNNs). We first fine-tune five pre-trained CNNs and minimize the overall cost of misclassification by…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Ashfiqun Mustari , Rushmia Ahmed , Afsara Tasnim , Jakia Sultana Juthi , G M Shahariar

Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits…

Machine Learning · Computer Science 2024-03-06 Nian Liu , Xiao Wang , Hui Han , Chuan Shi