English
Related papers

Related papers: Unsupervised Feature Clustering Improves Contrasti…

200 papers

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

Cluster discrimination is an effective pretext task for unsupervised representation learning, which often consists of two phases: clustering and discrimination. Clustering is to assign each instance a pseudo label that will be used to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Qi Qian , Yuanhong Xu , Juhua Hu , Hao Li , Rong Jin

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

Collecting large annotated datasets in Remote Sensing is often expensive and thus can become a major obstacle for training advanced machine learning models. Common techniques of addressing this issue, based on the underlying idea of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Rahul Ghosh , Xiaowei Jia , Chenxi Lin , Zhenong Jin , Vipin Kumar

Person re-identification (ReID) aims at searching the same identity person among images captured by various cameras. Unsupervised person ReID attracts a lot of attention recently, due to it works without intensive manual annotation and thus…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Bo Pang , Deming Zhai , Junjun Jiang , Xianming Liu

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Clustering is one of the most fundamental tasks in machine learning. Recently, deep clustering has become a major trend in clustering techniques. Representation learning often plays an important role in the effectiveness of deep clustering,…

Machine Learning · Computer Science 2021-06-02 Yaling Tao , Kentaro Takagi , Kouta Nakata

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

Machine Learning · Computer Science 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee

Contrastive learning has been widely studied in sentence representation learning. However, earlier works mainly focus on the construction of positive examples, while in-batch samples are often simply treated as negative examples. This…

Computation and Language · Computer Science 2023-05-18 Jinghao Deng , Fanqi Wan , Tao Yang , Xiaojun Quan , Rui Wang

Unsupervised contrastive learning has shown significant performance improvements in recent years, often approaching or even rivaling supervised learning in various tasks. However, its learning mechanism is fundamentally different from…

Machine Learning · Computer Science 2026-03-05 Yi-Ge Zhang , Jingyi Cui , Qiran Li , Yisen Wang

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Machine Learning · Statistics 2022-03-18 Kristoffer Wickstrøm , Michael Kampffmeyer , Karl Øyvind Mikalsen , Robert Jenssen

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

The pursuit of learning robust representations without human supervision is a longstanding challenge. The recent advancements in self-supervised contrastive learning approaches have demonstrated high performance across various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ozgu Goksu , Nicolas Pugeault

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learning offer…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Attiano Purpura-Pontoniere , Demetri Terzopoulos , Adam Wang , Abdullah-Al-Zubaer Imran

The discriminability of feature representation is the key to open-set face recognition. Previous methods rely on the learnable weights of the classification layer that represent the identities. However, the evaluation process learns no…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Youzhe Song , Feng Wang

Unsupervised person re-identification (re-ID) has attracted increasing research interests because of its scalability and possibility for real-world applications. State-of-the-art unsupervised re-ID methods usually follow a clustering-based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Tianyang Liu , Yutian Lin , Bo Du

Recently, contrastive self-supervised learning has become a key component for learning visual representations across many computer vision tasks and benchmarks. However, contrastive learning in the context of domain adaptation remains…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Mamatha Thota , Georgios Leontidis