English
Related papers

Related papers: Feature-Suppressed Contrast for Self-Supervised Fo…

200 papers

Learning from large amounts of unsupervised data and a small amount of supervision is an important open problem in computer vision. We propose a new semi-supervised learning method, Semantic Positives via Pseudo-Labels (SemPPL), that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Matko Bošnjak , Pierre H. Richemond , Nenad Tomasev , Florian Strub , Jacob C. Walker , Felix Hill , Lars Holger Buesing , Razvan Pascanu , Charles Blundell , Jovana Mitrovic

Bias in computer vision systems can perpetuate or even amplify discrimination against certain populations. Considering that bias is often introduced by biased visual datasets, many recent research efforts focus on training fair models using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos , Christos Diou

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

Ultrasound (US) imaging is clinically invaluable due to its noninvasive and safe nature. However, interpreting US images is challenging, requires significant expertise, and time, and is often prone to errors. Deep learning offers assistive…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Edward Ellis , Andrew Bulpitt , Nasim Parsa , Michael F Byrne , Sharib Ali

Unsupervised aspect detection (UAD) aims at automatically extracting interpretable aspects and identifying aspect-specific segments (such as sentences) from online reviews. However, recent deep learning-based topic models, specifically…

Computation and Language · Computer Science 2021-01-01 Tian Shi , Liuqing Li , Ping Wang , Chandan K. Reddy

Geo-tagged images are publicly available in large quantities, whereas labels such as object classes are rather scarce and expensive to collect. Meanwhile, contrastive learning has achieved tremendous success in various natural image and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Gengchen Mai , Ni Lao , Yutong He , Jiaming Song , Stefano Ermon

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

Self-supervised learning (SSL) has achieved remarkable performance in pretraining the models that can be further used in downstream tasks via fine-tuning. However, these self-supervised models may not capture meaningful semantic information…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Haolin Pan , Yong Guo , Qinyi Deng , Haomin Yang , Yiqun Chen , Jian Chen

Lacking supervised data is an issue while training deep neural networks (DNNs), mainly when considering medical and biological data where supervision is expensive. Recently, Embedded Pseudo-Labeling (EPL) addressed this problem by using a…

Machine Learning · Computer Science 2023-02-07 Bárbara Caroline Benato , Alexandre Xavier Falcão , Alexandru-Cristian Telea

This paper presents a simple yet effective two-stage framework for semi-supervised medical image segmentation. Unlike prior state-of-the-art semi-supervised segmentation methods that predominantly rely on pseudo supervision directly on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Huimin Wu , Xiaomeng Li , Kwang-Ting Cheng

Contrastive learning have been widely used as pretext tasks for self-supervised pre-trained molecular representation learning models in AI-aided drug design and discovery. However, exiting methods that generate molecular views by…

Biomolecules · Quantitative Biology 2023-03-14 Ziqiao Zhang , Ailin Xie , Jihong Guan , Shuigeng Zhou

Semi-supervised semantic segmentation (SSSS) faces persistent challenges in effectively leveraging unlabeled data, such as ineffective utilization of pseudo-labels, exacerbation of class imbalance biases, and neglect of prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ebenezer Tarubinga , Jenifer Kalafatovich , Seong-Whan Lee

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

Machine Learning · Computer Science 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost and can provide…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Boon Peng Yap , Beng Koon Ng

Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are…

Machine Learning · Computer Science 2026-01-27 Viet Anh Khoa Tran , Emre Neftci , Willem A. M. Wybo

Analysis of cardiac ultrasound images is commonly performed in routine clinical practice for quantification of cardiac function. Its increasing automation frequently employs deep learning networks that are trained to predict disease or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Agisilaos Chartsias , Shan Gao , Angela Mumith , Jorge Oliveira , Kanwal Bhatia , Bernhard Kainz , Arian Beqiri

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Ganning Zhao , Tingwei Shen , Suya You , C. -C. Jay Kuo

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He