English
Related papers

Related papers: Contrastive Label Disambiguation for Self-Supervis…

200 papers

Domain adaptive object re-ID aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain to tackle the open-class re-identification problems. Although state-of-the-art pseudo-label-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yixiao Ge , Feng Zhu , Dapeng Chen , Rui Zhao , Hongsheng Li

The perception of autonomous vehicles using radars has attracted increased research interest due its ability to operate in fog and bad weather. However, training radar models is hindered by the cost and difficulty of annotating large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yiduo Hao , Sohrab Madani , Junfeng Guan , Mohammed Alloulah , Saurabh Gupta , Haitham Hassanieh

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal;…

Machine Learning · Computer Science 2024-08-06 Min Gu Kwak , Hyungu Kahng , Seoung Bum Kim

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Alvaro Gomariz , Huanxiang Lu , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Fethallah Benmansour , Alessandra M. Valcarcel , Jennifer Luu , Daniela Ferrara , Orcun Goksel

Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of…

Machine Learning · Computer Science 2023-12-21 Wenlong Ji , Zhun Deng , Ryumei Nakada , James Zou , Linjun Zhang

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

Recently, contrastive learning has largely advanced the progress of unsupervised visual representation learning. Pre-trained on ImageNet, some self-supervised algorithms reported higher transfer learning performance compared to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Longhui Wei , Lingxi Xie , Jianzhong He , Jianlong Chang , Xiaopeng Zhang , Wengang Zhou , Houqiang Li , Qi Tian

Robust radio signal recognition is fundamental to spectrum management, electromagnetic space security, and intelligent wireless applications, yet existing deep-learning methods rely heavily on large labeled datasets and struggle to capture…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Shilian Zheng , Jie Chen , Luxin Zhang , Xiaoniu Yang

Road network and trajectory representation learning are essential for traffic systems since the learned representation can be directly used in various downstream tasks (e.g., traffic speed inference, and travel time estimation). However,…

Machine Learning · Computer Science 2023-02-14 Zhenyu Mao , Ziyue Li , Dedong Li , Lei Bai , Rui Zhao

Terrain traversability analysis is a fundamental issue to achieve the autonomy of a robot at off-road environments. Geometry-based and appearance-based methods have been studied in decades, while behavior-based methods exploiting learning…

Robotics · Computer Science 2022-01-21 Zeyu Zhu , Nan Li , Ruoyu Sun , Huijing Zhao , Donghao Xu

Contrastive pretraining techniques for text classification has been largely studied in an unsupervised setting. However, oftentimes labeled data from related tasks which share label semantics with current task is available. We hypothesize…

Computation and Language · Computer Science 2021-12-22 Samujjwal Ghosh , Subhadeep Maji , Maunendra Sankar Desarkar

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aritra Ghosh , Andrew Lan

To safely deploy autonomous vehicles, onboard perception systems must work reliably at high accuracy across a diverse set of environments and geographies. One of the most common techniques to improve the efficacy of such systems in new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Benjamin Caine , Rebecca Roelofs , Vijay Vasudevan , Jiquan Ngiam , Yuning Chai , Zhifeng Chen , Jonathon Shlens

In cross-lingual named entity recognition (NER), self-training is commonly used to bridge the linguistic gap by training on pseudo-labeled target-language data. However, due to sub-optimal performance on target languages, the pseudo labels…

Computation and Language · Computer Science 2023-06-06 Ran Zhou , Xin Li , Lidong Bing , Erik Cambria , Chunyan Miao

We present a novel unsupervised domain adaptation method for semantic segmentation that generalizes a model trained with source images and corresponding ground-truth labels to a target domain. A key to domain adaptive semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Geon Lee , Chanho Eom , Wonkyung Lee , Hyekang Park , Bumsub Ham

Recently, vehicle re-identification methods based on deep learning constitute remarkable achievement. However, this achievement requires large-scale and well-annotated datasets. In constructing the dataset, assigning globally available…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Jongmin Yu , Junsik Kim , Minkyung Kim , Hyeontaek Oh

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon