English
Related papers

Related papers: Safe Semi-Supervised Contrastive Learning Using In…

200 papers

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention. Self-supervised learning followed by the supervised fine-tuning on a few labeled examples can…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Wentao Zhu , Hang Shang , Tingxun Lv , Chao Liao , Sen Yang , Ji Liu

Contrastive learning between different views of the data achieves outstanding success in the field of self-supervised representation learning and the learned representations are useful in broad downstream tasks. Since all supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Haoqing Wang , Xun Guo , Zhi-Hong Deng , Yan Lu

To overcome the data-hungry challenge, we have proposed a semi-supervised contrastive learning framework for the task of class-imbalanced semantic segmentation. First and foremost, to make the model operate in a semi-supervised manner, we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kangcheng Liu

Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic…

Computation and Language · Computer Science 2022-01-24 Wenxuan Zhou , Fangyu Liu , Muhao Chen

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of unclassified data, to perform a classification in situations when, typically, there is little labeled data. Even though this is not…

Machine Learning · Statistics 2020-12-11 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

Semi-Supervised Learning (SSL) under class distribution mismatch aims to tackle a challenging problem wherein unlabeled data contain lots of unknown categories unseen in the labeled ones. In such mismatch scenarios, traditional SSL suffers…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Pan Du , Suyun Zhao , Zisen Sheng , Cuiping Li , Hong Chen

Semi-supervised learning aims to boost the accuracy of a model by exploring unlabeled images. The state-of-the-art methods are consistency-based which learn about unlabeled images by encouraging the model to give consistent predictions for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Rongchang Xie , Chunyu Wang , Wenjun Zeng , Yizhou Wang

Existing semi-supervised learning (SSL) methods assume that labeled and unlabeled data share the same class space. However, in real-world applications, unlabeled data always contain classes not present in the labeled set, which may cause…

Machine Learning · Computer Science 2024-01-17 Wenjuan Xi , Xin Song , Weili Guo , Yang Yang

Anomaly detection (AD), separating anomalies from normal data, has many applications across domains, from security to healthcare. While most previous works were shown to be effective for cases with fully or partially labeled data, that…

Machine Learning · Computer Science 2022-08-08 Jinsung Yoon , Kihyuk Sohn , Chun-Liang Li , Sercan O. Arik , Chen-Yu Lee , Tomas Pfister

Graph classification is a widely studied problem and has broad applications. In many real-world problems, the number of labeled graphs available for training classification models is limited, which renders these models prone to overfitting.…

Machine Learning · Computer Science 2020-09-15 Jiaqi Zeng , Pengtao Xie

In the 21st-century information age, with the development of big data technology, effectively extracting valuable information from massive data has become a key issue. Traditional data mining methods are inadequate when faced with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Aoran Shen , Minghao Dai , Jiacheng Hu , Yingbin Liang , Shiru Wang , Junliang Du

Using unlabeled data to regularize the machine learning models has demonstrated promise for improving safety and reliability in detecting out-of-distribution (OOD) data. Harnessing the power of unlabeled in-the-wild data is non-trivial due…

Machine Learning · Computer Science 2024-02-07 Xuefeng Du , Zhen Fang , Ilias Diakonikolas , Yixuan Li

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Unsupervised person re-identification (re-ID) aims at closing the performance gap to supervised methods. These methods build reliable relationship between data points while learning representations. However, we empirically show that the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Xuanyu He , Wei Zhang , Ran Song , Qian Zhang , Xiangyuan Lan , Lin Ma

Semisupervised learning is a learning standard which deals with the study of how computers and natural systems such as human beings acquire knowledge in the presence of both labeled and unlabeled data. Semisupervised learning based methods…

Machine Learning · Computer Science 2014-02-20 V. Jothi Prakash , Dr. L. M. Nithya

A common classification task situation is where one has a large amount of data available for training, but only a small portion is annotated with class labels. The goal of semi-supervised training, in this context, is to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Zijian Hu , Zhengyu Yang , Xuefeng Hu , Ram Nevatia

Recently, self-supervised learning has attracted great attention, since it only requires unlabeled data for model training. Contrastive learning is one popular method for self-supervised learning and has achieved promising empirical…

Machine Learning · Computer Science 2023-03-03 Weiran Huang , Mingyang Yi , Xuyang Zhao , Zihao Jiang

Recent semi-supervised learning algorithms have demonstrated greater success with higher overall performance due to better-unlabeled data representations. Nonetheless, recent research suggests that the performance of the SSL algorithm can…

Machine Learning · Computer Science 2023-02-02 Xujiang Zhao , Killamsetty Krishnateja , Rishabh Iyer , Feng Chen

Learning time-series representations when only unlabeled data or few labeled samples are available can be a challenging task. Recently, contrastive self-supervised learning has shown great improvement in extracting useful representations…

Machine Learning · Computer Science 2023-09-06 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li , Cuntai Guan