English
Related papers

Related papers: Not All Data are Good Labels: On the Self-supervis…

200 papers

We present a novel data-efficient semi-supervised framework to improve the generalization of image captioning models. Constructing a large-scale labeled image captioning dataset is an expensive task in terms of labor, time, and cost. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Dong-Jin Kim , Tae-Hyun Oh , Jinsoo Choi , In So Kweon

Semi-supervised multi-label learning (SSMLL) aims to address the challenge of limited labeled data in multi-label learning (MLL) by leveraging unlabeled data to improve the model's performance. While pseudo-labeling has become a dominant…

Machine Learning · Computer Science 2025-12-03 Bo Han , Zhuoming Li , Xiaoyu Wang , Yaxin Hou , Hui Liu , Junhui Hou , Yuheng Jia

This paper briefly reviews the connections between meta-learning and self-supervised learning. Meta-learning can be applied to improve model generalization capability and to construct general AI algorithms. Self-supervised learning utilizes…

Machine Learning · Computer Science 2021-11-17 Huimin Peng

With the advent of billion-parameter foundation models, efficient fine-tuning has become increasingly important for the adaptation of models to downstream tasks. However, especially in computer vision, it can be hard to achieve good…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Alfonso Taboada Warmerdam , Mathilde Caron , Yuki M. Asano

We introduce LiDAR-UDA, a novel two-stage self-training-based Unsupervised Domain Adaptation (UDA) method for LiDAR segmentation. Existing self-training methods use a model trained on labeled source data to generate pseudo labels for target…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Amirreza Shaban , JoonHo Lee , Sanghun Jung , Xiangyun Meng , Byron Boots

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

Machine Learning · Statistics 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

For a self-driving car to operate reliably, its perceptual system must generalize to the end-user's environment -- ideally without additional annotation efforts. One potential solution is to leverage unlabeled data (e.g., unlabeled LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yurong You , Cheng Perng Phoo , Katie Z Luo , Travis Zhang , Wei-Lun Chao , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

Machine Learning · Computer Science 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng

Deep neural networks have achieved remarkable performance across various tasks when supplied with large-scale labeled data. However, the collection of labeled data can be time-consuming and labor-intensive. Semi-supervised learning (SSL),…

Machine Learning · Computer Science 2024-06-28 Chaoqi Liang , Guanglei Yang , Lifeng Qiao , Zitong Huang , Hongliang Yan , Yunchao Wei , Wangmeng Zuo

In this work, we propose a simple yet effective meta-learning algorithm in semi-supervised learning. We notice that most existing consistency-based approaches suffer from overfitting and limited model generalization ability, especially when…

Machine Learning · Computer Science 2021-03-18 Xin-Yu Zhang , Taihong Xiao , Haolin Jia , Ming-Ming Cheng , Ming-Hsuan Yang

In semantic segmentation, the creation of pixel-level labels for training data incurs significant costs. To address this problem, semi-supervised learning, which utilizes a small number of labeled images alongside unlabeled images to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Takahiro Mano , Reiji Saito , Kazuhiro Hotta

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

Supervised learning of deep neural networks heavily relies on large-scale datasets annotated by high-quality labels. In contrast, mislabeled samples can significantly degrade the generalization of models and result in memorizing samples,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang

Supervised learning algorithms based on Convolutional Neural Networks have become the benchmark for medical image segmentation tasks, but their effectiveness heavily relies on a large amount of labeled data. However, annotating medical…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Tao Wang , Yuanbin Chen , Xinlin Zhang , Yuanbo Zhou , Junlin Lan , Bizhe Bai , Tao Tan , Min Du , Qinquan Gao , Tong Tong

Anomaly detection in time-series has a wide range of practical applications. While numerous anomaly detection methods have been proposed in the literature, a recent survey concluded that no single method is the most accurate across various…

Machine Learning · Computer Science 2023-03-14 Mononito Goswami , Cristian Challu , Laurent Callot , Lenon Minorics , Andrey Kan

Semi-supervised learning is a challenging problem which aims to construct a model by learning from a limited number of labeled examples. Numerous methods have been proposed to tackle this problem, with most focusing on utilizing the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Peng Tu , Yawen Huang , Rongrong Ji , Feng Zheng , Ling Shao

While supervised techniques in re-identification are extremely effective, the need for large amounts of annotations makes them impractical for large camera networks. One-shot re-identification, which uses a singular labeled tracklet for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Dripta S. Raychaudhuri , Amit K. Roy-Chowdhury

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

Machine Learning · Computer Science 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo