中文
相关论文

相关论文: NTKCPL: Active Learning on Top of Self-Supervised …

200 篇论文

Applied mathematics and machine computations have raised a lot of hope since the recent success of supervised learning. Many practitioners in industries have been trying to switch from their old paradigms to machine learning. Interestingly,…

机器学习 · 计算机科学 2022-09-26 Vivien Cabannes

Neural coreference resolution models trained on one dataset may not transfer to new, low-resource domains. Active learning mitigates this problem by sampling a small subset of data for annotators to label. While active learning is…

计算与语言 · 计算机科学 2022-03-30 Michelle Yuan , Patrick Xia , Chandler May , Benjamin Van Durme , Jordan Boyd-Graber

Semi-supervised learning leverages unlabeled data to enhance model performance, addressing the limitations of fully supervised approaches. Among its strategies, pseudo-supervision has proven highly effective, typically relying on one or…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Negin Ghamsarian , Sahar Nasirihaghighi , Klaus Schoeffmann , Raphael Sznitman

Active Learning (AL) promises to reduce annotation cost by prioritizing informative samples, yet its reliability is undermined when labels are noisy or when the data distribution shifts. In practice, annotators make mistakes, rare…

机器学习 · 计算机科学 2025-10-14 Atharv Goel , Sharat Agarwal , Saket Anand , Chetan Arora

Label scarcity has been a long-standing issue for biomedical image segmentation, due to high annotation costs and professional requirements. Recently, active learning (AL) strategies strive to reduce annotation costs by querying a small…

图像与视频处理 · 电气工程与系统科学 2022-11-02 Ziyuan Zhao , Wenjing Lu , Zeng Zeng , Kaixin Xu , Bharadwaj Veeravalli , Cuntai Guan

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

机器学习 · 计算机科学 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

The remarkable performance of deep neural networks depends on the availability of massive labeled data. To alleviate the load of data annotation, active deep learning aims to select a minimal set of training points to be labelled which…

机器学习 · 计算机科学 2020-03-24 Dan Kushnir , Luca Venturi

We address the challenging problem of Long-Tailed Semi-Supervised Learning (LTSSL) where labeled data exhibit imbalanced class distribution and unlabeled data follow an unknown distribution. Unlike in balanced SSL, the generated…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Chengcheng Ma , Ismail Elezi , Jiankang Deng , Weiming Dong , Changsheng Xu

While deep learning succeeds in a wide range of tasks, it highly depends on the massive collection of annotated data which is expensive and time-consuming. To lower the cost of data annotation, active learning has been proposed to…

计算机视觉与模式识别 · 计算机科学 2022-12-22 Siyu Huang , Tianyang Wang , Haoyi Xiong , Bihan Wen , Jun Huan , Dejing Dou

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

机器学习 · 计算机科学 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

Speaker representation learning is crucial for voice recognition systems, with recent advances in self-supervised approaches reducing dependency on labeled data. Current two-stage iterative frameworks, while effective, suffer from…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Danwei Cai , Zexin Cai , Ze Li , Ming Li

Active learning is a state-of-art machine learning approach to deal with an abundance of unlabeled data. In the field of Natural Language Processing, typically it is costly and time-consuming to have all the data annotated. This…

计算与语言 · 计算机科学 2021-07-19 Yukun Jiang

The recent success of large pre-trained language models (PLMs) heavily hinges on massive labeled data, which typically produces inferior performance in low-resource scenarios. To remedy this dilemma, we study self-training as one of the…

机器学习 · 计算机科学 2023-10-23 Jianing Wang , Qiushi Sun , Nuo Chen , Chengyu Wang , Jun Huang , Ming Gao , Xiang Li

Active learning is the iterative construction of a classification model through targeted labeling, enabling significant labeling cost savings. As most research on active learning has been carried out before transformer-based language models…

计算与语言 · 计算机科学 2022-03-22 Christopher Schröder , Andreas Niekler , Martin Potthast

Supervised machine learning often requires large training sets to train accurate models, yet obtaining large amounts of labeled data is not always feasible. Hence, it becomes crucial to explore active learning methods for reducing the size…

机器学习 · 计算机科学 2024-04-16 Ashna Jose , Emilie Devijver , Massih-Reza Amini , Noel Jakse , Roberta Poloni

Domain adaptive semantic segmentation aims to learn a model with the supervision of source domain data, and produce satisfactory dense predictions on unlabeled target domain. One popular solution to this challenging task is self-training,…

计算机视觉与模式识别 · 计算机科学 2022-03-21 Ruihuang Li , Shuai Li , Chenhang He , Yabin Zhang , Xu Jia , Lei Zhang

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Youshan Zhang , Brian D. Davison

Learning from large amounts of unsupervised data and a small amount of supervision is an important open problem in computer vision. We propose a new semi-supervised learning method, Semantic Positives via Pseudo-Labels (SemPPL), that…

Majorly classical Active Learning (AL) approach usually uses statistical theory such as entropy and margin to measure instance utility, however it fails to capture the data distribution information contained in the unlabeled data. This can…

机器学习 · 计算机科学 2020-12-10 Patrick K. Gikunda , Nicolas Jouandeau

Recent progress in semi- and self-supervised learning has caused a rift in the long-held belief about the need for an enormous amount of labeled data for machine learning and the irrelevancy of unlabeled data. Although it has been…

机器学习 · 计算机科学 2023-03-14 Minwook Kim , Juseong Kim , Giltae Song