English
Related papers

Related papers: Rank-Aware Negative Training for Semi-Supervised T…

200 papers

Short text clustering is challenging since it takes imbalanced and noisy data as inputs. Existing approaches cannot solve this problem well, since (1) they are prone to obtain degenerate solutions especially on heavy imbalanced datasets,…

Computation and Language · Computer Science 2023-05-29 Xiaolin Zheng , Mengling Hu , Weiming Liu , Chaochao Chen , Xinting Liao

The robust self-training (RST) framework has emerged as a prominent approach for semi-supervised adversarial training. To explore the possibility of tackling more complicated tasks with even lower labeling budgets, unlike prior approaches…

Machine Learning · Computer Science 2024-09-20 Tsung-Han Wu , Hung-Ting Su , Shang-Tse Chen , Winston H. Hsu

The goal of semi-supervised learning is to utilize the unlabeled, in-domain dataset U to improve models trained on the labeled dataset D. Under the context of large-scale language-model (LM) pretraining, how we can make the best use of U is…

Computation and Language · Computer Science 2020-11-20 Zijun Sun , Chun Fan , Xiaofei Sun , Yuxian Meng , Fei Wu , Jiwei Li

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

Computation and Language · Computer Science 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

Deep neural network can easily overfit to even noisy labels due to its high capacity, which degrades the generalization performance of a model. To overcome this issue, we propose a new approach for learning from noisy labels (LNL) via…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seulki Park , Hwanjun Song , Daeho Um , Dae Ung Jo , Sangdoo Yun , Jin Young Choi

Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization. However, its training procedure suffers from confirmation bias due to the noise contained in self-generated artificial labels. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Fan Yang , Kai Wu , Shuyi Zhang , Guannan Jiang , Yong Liu , Feng Zheng , Wei Zhang , Chengjie Wang , Long Zeng

This paper presents a semi-supervised learning framework that is new in being designed for automatic modulation classification (AMC). By carefully utilizing unlabeled signal data with a self-supervised contrastive-learning pre-training…

Machine Learning · Computer Science 2022-03-31 Dongxin Liu , Peng Wang , Tianshi Wang , Tarek Abdelzaher

Neural sequence labeling (NSL) aims at assigning labels for input language tokens, which covers a broad range of applications, such as named entity recognition (NER) and slot filling, etc. However, the satisfying results achieved by…

Computation and Language · Computer Science 2023-02-20 Jianing Wang , Chengyu Wang , Jun Huang , Ming Gao , Aoying Zhou

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Samuli Laine , Timo Aila

Sequence labeling systems should perform reliably not only under ideal conditions but also with corrupted inputs - as these systems often process user-generated text or follow an error-prone upstream component. To this end, we formulate the…

Computation and Language · Computer Science 2020-05-15 Marcin Namysl , Sven Behnke , Joachim Köhler

Neural models have shown several state-of-the-art performances on Semantic Role Labeling (SRL). However, the neural models require an immense amount of semantic-role corpora and are thus not well suited for low-resource languages or…

Computation and Language · Computer Science 2018-08-30 Sanket Vaibhav Mehta , Jay Yoon Lee , Jaime Carbonell

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Deep learning with noisy labels is a challenging task. Recent prominent methods that build on a specific sample selection (SS) strategy and a specific semi-supervised learning (SSL) model achieved state-of-the-art performance. Intuitively,…

Machine Learning · Computer Science 2020-12-03 Zhuowei Wang , Jing Jiang , Bo Han , Lei Feng , Bo An , Gang Niu , Guodong Long

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Semi-supervised learning provides a solution to reduce the dependency of machine learning on labeled data. As one of the efficient semi-supervised techniques, self-training (ST) has received increasing attention. Several advancements have…

Machine Learning · Computer Science 2024-04-22 Jifeng Guo , Zhulin Liu , Tong Zhang , C. L. Philip Chen

Until recently, the number of public real-world text images was insufficient for training scene text recognizers. Therefore, most modern training methods rely on synthetic data and operate in a fully supervised manner. Nevertheless, the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Aviad Aberdam , Roy Ganz , Shai Mazor , Ron Litman

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy

Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yang Zou , Zhiding Yu , Xiaofeng Liu , B. V. K. Vijaya Kumar , Jinsong Wang

Semi-supervised learning aims to leverage a large amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. In this paper, we delve into semi-supervised learning for object detection, where…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zhenyu Wang , Yali Li , Ye Guo , Shengjin Wang

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

Machine Learning · Computer Science 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang