English
Related papers

Related papers: Learning from Imperfect Text Guidance: Robust Long…

200 papers

Long-tailed semi-supervised learning (LTSSL) presents a formidable challenge where models must overcome the scarcity of tail samples while mitigating the noise from unreliable pseudo-labels. Most prior LTSSL methods are designed to train…

Machine Learning · Computer Science 2026-04-09 Zhiyuan Huang , Jiahao Chen , Bing Su

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

We study Label Smoothing (LS), a widely used regularization technique, in the context of neural learning to rank (L2R) models. LS combines the ground-truth labels with a uniform distribution, encouraging the model to be less confident in…

Information Retrieval · Computer Science 2020-12-17 Gustavo Penha , Claudia Hauff

Real-world training data usually exhibits long-tailed distribution, where several majority classes have a significantly larger number of samples than the remaining minority classes. This imbalance degrades the performance of typical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Shuang Li , Kaixiong Gong , Chi Harold Liu , Yulin Wang , Feng Qiao , Xinjing Cheng

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Deep neural networks are known to be data-driven and label noise can have a marked impact on model performance. Recent studies have shown great robustness to classic image recognition even under a high noisy rate. In medical applications,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Lie Ju , Xin Wang , Lin Wang , Dwarikanath Mahapatra , Xin Zhao , Mehrtash Harandi , Tom Drummond , Tongliang Liu , Zongyuan Ge

Long-Tailed Semi-Supervised Learning (LTSSL) aims to learn from class-imbalanced data where only a few samples are annotated. Existing solutions typically require substantial cost to solve complex optimization problems, or class-balanced…

Machine Learning · Computer Science 2022-05-27 Tong Wei , Qian-Yu Liu , Jiang-Xin Shi , Wei-Wei Tu , Lan-Zhe Guo

Learning an effective representation in multi-label text classification (MLTC) is a significant challenge in NLP. This challenge arises from the inherent complexity of the task, which is shaped by two key factors: the intricate connections…

Machine Learning · Computer Science 2024-04-16 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Aggregating multiple sources of weak supervision (WS) can ease the data-labeling bottleneck prevalent in many machine learning applications, by replacing the tedious manual collection of ground truth labels. Current state of the art…

Machine Learning · Computer Science 2021-12-01 Salva Rühling Cachay , Benedikt Boecking , Artur Dubrawski

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

Machine Learning · Computer Science 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

In this paper, we consider a new low-quality label learning problem: learning time series detection models from temporally imprecise labels. In this problem, the data consist of a set of input time series, and supervision is provided by a…

Machine Learning · Statistics 2017-04-14 Roy J. Adams , Benjamin M. Marlin

Accurate segmentation of Optical Coherence Tomography (OCT) images is crucial for diagnosing and monitoring retinal diseases. However, the labor-intensive nature of pixel-level annotation limits the scalability of supervised learning for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jiaqi Yang , Nitish Mehta , Xiaoling Hu , Chao Chen , Chia-Ling Tsai

Learning generic joint representations for video and text by a supervised method requires a prohibitively substantial amount of manually annotated video datasets. As a practical alternative, a large-scale but uncurated and narrated video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Dohwan Ko , Joonmyung Choi , Juyeon Ko , Shinyeong Noh , Kyoung-Woon On , Eun-Sol Kim , Hyunwoo J. Kim

Virtually all of deep learning literature relies on the assumption of large amounts of available training data. Indeed, even the majority of few-shot learning methods rely on a large set of "base classes" for pretraining. This assumption,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Ziqi Pang , Zhiyuan Hu , Pavel Tokmakov , Yu-Xiong Wang , Martial Hebert

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

Computation and Language · Computer Science 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable;…

Extreme Multi-label Text Classification (XMTC) has been a tough challenge in machine learning research and applications due to the sheer sizes of the label spaces and the severe data scarce problem associated with the long tail of rare…

Machine Learning · Computer Science 2022-04-05 Ruohong Zhang , Yau-Shian Wang , Yiming Yang , Donghan Yu , Tom Vu , Likun Lei

Weakly supervised learning is a popular approach for training machine learning models in low-resource settings. Instead of requesting high-quality yet costly human annotations, it allows training models with noisy annotations obtained from…

Computation and Language · Computer Science 2023-09-19 Dawei Zhu , Xiaoyu Shen , Marius Mosbach , Andreas Stephan , Dietrich Klakow

Long-tailed datasets are very frequently encountered in real-world use cases where few classes or categories (known as majority or head classes) have higher number of data samples compared to the other classes (known as minority or tail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Saptarshi Sinha , Hiroki Ohashi , Katsuyuki Nakamura

Noisy labels hurt deep learning-based supervised image classification performance as the models may overfit the noise and learn corrupted feature extractors. For natural image classification training with noisy labeled data, model…

Image and Video Processing · Electrical Eng. & Systems 2023-08-10 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian A. Linte