中文
相关论文

相关论文: Learning from Hard Labels with Additional Supervis…

200 篇论文

Recent studies have shown that regularization techniques using soft labels, e.g., label smoothing, Mixup, and CutMix, not only enhance image classification accuracy but also mitigate miscalibration due to overconfident predictions, and…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Jonghyun Park , Juyeop Kim , Jong-Seok Lee

Deep neural networks tend to memorize noisy labels, severely degrading their generalization performance. Although Mixup has demonstrated effectiveness in improving generalization and robustness, existing Mixup-based methods typically…

机器学习 · 计算机科学 2025-09-16 Qiuhao Liu , Ling Li , Yao Lu , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Learning from imprecise labels such as "animal" or "bird", but making precise predictions like "snow bunting" at inference time is an important capability for any classifier when expertly labeled training data is scarce. Contributions by…

计算机视觉与模式识别 · 计算机科学 2022-01-28 Clemens-Alexander Brust , Björn Barz , Joachim Denzler

Labeling training data is a key bottleneck in the modern machine learning pipeline. Recent weak supervision approaches combine labels from multiple noisy sources by estimating their accuracies without access to ground truth labels; however,…

机器学习 · 统计学 2019-03-15 Paroma Varma , Frederic Sala , Ann He , Alexander Ratner , Christopher Ré

Label distribution (LD) uses the description degree to describe instances, which provides more fine-grained supervision information when learning with label ambiguity. Nevertheless, LD is unavailable in many real-world applications. To…

机器学习 · 计算机科学 2023-03-22 Zhiqiang Kou , Yuheng Jia , Jing Wang , Boyu Shi , Xin Geng

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

机器学习 · 计算机科学 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Extreme classification tasks are multi-label tasks with an extremely large number of labels (tags). These tasks are hard because the label space is usually (i) very large, e.g. thousands or millions of labels, (ii) very sparse, i.e. very…

机器学习 · 计算机科学 2020-12-04 Elham J. Barezi , Iacer Calixto , Kyunghyun Cho , Pascale Fung

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

Annotating datasets is one of the main costs in nowadays supervised learning. The goal of weak supervision is to enable models to learn using only forms of labelling which are cheaper to collect, as partial labelling. This is a type of…

机器学习 · 计算机科学 2021-02-02 Vivien Cabannes , Alessandro Rudi , Francis Bach

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

While deep learning strategies achieve outstanding results in computer vision tasks, one issue remains: The current strategies rely heavily on a huge amount of labeled data. In many real-world problems, it is not feasible to create such an…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Lars Schmarje , Monty Santarossa , Simon-Martin Schröder , Reinhard Koch

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

机器学习 · 计算机科学 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Constraint-based learning reduces the burden of collecting labels by having users specify general properties of structured outputs, such as constraints imposed by physical laws. We propose a novel framework for simultaneously learning these…

机器学习 · 计算机科学 2018-06-01 Hongyu Ren , Russell Stewart , Jiaming Song , Volodymyr Kuleshov , Stefano Ermon

Semi-supervised learning (SSL) constructs classifiers using both labelled and unlabelled data. It leverages information from labelled samples, whose acquisition is often costly or labour-intensive, together with unlabelled data to enhance…

机器学习 · 统计学 2025-12-29 Jinran Wu , You-Gan Wang , Geoffrey J. McLachlan

As data volumes continue to grow, the labelling process increasingly becomes a bottleneck, creating demand for methods that leverage information from unlabelled data. Impressive results have been achieved in semi-supervised learning (SSL)…

机器学习 · 计算机科学 2020-07-07 Ivana Balažević , Carl Allen , Timothy Hospedales

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

机器学习 · 计算机科学 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency…

机器学习 · 计算机科学 2022-06-10 Doyup Lee , Sungwoong Kim , Ildoo Kim , Yeongjae Cheon , Minsu Cho , Wook-Shin Han

Most positive and unlabeled data is subject to selection biases. The labeled examples can, for example, be selected from the positive set because they are easier to obtain or more obviously positive. This paper investigates how learning can…

机器学习 · 计算机科学 2019-07-01 Jessa Bekker , Pieter Robberechts , Jesse Davis

In this paper, we address the limitations of the common data annotation and training methods for objective single-label classification tasks. Typically, when annotating such tasks annotators are only asked to provide a single label for each…

计算与语言 · 计算机科学 2023-11-10 Ben Wu , Yue Li , Yida Mu , Carolina Scarton , Kalina Bontcheva , Xingyi Song

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

机器学习 · 计算机科学 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick