English
Related papers

Related papers: Learning from Stochastic Labels

200 papers

We tackle the problem of discovering novel classes in an image collection given labelled examples of other classes. This setting is similar to semi-supervised learning, but significantly harder because there are no labelled examples for the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Kai Han , Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Andrea Vedaldi , Andrew Zisserman

In this paper, we study the classification problem in which we have access to easily obtainable surrogate for true labels, namely complementary labels, which specify classes that observations do \textbf{not} belong to. Let $Y$ and $\bar{Y}$…

Machine Learning · Statistics 2018-08-09 Xiyu Yu , Tongliang Liu , Mingming Gong , Dacheng Tao

Noisy training labels can hurt model performance. Most approaches that aim to address label noise assume label noise is independent from the input features. In practice, however, label noise is often feature or \textit{instance-dependent},…

Machine Learning · Computer Science 2023-07-12 Donna Tjandra , Jenna Wiens

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

While neural networks trained for semantic segmentation are essential for perception in autonomous driving, most current algorithms assume a fixed number of classes, presenting a major limitation when developing new autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Marvin Klingner , Andreas Bär , Philipp Donn , Tim Fingscheidt

Due to the expensive costs of collecting labels in multi-label classification datasets, partially annotated multi-label classification has become an emerging field in computer vision. One baseline approach to this task is to assume…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Youngwook Kim , Jae Myung Kim , Jieun Jeong , Cordelia Schmid , Zeynep Akata , Jungwoo Lee

As the number of applications that use machine learning algorithms increases, the need for labeled data useful for training such algorithms intensifies. Getting labels typically involves employing humans to do the annotation, which directly…

Machine Learning · Computer Science 2013-07-16 Alexandros Ntoulas , Omar Alonso , Vasilis Kandylas

Long-term test-time adaptation (TTA) is a challenging task due to error accumulation. Recent approaches tackle this issue by actively labeling a small proportion of samples in each batch, yet the annotation burden quickly grows as the batch…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Guowei Wang , Changxing Ding

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

Machine Learning · Computer Science 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

In this paper, we investigate the problem of learning with noisy labels in real-world annotation scenarios, where noise can be categorized into two types: factual noise and ambiguity noise. To better distinguish these noise types and…

Machine Learning · Computer Science 2023-08-23 Renyu Zhu , Haoyu Liu , Runze Wu , Minmin Lin , Tangjie Lv , Changjie Fan , Haobo Wang

We propose a simulation framework for generating instance-dependent noisy labels via a pseudo-labeling paradigm. We show that the distribution of the synthetic noisy labels generated with our framework is closer to human labels compared to…

Machine Learning · Computer Science 2021-10-19 Keren Gu , Xander Masotto , Vandana Bachani , Balaji Lakshminarayanan , Jack Nikodem , Dong Yin

Sample selection is a prevalent method in learning with noisy labels, where small-loss data are typically considered as correctly labeled data. However, this method may not effectively identify clean hard examples with large losses, which…

Machine Learning · Computer Science 2023-08-29 Suqin Yuan , Lei Feng , Tongliang Liu

Mammogram classification is directly related to computer-aided diagnosis of breast cancer. Traditional methods requires great effort to annotate the training data by costly manual labeling and specialized computational models to detect…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Wentao Zhu , Qi Lou , Yeeleng Scott Vang , Xiaohui Xie

In this paper, we consider the instance segmentation task on a long-tailed dataset, which contains label noise, i.e., some of the annotations are incorrect. There are two main reasons making this case realistic. First, datasets collected…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Guanlin Li , Guowen Xu , Tianwei Zhang

Partial-label learning (PLL) is a typical weakly supervised learning problem, where each training instance is equipped with a set of candidate labels among which only one is the true label. Most existing methods elaborately designed…

Machine Learning · Computer Science 2020-09-08 Jiaqi Lv , Miao Xu , Lei Feng , Gang Niu , Xin Geng , Masashi Sugiyama

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Classifier chains are an effective technique for modeling label dependencies in multi-label classification. However, the method requires a fixed, static order of the labels. While in theory, any order is sufficient, in practice, this order…

Machine Learning · Computer Science 2021-12-14 Eneldo Loza Mencía , Moritz Kulessa , Simon Bohlender , Johannes Fürnkranz

Manual annotations are a prerequisite for many applications of machine learning. However, weaknesses in the annotation process itself are easy to overlook. In particular, scholars often choose what information to give to annotators without…

Social and Information Networks · Computer Science 2017-08-22 Kenneth Joseph , Lisa Friedland , William Hobbs , Oren Tsur , David Lazer

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We…

Machine Learning · Computer Science 2022-02-09 Chidubem Arachie , Bert Huang

Incorporating every annotator's perspective is crucial for unbiased data modeling. Annotator fatigue and changing opinions over time can distort dataset annotations. To combat this, we propose to learn a more accurate representation of…

Machine Learning · Computer Science 2024-06-05 Uthman Jinadu , Yi Ding