English
Related papers

Related papers: Identifying Incorrect Annotations in Multi-Label C…

200 papers

Multi-label classification (MLC) is a supervised learning problem in which, contrary to standard multiclass classification, an instance can be associated with several class labels simultaneously. In this chapter, we advocate a rule-based…

Machine Learning · Computer Science 2020-12-09 Eneldo Loza Mencía , Johannes Fürnkranz , Eyke Hüllermeier , Michael Rapp

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

This work deviates from easy-to-define class boundaries for object interactions. For the task of object interaction recognition, often captured using an egocentric view, we show that semantic ambiguities in verbs and recognising…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Michael Wray , Davide Moltisanti , Walterio Mayol-Cuevas , Dima Damen

As a means of human-based computation, crowdsourcing has been widely used to annotate large-scale unlabeled datasets. One of the obvious challenges is how to aggregate these possibly noisy labels provided by a set of heterogeneous…

Machine Learning · Computer Science 2020-10-20 Xuan Wei , Daniel Dajun Zeng , Junming Yin

Competitive methods for multi-label classification typically invest in learning labels together. To do so in a beneficial way, analysis of label dependence is often seen as a fundamental step, separate and prior to constructing a…

Machine Learning · Statistics 2017-07-19 Jesse Read , Jaakko Hollmén

High-quality data is crucial for the success of machine learning, but labeling large datasets is often a time-consuming and costly process. While semi-supervised learning can help mitigate the need for labeled data, label quality remains an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Lars Schmarje , Vasco Grossmann , Tim Michels , Jakob Nazarenus , Monty Santarossa , Claudius Zelenka , Reinhard Koch

In this paper, we address the limitations of the common data annotation and training methods for objective single-label classification tasks. Typically, when annotating such tasks annotators are only asked to provide a single label for each…

Computation and Language · Computer Science 2023-11-10 Ben Wu , Yue Li , Yida Mu , Carolina Scarton , Kalina Bontcheva , Xingyi Song

The original ImageNet benchmark enforces a single-label assumption, despite many images depicting multiple objects. This leads to label noise and limits the richness of the learning signal. Multi-label annotations more accurately reflect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Junyu Chen , Md Yousuf Harun , Christopher Kanan

Annotating data for multi-label classification is prohibitively expensive because every category of interest must be confirmed to be present or absent. Recent work on single positive multi-label (SPML) learning shows that it is possible to…

Machine Learning · Computer Science 2023-05-26 Julio Arroyo , Pietro Perona , Elijah Cole

Uncertainty in machine learning models is a timely and vast field of research. In supervised learning, uncertainty can already occur in the first stage of the training process, the annotation phase. This scenario is particularly evident…

Machine Learning · Computer Science 2024-07-24 Katharina Hechinger , Christoph Koller , Xiao Xiang Zhu , Göran Kauermann

The work discusses the use of machine learning algorithms for anomaly detection in medical image analysis and how the performance of these algorithms depends on the number of annotators and the quality of labels. To address the issue of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Hieu H. Pham , Khiem H. Le , Tuan V. Tran , Ha Q. Nguyen

Mislabeled data is a pervasive issue that undermines the performance of machine learning systems in real-world applications. An effective approach to mitigate this problem is to detect mislabeled instances and subject them to special…

Machine Learning · Computer Science 2025-11-05 Ilies Chibane , Thomas George , Pierre Nodet , Vincent Lemaire

Multi-label text classification refers to the problem of assigning each given document its most relevant labels from the label set. Commonly, the metadata of the given documents and the hierarchy of the labels are available in real-world…

Computation and Language · Computer Science 2023-10-24 Yu Zhang , Zhihong Shen , Yuxiao Dong , Kuansan Wang , Jiawei Han

Due to the expensive costs of collecting labels in multi-label classification datasets, partially annotated multi-label classification has become an emerging field in computer vision. One baseline approach to this task is to assume…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Youngwook Kim , Jae Myung Kim , Jieun Jeong , Cordelia Schmid , Zeynep Akata , Jungwoo Lee

Annotating multi-class instances is a crucial task in the field of machine learning. Unfortunately, identifying the correct class label from a long sequence of candidate labels is time-consuming and laborious. To alleviate this problem, we…

Machine Learning · Computer Science 2025-12-05 Meng Wei , Zhongnian Li , Yong Zhou , Qiaoyu Guo , Xinzheng Xu

Multi-label classification is a type of classification task, it is used when there are two or more classes, and the data point we want to predict may belong to none of the classes or all of them at the same time. In the real world, many…

Machine Learning · Computer Science 2021-04-26 Shikun Chen

Real-world data for classification is often labeled by multiple annotators. For analyzing such data, we introduce CROWDLAB, a straightforward approach to utilize any trained classifier to estimate: (1) A consensus label for each example…

Machine Learning · Computer Science 2023-01-30 Hui Wen Goh , Ulyana Tkachenko , Jonas Mueller

Annotated data is an essential ingredient in natural language processing for training and evaluating machine learning models. It is therefore very desirable for the annotations to be of high quality. Recent work, however, has shown that…

Computation and Language · Computer Science 2022-09-27 Jan-Christoph Klie , Bonnie Webber , Iryna Gurevych

This work presents a new strategy for multi-class classification that requires no class-specific labels, but instead leverages pairwise similarity between examples, which is a weaker form of annotation. The proposed method, meta…

Machine Learning · Computer Science 2019-01-04 Yen-Chang Hsu , Zhaoyang Lv , Joel Schlosser , Phillip Odom , Zsolt Kira

In the field of image classification, existing methods often struggle with biased or ambiguous data, a prevalent issue in real-world scenarios. Current strategies, including semi-supervised learning and class blending, offer partial…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Lars Schmarje , Vasco Grossmann , Claudius Zelenka , Johannes Brünger , Reinhard Koch