English
Related papers

Related papers: Transferring Annotator- and Instance-dependent Tra…

200 papers

Test-time adaptation (TTA) methods, which generally rely on the model's predictions (e.g., entropy minimization) to adapt the source pretrained model to the unlabeled target domain, suffer from noisy signals originating from 1) incorrect or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jungsoo Lee , Debasmit Das , Jaegul Choo , Sungha Choi

Federated learning (FL) with noisy labels poses a significant challenge. Existing methods designed for handling noisy labels in centralized learning tend to lose their effectiveness in the FL setting, mainly due to the small dataset size…

Machine Learning · Computer Science 2024-01-11 Lei Wang , Jieming Bian , Jie Xu

Manual annotations are a prerequisite for many applications of machine learning. However, weaknesses in the annotation process itself are easy to overlook. In particular, scholars often choose what information to give to annotators without…

Social and Information Networks · Computer Science 2017-08-22 Kenneth Joseph , Lisa Friedland , William Hobbs , Oren Tsur , David Lazer

State-of-the-art methods for counting people in crowded scenes rely on deep networks to estimate crowd density. While effective, these data-driven approaches rely on large amount of data annotation to achieve good performance, which stops…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Weizhe Liu , Nikita Durasov , Pascal Fua

While crowdsourcing has emerged as a practical solution for labeling large datasets, it presents a significant challenge in learning accurate models due to noisy labels from annotators with varying levels of expertise. Existing methods…

Machine Learning · Computer Science 2024-11-27 Hui Guo , Grace Y. Yi , Boyu Wang

Crowdsourcing has emerged as an alternative solution for collecting large scale labels. However, the majority of recruited workers are not domain experts, so their contributed labels could be noisy. In this paper, we propose a two-stage…

Methodology · Statistics 2023-09-28 Qi Xu , Yubai Yuan , Junhui Wang , Annie Qu

Learning from noisy-labeled data is crucial for real-world applications. Traditional Noisy-Label Learning (NLL) methods categorize training data into clean and noisy sets based on the loss distribution of training samples. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Po-Hsuan Huang , Chia-Ching Lin , Chih-Fan Hsu , Ming-Ching Chang , Wei-Chao Chen

High-quality human annotations are necessary for creating effective machine learning-driven stream processing systems. We study hybrid stream processing systems based on a Human-In-The-Loop Machine Learning (HITL-ML) paradigm, in which one…

Human-Computer Interaction · Computer Science 2022-01-19 Rahul Pandey , Hemant Purohit , Carlos Castillo , Valerie L. Shalin

Learning from real-world data is frequently hindered by the compound challenge of long-tailed class distributions and noisy annotations. Existing methods partially address these issues but typically ignore the non-uniform impact of label…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mengke Li , Haiquan Ling , Lihao Chen , Yang Lu , Yiqun Zhang , Hui Huang

Accurately annotating large scale dataset is notoriously expensive both in time and in money. Although acquiring low-quality-annotated dataset can be much cheaper, it often badly damages the performance of trained models when using such…

Machine Learning · Computer Science 2019-11-05 Yilun Xu , Peng Cao , Yuqing Kong , Yizhou Wang

Training a deep neural network heavily relies on a large amount of training data with accurate annotations. To alleviate this problem, various methods have been proposed to annotate the data automatically. However, automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Yi Wei , Xue Mei , Xin Liu , Pengxiang Xu

Generalization is an important attribute of machine learning models, particularly for those that are to be deployed in a medical context, where unreliable predictions can have real world consequences. While the failure of models to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Brennan Nichyporuk , Jillian Cardinell , Justin Szeto , Raghav Mehta , Jean-Pierre R. Falet , Douglas L. Arnold , Sotirios A. Tsaftaris , Tal Arbel

Domain Adaptive Object Detection (DAOD) models a joint distribution of images and labels from an annotated source domain and learns a domain-invariant transformation to estimate the target labels with the given target domain images.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Xinyu Liu , Wuyang Li , Qiushi Yang , Baopu Li , Yixuan Yuan

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Görkem Algan , İlkay Ulusoy

Robust training with noisy labels is a critical challenge in image classification, offering the potential to reduce reliance on costly clean-label datasets. Real-world datasets often contain a mix of in-distribution (ID) and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Arpit Garg , Cuong Nguyen , Rafael Felix , Yuyuan Liu , Thanh-Toan Do , Gustavo Carneiro

The state-of-the-art methods for drum transcription in the presence of melodic instruments (DTM) are machine learning models trained in a supervised manner, which means that they rely on labeled datasets. The problem is that the available…

Sound · Computer Science 2021-11-24 Mickael Zehren , Marco Alunno , Paolo Bientinesi

Artificial Intelligence of Things (AIoT) is an emerging frontier based on the deep fusion of Internet of Things (IoT) and Artificial Intelligence (AI) technologies. Although advanced deep learning techniques enhance the efficient data…

Machine Learning · Computer Science 2024-07-10 Yan Liu , Bin Guo , Nuo Li , Yasan Ding , Zhouyangzi Zhang , Zhiwen Yu

Label noise refers to incorrect labels in a dataset caused by human errors or collection defects, which is common in real-world applications and can significantly reduce the accuracy of models. This report explores how to estimate noise…

Machine Learning · Computer Science 2025-01-03 Haixu Liu , Zerui Tao , Naihui Zhang , Sixing Liu

Crowdsourcing is a popular means to obtain labeled data at moderate costs, for example for tweets, which can then be used in text mining tasks. To alleviate the problem of low-quality labels in this context, multiple human factors have been…

Human-Computer Interaction · Computer Science 2018-08-02 Stefan Räbiger , Yücel Saygın , Myra Spiliopoulou

High-quality data is necessary for modern machine learning. However, the acquisition of such data is difficult due to noisy and ambiguous annotations of humans. The aggregation of such annotations to determine the label of an image leads to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Lars Schmarje , Vasco Grossmann , Claudius Zelenka , Sabine Dippel , Rainer Kiko , Mariusz Oszust , Matti Pastell , Jenny Stracke , Anna Valros , Nina Volkmann , Reinhard Koch