中文
相关论文

相关论文: Reconstructing Test Labels from Noisy Loss Functio…

200 篇论文

Label noise poses an important challenge in machine learning, especially in deep learning, in which large models with high expressive power dominate the field. Models of that kind are prone to memorizing incorrect labels, thereby harming…

机器学习 · 计算机科学 2024-01-26 Julian Lienen , Eyke Hüllermeier

Deep neural network can easily overfit to even noisy labels due to its high capacity, which degrades the generalization performance of a model. To overcome this issue, we propose a new approach for learning from noisy labels (LNL) via…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Seulki Park , Hwanjun Song , Daeho Um , Dae Ung Jo , Sangdoo Yun , Jin Young Choi

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

机器学习 · 计算机科学 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

Object grasping is a crucial technology enabling robots to perceive and interact with the environment sufficiently. However, in practical applications, researchers are faced with missing or noisy ground truth while training the…

机器人学 · 计算机科学 2024-09-10 Yangfan Deng , Mengyao Zhang , Yong Zhao

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

机器学习 · 计算机科学 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

In this paper, we consider a novel machine learning problem, that is, learning a classifier from noisy label distributions. In this problem, each instance with a feature vector belongs to at least one group. Then, instead of the true label…

机器学习 · 计算机科学 2017-08-17 Yuya Yoshikawa

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled…

计算机视觉与模式识别 · 计算机科学 2015-04-16 Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , Andrew Rabinovich

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

In recent years, deep neural networks (DNNs) have gained remarkable achievement in computer vision tasks, and the success of DNNs often depends greatly on the richness of data. However, the acquisition process of data and high-quality…

计算机视觉与模式识别 · 计算机科学 2024-04-08 Mengting Li , Chuang Zhu

Many tasks in natural language processing can be viewed as multi-label classification problems. However, most of the existing models are trained with the standard cross-entropy loss function and use a fixed prediction policy (e.g., a…

计算与语言 · 计算机科学 2019-09-11 Jiawei Wu , Wenhan Xiong , William Yang Wang

We prove that the empirical risk of most well-known loss functions factors into a linear term aggregating all labels with a term that is label free, and can further be expressed by sums of the loss. This holds true even for non-smooth,…

机器学习 · 计算机科学 2016-02-11 Giorgio Patrini , Frank Nielsen , Richard Nock , Marcello Carioni

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

机器学习 · 计算机科学 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the…

计算与语言 · 计算机科学 2022-04-21 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

In the real world, data is often noisy, affecting not only the quality of features but also the accuracy of labels. Current research on mitigating label errors stems primarily from advances in deep learning, and a gap exists in exploring…

机器学习 · 计算机科学 2024-05-29 Lukasz Sztukiewicz , Jack Henry Good , Artur Dubrawski

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

机器学习 · 计算机科学 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Class labels used for machine learning are relatable to each other, with certain class labels being more similar to each other than others (e.g. images of cats and dogs are more similar to each other than those of cats and cars). Such…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Gautam Rajendrakumar Gare , John Michael Galeotti

Multi-label classification is the task of assigning a subset of labels to a given query instance. For evaluating such predictions, the set of predicted labels needs to be compared to the ground-truth label set associated with that instance,…

机器学习 · 计算机科学 2020-11-03 Eyke Hüllermeier , Marcel Wever , Eneldo Loza Mencia , Johannes Fürnkranz , Michael Rapp

In many domains, collecting sufficient labeled training data for supervised machine learning requires easily accessible but noisy sources, such as crowdsourcing services or tagged Web data. Noisy labels occur frequently in data sets…

机器学习 · 计算机科学 2018-11-16 Matthew Klawonn , Eric Heim , James Hendler

In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into…

机器学习 · 计算机科学 2024-09-25 Sjoerd de Vries , Dirk Thierens