中文
相关论文

相关论文: How does Disagreement Help Generalization against …

200 篇论文

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled…

计算机视觉与模式识别 · 计算机科学 2015-04-16 Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , Andrew Rabinovich

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

计算机视觉与模式识别 · 计算机科学 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas

Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could…

机器学习 · 计算机科学 2023-01-09 Mingcai Chen , Hao Cheng , Yuntao Du , Ming Xu , Wenyu Jiang , Chongjun Wang

Learning with curriculum has shown great effectiveness in tasks where the data contains noisy (corrupted) labels, since the curriculum can be used to re-weight or filter out noisy samples via proper design. However, obtaining curriculum…

机器学习 · 计算机科学 2020-12-29 Mengying Sun , Jing Xing , Bin Chen , Jiayu Zhou

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Supervised learning of deep neural networks heavily relies on large-scale datasets annotated by high-quality labels. In contrast, mislabeled samples can significantly degrade the generalization of models and result in memorizing samples,…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang

It is crucial to distinguish mislabeled samples for dealing with noisy labels. Previous methods such as Coteaching and JoCoR introduce two different networks to select clean samples out of the noisy ones and only use these clean ones to…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Rumeng Yi , Yaping Huang

Noisy Labels are commonly present in data sets automatically collected from the internet, mislabeled by non-specialist annotators, or even specialists in a challenging task, such as in the medical field. Although deep learning models have…

机器学习 · 计算机科学 2020-12-08 Filipe R. Cordeiro , Gustavo Carneiro

Due to the memorization effect in Deep Neural Networks (DNNs), training with noisy labels usually results in inferior model performance. Existing state-of-the-art methods primarily adopt a sample selection strategy, which selects small-loss…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Yazhou Yao , Zeren Sun , Chuanyi Zhang , Fumin Shen , Qi Wu , Jian Zhang , Zhenmin Tang

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

机器学习 · 计算机科学 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Recent advances in deep learning have relied on large, labelled datasets to train high-capacity models. However, collecting large datasets in a time- and cost-efficient manner often results in label noise. We present a method for learning…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Ahmet Iscen , Jack Valmadre , Anurag Arnab , Cordelia Schmid

We propose self-teaching networks to improve the generalization capacity of deep neural networks. The idea is to generate soft supervision labels using the output layer for training the lower layers of the network. During the network…

音频与语音处理 · 电气工程与系统科学 2019-09-11 Liang Lu , Eric Sun , Yifan Gong

We introduce collaborative learning in which multiple classifier heads of the same network are simultaneously trained on the same training data to improve generalization and robustness to label noise with no extra inference cost. It…

机器学习 · 统计学 2018-11-08 Guocong Song , Wei Chai

Learning with noisy labels is a vital topic for practical deep learning as models should be robust to noisy open-world datasets in the wild. The state-of-the-art noisy label learning approach JoCoR fails when faced with a large ratio of…

计算机视觉与模式识别 · 计算机科学 2022-12-27 Yuhang Zhang , Weihong Deng , Xingchen Cui , Yunfeng Yin , Hongzhi Shi , Dongchao Wen

Contrastive learning has shown outstanding performances in both supervised and unsupervised learning, and has recently been introduced to solve weakly supervised learning problems such as semi-supervised learning and noisy label learning.…

机器学习 · 计算机科学 2023-06-08 Jingyi Cui , Weiran Huang , Yifei Wang , Yisen Wang

Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy…

机器学习 · 计算机科学 2022-03-11 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Deep neural networks are known to be annotation-hungry. Numerous efforts have been devoted to reducing the annotation cost when learning with deep networks. Two prominent directions include learning with noisy labels and semi-supervised…

计算机视觉与模式识别 · 计算机科学 2020-02-20 Junnan Li , Richard Socher , Steven C. H. Hoi

Deep neural networks (DNNs) trained on large-scale datasets have exhibited significant performance in image classification. Many large-scale datasets are collected from websites, however they tend to contain inaccurate labels that are…

计算机视觉与模式识别 · 计算机科学 2019-04-23 Daiki Tanaka , Daiki Ikami , Toshihiko Yamasaki , Kiyoharu Aizawa

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

机器学习 · 计算机科学 2021-11-11 Abhishek Kumar , Ehsan Amid