中文
相关论文

相关论文: Do We Really Need Gold Samples for Sample Weightin…

200 篇论文

Training deep neural networks(DNN) with noisy labels is challenging since DNN can easily memorize inaccurate labels, leading to poor generalization ability. Recently, the meta-learning based label correction strategy is widely adopted to…

计算机视觉与模式识别 · 计算机科学 2023-02-20 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective…

计算机视觉与模式识别 · 计算机科学 2017-05-10 Ishan Jindal , Matthew Nokleby , Xuewen Chen

We present a new approach and a novel architecture, termed WSNet, for learning compact and efficient deep neural networks. Existing approaches conventionally learn full model parameters independently and then compress them via ad hoc…

计算机视觉与模式识别 · 计算机科学 2018-05-23 Xiaojie Jin , Yingzhen Yang , Ning Xu , Jianchao Yang , Nebojsa Jojic , Jiashi Feng , Shuicheng Yan

Extracting noisy or incorrectly labeled samples from a labeled dataset with hard/difficult samples is an important yet under-explored topic. Two general and often independent lines of work exist, one focuses on addressing noisy labels, and…

机器学习 · 计算机科学 2023-07-21 Mahsa Forouzesh , Patrick Thiran

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

机器学习 · 计算机科学 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Deep neural networks (DNNs) are capable of perfectly fitting the training data, including memorizing noisy data. It is commonly believed that memorization hurts generalization. Therefore, many recent works propose mitigation strategies to…

机器学习 · 统计学 2022-10-28 Carey E. Priebe , Ningyuan Huang , Soledad Villar , Cong Mu , Li Chen

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

机器学习 · 计算机科学 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

Deep neural network can easily overfit to even noisy labels due to its high capacity, which degrades the generalization performance of a model. To overcome this issue, we propose a new approach for learning from noisy labels (LNL) via…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Seulki Park , Hwanjun Song , Daeho Um , Dae Ung Jo , Sangdoo Yun , Jin Young Choi

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

机器学习 · 计算机科学 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

Labeling objects at a subordinate level typically requires expert knowledge, which is not always available when using random annotators. As such, learning directly from web images for fine-grained recognition has attracted broad attention.…

计算机视觉与模式识别 · 计算机科学 2021-01-26 Huafeng Liu , Chuanyi Zhang , Yazhou Yao , Xiushen Wei , Fumin Shen , Jian Zhang , Zhenmin Tang

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

Algorithms which minimize the averaged loss have been widely designed for dealing with noisy labels. Intuitively, when there is a finite training sample, penalizing the variance of losses will improve the stability and generalization of the…

机器学习 · 计算机科学 2022-02-01 Yexiong Lin , Yu Yao , Yuxuan Du , Jun Yu , Bo Han , Mingming Gong , Tongliang Liu

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

机器学习 · 计算机科学 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

Data sets for fairness relevant tasks can lack examples or be biased according to a specific label in a sensitive attribute. We demonstrate the usefulness of weight based meta-learning approaches in such situations. For models that can be…

机器学习 · 计算机科学 2019-11-12 Dylan Slack , Sorelle Friedler , Emile Givental

Noisy labels, inevitably existing in pseudo segmentation labels generated from weak object-level annotations, severely hampers model optimization for semantic segmentation. Previous works often rely on massive hand-crafted losses and…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Shenwang Jiang , Jianan Li , Ying Wang , Wenxuan Wu , Jizhou Zhang , Bo Huang , Tingfa Xu

Label smoothing is commonly used in training deep learning models, wherein one-hot training labels are mixed with uniform label vectors. Empirically, smoothing has been shown to improve both predictive performance and model calibration. In…

机器学习 · 计算机科学 2020-03-06 Michal Lukasik , Srinadh Bhojanapalli , Aditya Krishna Menon , Sanjiv Kumar

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aritra Ghosh , Andrew Lan

Image classification problems are typically addressed by first collecting examples with candidate labels, second cleaning the candidate labels manually, and third training a deep neural network on the clean examples. The manual labeling…

机器学习 · 计算机科学 2020-02-27 Fatih Furkan Yilmaz , Reinhard Heckel

Large Language Models (LLMs) have demonstrated remarkable performance through supervised fine-tuning or in-context learning using gold labels. However, this paradigm is limited by the availability of gold labels, while in certain scenarios,…

计算与语言 · 计算机科学 2024-09-20 Chaoqun Liu , Qin Chao , Wenxuan Zhang , Xiaobao Wu , Boyang Li , Anh Tuan Luu , Lidong Bing

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart