中文
相关论文

相关论文: Learning Improved Representations by Transferring …

200 篇论文

High-quality data is a key aspect of modern machine learning. However, labels generated by humans suffer from issues like label noise and class ambiguities. We raise the question of whether hard labels are sufficient to represent the…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Vasco Grossmann , Lars Schmarje , Reinhard Koch

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

机器学习 · 计算机科学 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

机器学习 · 计算机科学 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

机器学习 · 计算机科学 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

Label noise poses an important challenge in machine learning, especially in deep learning, in which large models with high expressive power dominate the field. Models of that kind are prone to memorizing incorrect labels, thereby harming…

机器学习 · 计算机科学 2024-01-26 Julian Lienen , Eyke Hüllermeier

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge.…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

Transfer learning is a powerful way to adapt existing deep learning models to new emerging use-cases in remote sensing. Starting from a neural network already trained for semantic segmentation, we propose to modify its label space to…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Gaston Lenczner , Adrien Chan-Hon-Tong , Nicola Luminari , Bertrand Le Saux

It is crucial to distinguish mislabeled samples for dealing with noisy labels. Previous methods such as Coteaching and JoCoR introduce two different networks to select clean samples out of the noisy ones and only use these clean ones to…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Rumeng Yi , Yaping Huang

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Görkem Algan , İlkay Ulusoy

Overconfidence is a common issue for deep neural networks, limiting their deployment in real-world applications. To better estimate confidence, existing methods mostly focus on fully-supervised scenarios and rely on training labels. In this…

机器学习 · 计算机科学 2023-07-21 Chen Li , Xiaoling Hu , Chao Chen

Semi-supervised learning is becoming increasingly important because it can combine data carefully labeled by humans with abundant unlabeled data to train deep neural networks. Classic methods on semi-supervised learning that have focused on…

计算机视觉与模式识别 · 计算机科学 2019-09-20 Ahmet Iscen , Giorgos Tolias , Yannis Avrithis , Ondrej Chum

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

机器学习 · 计算机科学 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

We propose to transfer representational knowledge from multiple sources to a target noisy matrix completion task by aggregating singular subspaces information. Under our representational similarity framework, we first integrate linear…

机器学习 · 统计学 2024-12-10 Yong He , Zeyu Li , Dong Liu , Kangxiang Qin , Jiahui Xie

The recent success of deep neural networks is powered in part by large-scale well-labeled training data. However, it is a daunting task to laboriously annotate an ImageNet-like dateset. On the contrary, it is fairly convenient, fast, and…

计算机视觉与模式识别 · 计算机科学 2018-03-23 Yifan Ding , Liqiang Wang , Deliang Fan , Boqing Gong

In this paper, we answer the question of when inserting label noise (less informative labels) can instead return us more accurate and fair models. We are primarily inspired by three observations: 1) In contrast to reducing label noise…

机器学习 · 计算机科学 2021-11-09 Yang Liu , Jialu Wang

We find that the way we choose to represent data labels can have a profound effect on the quality of trained models. For example, training an image classifier to regress audio labels rather than traditional categorical probabilities…

机器学习 · 计算机科学 2021-04-07 Boyuan Chen , Yu Li , Sunand Raghupathi , Hod Lipson

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Mislabeled samples are ubiquitous in real-world datasets as rule-based or expert labeling is usually based on incorrect assumptions or subject to biased opinions. Neural networks can "memorize" these mislabeled samples and, as a result,…

机器学习 · 计算机科学 2021-11-24 Katharina Rombach , Gabriel Michau , Olga Fink

Labeling and maintaining a commercial sound effects library is a time-consuming task exacerbated by databases that continually grow in size and undergo taxonomy updates. Moreover, sound search and taxonomy creation are complicated by…

声音 · 计算机科学 2022-08-22 Alison B. Ma , Alexander Lerch