中文
相关论文

相关论文: Combining Self-Supervised and Supervised Learning …

200 篇论文

Classical machine learning implicitly assumes that labels of the training data are sampled from a clean distribution, which can be too restrictive for real-world scenarios. However, statistical-learning-based methods may not train deep…

机器学习 · 计算机科学 2021-02-23 Bo Han , Quanming Yao , Tongliang Liu , Gang Niu , Ivor W. Tsang , James T. Kwok , Masashi Sugiyama

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Large-scale datasets possessing clean label annotations are crucial for training Convolutional Neural Networks (CNNs). However, labeling large-scale data can be very costly and error-prone, and even high-quality datasets are likely to…

计算机视觉与模式识别 · 计算机科学 2018-04-03 Yisen Wang , Weiyang Liu , Xingjun Ma , James Bailey , Hongyuan Zha , Le Song , Shu-Tao Xia

Learning with Noisy Labels (LNL) aims to improve the model generalization when facing data with noisy labels, and existing methods generally assume that noisy labels come from known classes, called closed-set noise. However, in real-world…

机器学习 · 计算机科学 2025-01-22 Linchao Pan , Can Gao , Jie Zhou , Jinbao Wang

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

计算机视觉与模式识别 · 计算机科学 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Supervised learning on Deep Neural Networks (DNNs) is data hungry. Optimizing performance of DNN in the presence of noisy labels has become of paramount importance since collecting a large dataset will usually bring in noisy labels.…

计算机视觉与模式识别 · 计算机科学 2020-12-09 Shuyu Kong , You Li , Jia Wang , Amin Rezaei , Hai Zhou

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

机器学习 · 计算机科学 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

Datasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs). We propose a new perspective for understanding DNN generalization for such datasets, by…

计算机视觉与模式识别 · 计算机科学 2018-08-01 Xingjun Ma , Yisen Wang , Michael E. Houle , Shuo Zhou , Sarah M. Erfani , Shu-Tao Xia , Sudanthi Wijewickrema , James Bailey

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

计算机视觉与模式识别 · 计算机科学 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

计算机视觉与模式识别 · 计算机科学 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

Deep neural networks are able to memorize noisy labels easily with a softmax cross-entropy (CE) loss. Previous studies attempted to address this issue focus on incorporating a noise-robust loss function to the CE loss. However, the…

机器学习 · 计算机科学 2022-07-26 Li Yi , Sheng Liu , Qi She , A. Ian McLeod , Boyu Wang

We propose a semi-supervised learning approach for video classification, VideoSSL, using convolutional neural networks (CNN). Like other computer vision tasks, existing supervised video classification methods demand a large amount of…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Longlong Jing , Toufiq Parag , Zhe Wu , Yingli Tian , Hongcheng Wang

In this paper, we address the problem of effectively self-training neural networks in a low-resource setting. Self-training is frequently used to automatically increase the amount of training data. However, in a low-resource scenario, it is…

计算与语言 · 计算机科学 2019-04-03 Debjit Paul , Mittul Singh , Michael A. Hedderich , Dietrich Klakow

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

机器学习 · 计算机科学 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

计算与语言 · 计算机科学 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow

Despite the large progress in supervised learning with neural networks, there are significant challenges in obtaining high-quality, large-scale and accurately labelled datasets. In such a context, how to learn in the presence of noisy…

计算机视觉与模式识别 · 计算机科学 2024-09-09 Chen Feng , Georgios Tzimiropoulos , Ioannis Patras

Inspired by the remarkable zero-shot generalization capacity of vision-language pre-trained model, we seek to leverage the supervision from CLIP model to alleviate the burden of data labeling. However, such supervision inevitably contains…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Junchu Huang , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

机器学习 · 计算机科学 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

计算机视觉与模式识别 · 计算机科学 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic