中文
相关论文

相关论文: Normalized Loss Functions for Deep Learning with N…

200 篇论文

There are inevitably many mislabeled data in real-world datasets. Because deep neural networks (DNNs) have an enormous capacity to memorize noisy labels, a robust training scheme is required to prevent labeling errors from degrading the…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Jun Ho Lee , Jae Soon Baik , Tae Hwan Hwang , Jun Won Choi

All machine learning algorithms use a loss, cost, utility or reward function to encode the learning objective and oversee the learning process. This function that supervises learning is a frequently unrecognized hyperparameter that…

神经与进化计算 · 计算机科学 2024-11-06 Mathew Mithra Noel , Arindam Banerjee , Yug Oswal , Geraldine Bessie Amali D , Venkataraman Muthiah-Nakarajan

Deep neural networks have great representation power, but typically require large numbers of training examples. This motivates deep active learning methods that can significantly reduce the amount of labeled training data. Empirical…

机器学习 · 计算机科学 2026-01-01 Yinglun Zhu , Robert Nowak

The drastic increase of data quantity often brings the severe decrease of data quality, such as incorrect label annotations, which poses a great challenge for robustly training Deep Neural Networks (DNNs). Existing learning \mbox{methods}…

机器学习 · 计算机科学 2022-03-18 Qizhou Wang , Bo Han , Tongliang Liu , Gang Niu , Jian Yang , Chen Gong

Real-world training data is often noisy; for example, human annotators assign conflicting class labels to the same instances. Partial-label learning (PLL) is a weakly supervised learning paradigm that allows training classifiers in this…

机器学习 · 计算机科学 2025-10-27 Tobias Fuchs , Florian Kalinke

Deep neural networks (DNNs) have achieved great success in a wide variety of medical image analysis tasks. However, these achievements indispensably rely on the accurately-annotated datasets. If with the noisy-labeled images, the training…

计算机视觉与模式识别 · 计算机科学 2019-01-25 Cheng Xue , Qi Dou , Xueying Shi , Hao Chen , Pheng Ann Heng

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

计算与语言 · 计算机科学 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

机器学习 · 计算机科学 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Supervised training of deep neural nets typically relies on minimizing cross-entropy. However, in many domains, we are interested in performing well on metrics specific to the application. In this paper we propose a direct loss minimization…

机器学习 · 计算机科学 2016-06-03 Yang Song , Alexander G. Schwing , Richard S. Zemel , Raquel Urtasun

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

机器学习 · 计算机科学 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

In Multi-Label Learning (MLL), it is extremely challenging to accurately annotate every appearing object due to expensive costs and limited knowledge. When facing such a challenge, a more practical and cheaper alternative should be Single…

机器学习 · 计算机科学 2024-06-11 Xiang Li , Xinrui Wang , Songcan Chen

We propose self-teaching networks to improve the generalization capacity of deep neural networks. The idea is to generate soft supervision labels using the output layer for training the lower layers of the network. During the network…

音频与语音处理 · 电气工程与系统科学 2019-09-11 Liang Lu , Eric Sun , Yifan Gong

Recent studies on the memorization effects of deep neural networks on noisy labels show that the networks first fit the correctly-labeled training samples before memorizing the mislabeled samples. Motivated by this early-learning…

机器学习 · 计算机科学 2021-09-07 Yangdi Lu , Yang Bo , Wenbo He

Adversarial robustness has proven to be a required property of machine learning algorithms. A key and often overlooked aspect of this problem is to try to make the adversarial noise magnitude as large as possible to enhance the benefits of…

机器学习 · 统计学 2020-03-31 Amirreza Shaeiri , Rozhin Nobahari , Mohammad Hossein Rohban

Deep learning with noisy labels is a challenging task. Recent prominent methods that build on a specific sample selection (SS) strategy and a specific semi-supervised learning (SSL) model achieved state-of-the-art performance. Intuitively,…

机器学习 · 计算机科学 2020-12-03 Zhuowei Wang , Jing Jiang , Bo Han , Lei Feng , Bo An , Gang Niu , Guodong Long

Noisy training set usually leads to the degradation of generalization and robustness of neural networks. In this paper, we propose using a theoretically guaranteed noisy label detection framework to detect and remove noisy data for Learning…

机器学习 · 计算机科学 2022-03-22 Yikai Wang , Xinwei Sun , Yanwei Fu

The memorization effect of deep neural network (DNN) plays a pivotal role in many state-of-the-art label-noise learning methods. To exploit this property, the early stopping trick, which stops the optimization at the early stage of…

机器学习 · 计算机科学 2021-12-28 Yingbin Bai , Erkun Yang , Bo Han , Yanhua Yang , Jiatong Li , Yinian Mao , Gang Niu , Tongliang Liu

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial examples. In this paper, we improve the robustness of DNNs by utilizing techniques of Distance Metric Learning. Specifically, we incorporate…

机器学习 · 计算机科学 2019-05-29 Pengcheng Li , Jinfeng Yi , Bowen Zhou , Lijun Zhang

Learning from noisy labels (LNL) is a challenge that arises in many real-world scenarios where collected training data can contain incorrect or corrupted labels. Most existing solutions identify noisy labels and adopt active learning to…

机器学习 · 计算机科学 2025-04-07 Bo Yuan , Yulin Chen , Yin Zhang , Wei Jiang

The deep model training procedure requires large-scale datasets of annotated data. Due to the difficulty of annotating a large number of samples, label noise caused by incorrect annotations is inevitable, resulting in low model performance…

机器学习 · 计算机科学 2023-12-12 Fengpeng Li , Kemou Li , Jinyu Tian , Jiantao Zhou