中文
相关论文

相关论文: DisturbLabel: Regularizing CNN on the Loss Layer

200 篇论文

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

计算与语言 · 计算机科学 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

In supervised learning, the presence of noise can have a significant impact on decision making. Since many classifiers do not take label noise into account in the derivation of the loss function, including the loss functions of logistic…

机器学习 · 计算机科学 2022-07-20 Dawei Dai , Donggen Li , Zhiguo Zhuang

A recently-proposed technique called self-adaptive training augments modern neural networks by allowing them to adjust training labels on the fly, to avoid overfitting to samples that may be mislabeled or otherwise non-representative. By…

机器学习 · 计算机科学 2020-06-16 Daniel Chiu , Franklyn Wang , Scott Duke Kominers

Voice-over-Internet-Protocol (VoIP) calls are prone to various speech impairments due to environmental and network conditions resulting in bad user experience. A reliable audio impairment classifier helps to identify the cause for bad audio…

声音 · 计算机科学 2019-07-04 Chandan K A Reddy , Ross Cutler , Johannes Gehrke

To train robust deep neural networks (DNNs), we systematically study several target modification approaches, which include output regularisation, self and non-self label correction (LC). Two key issues are discovered: (1) Self LC is the…

机器学习 · 计算机科学 2021-06-03 Xinshao Wang , Yang Hua , Elyor Kodirov , David A. Clifton , Neil M. Robertson

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

计算机视觉与模式识别 · 计算机科学 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

Recently deep neural networks have shown their capacity to memorize training data, even with noisy labels, which hurts generalization performance. To mitigate this issue, we provide a simple but effective baseline method that is robust to…

机器学习 · 计算机科学 2019-09-30 Yucen Luo , Jun Zhu , Tomas Pfister

Multi-label image classification has generated significant interest in recent years and the performance of such systems often suffers from the not so infrequent occurrence of incorrect or missing labels in the training data. In this paper,…

计算机视觉与模式识别 · 计算机科学 2020-05-05 Zhuolin Jiang , Jan Silovsky , Man-Hung Siu , William Hartmann , Herbert Gish , Sancar Adali

The primary goal of training in early convolutional neural networks (CNN) is the higher generalization performance of the model. However, as the expected calibration error (ECE), which quantifies the explanatory power of model inference,…

计算机视觉与模式识别 · 计算机科学 2023-02-01 Seungbum Hong , Jihun Yoon , Bogyu Park , Min-Kook Choi

In actual scenarios, whether manually or automatically annotated, label noise is inevitably generated in the training data, which can affect the effectiveness of deep CNN models. The popular solutions require data cleaning or designing…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Dawei Dai , Hao Zhu , Shuyin Xia , Guoyin Wang

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

In supervised event detection, most of the mislabeling occurs between a small number of confusing type pairs, including trigger-NIL pairs and sibling sub-types of the same coarse type. To address this label confusion problem, this paper…

计算与语言 · 计算机科学 2019-06-17 Hongyu Lin , Yaojie Lu , Xianpei Han , Le Sun

Convolutional neural networks (CNNs) have gained increasing popularity and versatility in recent decades, finding applications in diverse domains. These remarkable achievements are greatly attributed to the support of extensive datasets…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Xin Zhang , Yuqi Song , Wyatt McCurdy , Xiaofeng Wang , Fei Zuo

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

机器学习 · 计算机科学 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up…

计算机视觉与模式识别 · 计算机科学 2021-04-05 Kento Nishi , Yi Ding , Alex Rich , Tobias Höllerer

Deep convolutional neural networks are known to be unstable during training at high learning rate unless normalization techniques are employed. Normalizing weights or activations allows the use of higher learning rates, resulting in faster…

机器学习 · 计算机科学 2019-12-02 Brendan Ruff , Taylor Beck , Joscha Bach

The recent success of deep neural networks is powered in part by large-scale well-labeled training data. However, it is a daunting task to laboriously annotate an ImageNet-like dateset. On the contrary, it is fairly convenient, fast, and…

计算机视觉与模式识别 · 计算机科学 2018-03-23 Yifan Ding , Liqiang Wang , Deliang Fan , Boqing Gong

Sequence labeling systems should perform reliably not only under ideal conditions but also with corrupted inputs - as these systems often process user-generated text or follow an error-prone upstream component. To this end, we formulate the…

计算与语言 · 计算机科学 2020-05-15 Marcin Namysl , Sven Behnke , Joachim Köhler

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

计算机视觉与模式识别 · 计算机科学 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen