中文
相关论文

相关论文: Beyond Loss Values: Robust Dynamic Pruning via Los…

200 篇论文

Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks. Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean…

机器学习 · 统计学 2022-07-13 Yingsong Huang , Bing Bai , Shengwei Zhao , Kun Bai , Fei Wang

Large language models (LLMs) have achieved outstanding performance in natural language processing, but enormous model sizes and high computational costs limit their practical deployment. Structured pruning can effectively reduce the…

计算与语言 · 计算机科学 2025-03-11 Jun Kong , Xinge Ma , Jin Wang , Xuejie Zhang

Learning with Noisy Labels (LNL) has become an appealing topic, as imperfectly annotated data are relatively cheaper to obtain. Recent state-of-the-art approaches employ specific selection mechanisms to separate clean and noisy samples and…

机器学习 · 计算机科学 2023-08-04 Ruixuan Xiao , Yiwen Dong , Haobo Wang , Lei Feng , Runze Wu , Gang Chen , Junbo Zhao

Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy…

机器学习 · 计算机科学 2022-03-11 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

Noisy labeled data represent a rich source of information that often are easily accessible and cheap to obtain, but label noise might also have many negative consequences if not accounted for. How to fully utilize noisy labels has been…

Large scale deep learning provides a tremendous opportunity to improve the quality of content recommendation systems by employing both wider and deeper models, but this comes at great infrastructural cost and carbon footprint in modern data…

机器学习 · 计算机科学 2020-10-22 Mao Ye , Dhruv Choudhary , Jiecao Yu , Ellie Wen , Zeliang Chen , Jiyan Yang , Jongsoo Park , Qiang Liu , Arun Kejariwal

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

There is an emerging trend to leverage noisy image datasets in many visual recognition tasks. However, the label noise among the datasets severely degenerates the \mbox{performance of deep} learning approaches. Recently, one mainstream is…

计算机视觉与模式识别 · 计算机科学 2017-11-03 Jiangchao Yao , Jiajie Wang , Ivor Tsang , Ya Zhang , Jun Sun , Chengqi Zhang , Rui Zhang

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

机器学习 · 计算机科学 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective…

计算机视觉与模式识别 · 计算机科学 2017-05-10 Ishan Jindal , Matthew Nokleby , Xuewen Chen

The removal of carefully-selected examples from training data has recently emerged as an effective way of improving the robustness of machine learning models. However, the best way to select these examples remains an open question. In this…

机器学习 · 计算机科学 2024-09-19 Andrea Napoli , Paul White

We propose dynamic curriculum learning via data parameters for noise robust keyword spotting. Data parameter learning has recently been introduced for image processing, where weight parameters, so-called data parameters, for target classes…

音频与语音处理 · 电气工程与系统科学 2021-02-22 Takuya Higuchi , Shreyas Saxena , Mehrez Souden , Tien Dung Tran , Masood Delfarah , Chandra Dhir

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

机器学习 · 计算机科学 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

Modern deep models are trained on large real-world datasets, where data quality varies and redundancy is common. Data-centric approaches such as dataset pruning have shown promise in improving training efficiency and model performance.…

机器学习 · 计算机科学 2025-07-18 Suorong Yang , Peijia Li , Yujie Liu , Zhiming Xu , Peng Ye , Wanli Ouyang , Furao Shen , Dongzhan Zhou

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

机器学习 · 计算机科学 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

机器学习 · 计算机科学 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

Noisy training set usually leads to the degradation of generalization and robustness of neural networks. In this paper, we propose using a theoretically guaranteed noisy label detection framework to detect and remove noisy data for Learning…

机器学习 · 计算机科学 2022-03-22 Yikai Wang , Xinwei Sun , Yanwei Fu

Learning with noisy labels (LNL) is essential for training deep neural networks with imperfect data. Meta-learning approaches have achieved success by using a clean unbiased labeled set to train a robust model. However, this approach…

机器学习 · 计算机科学 2025-07-17 Ruofan Hu , Dongyu Zhang , Huayi Zhang , Elke Rundensteiner

The deep model training procedure requires large-scale datasets of annotated data. Due to the difficulty of annotating a large number of samples, label noise caused by incorrect annotations is inevitable, resulting in low model performance…

机器学习 · 计算机科学 2023-12-12 Fengpeng Li , Kemou Li , Jinyu Tian , Jiantao Zhou