中文
相关论文

相关论文: Beyond Loss Values: Robust Dynamic Pruning via Los…

200 篇论文

Existing dialogue datasets contain lots of noise in their state annotations. Such noise can hurt model training and ultimately lead to poor generalization performance. A general framework named ASSIST has recently been proposed to train…

计算与语言 · 计算机科学 2022-10-25 Fanghua Ye , Xi Wang , Jie Huang , Shenghui Li , Samuel Stern , Emine Yilmaz

Label noise, commonly found in real-world datasets, has a detrimental impact on a model's generalization. To effectively detect incorrectly labeled instances, previous works have mostly relied on distinguishable training signals, such as…

机器学习 · 计算机科学 2024-05-31 Suyeon Kim , Dongha Lee , SeongKu Kang , Sukang Chae , Sanghwan Jang , Hwanjo Yu

Training deep neural networks on real-world datasets is often hampered by the presence of noisy labels, which can be memorized by over-parameterized models, leading to significant degradation in generalization performance. While existing…

机器学习 · 计算机科学 2025-12-18 Jianchao Wang , Qingfeng Li , Pengcheng Zheng , Xiaorong Pu , Yazhou Ren

Robust loss functions are essential for training deep neural networks with better generalization power in the presence of noisy labels. Symmetric loss functions are confirmed to be robust to label noise. However, the symmetric condition is…

机器学习 · 计算机科学 2021-06-08 Xiong Zhou , Xianming Liu , Junjun Jiang , Xin Gao , Xiangyang Ji

Network alignment has attracted widespread attention in various fields. However, most existing works mainly focus on the problem of label sparsity, while overlooking the issue of noise in network alignment, which can substantially undermine…

机器学习 · 计算机科学 2025-08-11 Yixuan Nan , Xixun Lin , Yanmin Shang , Zhuofan Li , Can Zhao , Yanan Cao

As deep neural networks can easily overfit noisy labels, robust training in the presence of noisy labels is becoming an important challenge in modern deep learning. While existing methods address this problem in various directions, they…

机器学习 · 计算机科学 2022-11-30 Jongwoo Ko , Bongsoo Yi , Se-Young Yun

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

机器学习 · 计算机科学 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Multi-label classification poses challenges due to imbalanced and noisy labels in training data. We propose a unified data augmentation method, named BalanceMix, to address these challenges. Our approach includes two samplers for imbalanced…

机器学习 · 计算机科学 2023-12-13 Hwanjun Song , Minseok Kim , Jae-Gil Lee

Training deep neural networks (DNNs) with noisy labels is a challenging problem due to over-parameterization. DNNs tend to essentially fit on clean samples at a higher rate in the initial stages, and later fit on the noisy samples at a…

机器学习 · 计算机科学 2021-07-08 Sree Ram Kamabattula , Venkat Devarajan , Babak Namazi , Ganesh Sankaranarayanan

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

机器学习 · 计算机科学 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

机器学习 · 计算机科学 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

Deep learning has shown remarkable success in medical image analysis, but its reliance on large volumes of high-quality labeled data limits its applicability. While noisy labeled data are easier to obtain, directly incorporating them into…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Chengxuan Qian , Kai Han , Jianxia Ding , Chongwen Lyu , Zhenlong Yuan , Jun Chen , Zhe Liu

Accurate perception is critical for vehicle safety, with LiDAR as a key enabler in autonomous driving. To ensure robust performance across environments, sensor types, and weather conditions without costly re-annotation, domain…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Weitong Kong , Zichao Zeng , Di Wen , Jiale Wei , Kunyu Peng , June Moh Goo , Jan Boehm , Rainer Stiefelhagen

While mislabeled or ambiguously-labeled samples in the training set could negatively affect the performance of deep models, diagnosing the dataset and identifying mislabeled samples helps to improve the generalization power. Training…

计算机视觉与模式识别 · 计算机科学 2022-12-21 Qingrui Jia , Xuhong Li , Lei Yu , Jiang Bian , Penghao Zhao , Shupeng Li , Haoyi Xiong , Dejing Dou

Ad-hoc instruction fine-tuning of large language models (LLMs) is widely adopted for domain-specific adaptation. While domain-specific supervised fine-tuning (SFT) is effective and efficient, it often weakens cross-domain generalization and…

人工智能 · 计算机科学 2025-08-11 Jucheng Hu , Surong Yang , Lijun Wu , Dongzhan Zhou

The performance of deep neural networks scales with dataset size and label quality, rendering the efficient mitigation of low-quality data annotations crucial for building robust and cost-effective systems. Existing strategies to address…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Francesco Di Salvo , Sebastian Doerrich , Ines Rieger , Christian Ledig

Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current approaches for designing robust losses involve the introduction of noise-robust factors, i.e., hyperparameters, to control the…

机器学习 · 计算机科学 2023-09-06 Kehui Ding , Jun Shu , Deyu Meng , Zongben Xu

Noisy PN learning is the problem of binary classification when training examples may be mislabeled (flipped) uniformly with noise rate rho1 for positive examples and rho0 for negative examples. We propose Rank Pruning (RP) to solve noisy PN…

机器学习 · 统计学 2017-08-11 Curtis G. Northcutt , Tailin Wu , Isaac L. Chuang

Dataset pruning aims to construct a coreset capable of achieving performance comparable to the original, full dataset. Most existing dataset pruning methods rely on snapshot-based criteria to identify representative samples, often resulting…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Xin Zhang , Jiawei Du , Yunsong Li , Weiying Xie , Joey Tianyi Zhou

Recent advances in deep learning rely heavily on massive datasets, leading to substantial storage and training costs. Dataset pruning aims to alleviate this demand by discarding redundant examples. However, many existing methods require…

机器学习 · 计算机科学 2025-06-13 Yeseul Cho , Baekrok Shin , Changmin Kang , Chulhee Yun