中文
相关论文

相关论文: Data filtering methods for training language model…

200 篇论文

The proliferation of hate speech on social media necessitates automated detection systems that balance accuracy with computational efficiency. This study evaluates 38 model configurations in detecting hate speech across datasets ranging…

计算与语言 · 计算机科学 2025-09-19 Mahmoud Abusaqer , Jamil Saquer , Hazim Shatnawi

Acquiring and training on large-scale labeled data can be impractical due to cost constraints. Additionally, the use of small training datasets can result in considerable variability in model outcomes, overfitting, and learning of spurious…

机器学习 · 计算机科学 2025-07-08 Jiashu Tao , Reza Shokri

Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident…

计算机视觉与模式识别 · 计算机科学 2020-07-16 Yang Zou , Zhiding Yu , Xiaofeng Liu , B. V. K. Vijaya Kumar , Jinsong Wang

This paper presents an improved LLM based model for Grammatical Error Detection (GED), which is a very challenging and equally important problem for many applications. The traditional approach to GED involved hand-designed features, but…

计算与语言 · 计算机科学 2024-11-26 Rahul Nihalani , Kushal Shah

The recent success of deep neural networks is powered in part by large-scale well-labeled training data. However, it is a daunting task to laboriously annotate an ImageNet-like dateset. On the contrary, it is fairly convenient, fast, and…

计算机视觉与模式识别 · 计算机科学 2018-03-23 Yifan Ding , Liqiang Wang , Deliang Fan , Boqing Gong

The quality of natural language texts in fine-tuning datasets plays a critical role in the performance of generative models, particularly in computational creativity tasks such as poem or song lyric generation. Fluency defects in generated…

计算与语言 · 计算机科学 2025-05-08 Ilya Koziev

Identifying and handling label errors can significantly enhance the accuracy of supervised machine learning models. Recent approaches for identifying label errors demonstrate that a low self-confidence of models with respect to a certain…

机器学习 · 计算机科学 2024-05-17 Johannes Jakubik , Michael Vössing , Manil Maskey , Christopher Wölfle , Gerhard Satzger

Constructing fine-grained image datasets typically requires domain-specific expert knowledge, which is not always available for crowd-sourcing platform annotators. Accordingly, learning directly from web images becomes an alternative method…

计算机视觉与模式识别 · 计算机科学 2020-08-07 Chuanyi Zhang , Yazhou Yao , Xiangbo Shu , Zechao Li , Zhenmin Tang , Qi Wu

In this paper, we investigate the problem of learning with noisy labels in real-world annotation scenarios, where noise can be categorized into two types: factual noise and ambiguity noise. To better distinguish these noise types and…

机器学习 · 计算机科学 2023-08-23 Renyu Zhu , Haoyu Liu , Runze Wu , Minmin Lin , Tangjie Lv , Changjie Fan , Haobo Wang

This paper introduces the MERIT Dataset, a multimodal (text + image + layout) fully labeled dataset within the context of school reports. Comprising over 400 labels and 33k samples, the MERIT Dataset is a valuable resource for training…

人工智能 · 计算机科学 2026-03-04 I. de Rodrigo , A. Sanchez-Cuadrado , J. Boal , A. J. Lopez-Lopez

Collecting large-scale data with clean labels for supervised training of neural networks is practically challenging. Although noisy labels are usually cheap to acquire, existing methods suffer a lot from label noise. This paper targets at…

机器学习 · 计算机科学 2020-06-16 Zizhao Zhang , Han Zhang , Sercan O. Arik , Honglak Lee , Tomas Pfister

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

机器学习 · 计算机科学 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Currently, there are more than a dozen Russian-language corpora for sentiment analysis, differing in the source of the texts, domain, size, number and ratio of sentiment classes, and annotation method. This work examines publicly available…

计算与语言 · 计算机科学 2021-06-29 Evgeny Kotelnikov

A common approach in positive-unlabeled learning is to train a classification model between labeled and unlabeled data. This strategy is in fact known to give an optimal classifier under mild conditions; however, it results in biased…

机器学习 · 统计学 2017-02-03 Shantanu Jain , Martha White , Predrag Radivojac

Real world datasets contain incorrectly labeled instances that hamper the performance of the model and, in particular, the ability to generalize out of distribution. Also, each example might have different contribution towards learning.…

Sample selection is a prevalent approach in learning with noisy labels, aiming to identify confident samples for training. Although existing sample selection methods have achieved decent results by reducing the noise rate of the selected…

机器学习 · 计算机科学 2025-10-22 Suqin Yuan , Lei Feng , Bo Han , Tongliang Liu

Learning from corrupted labels is very common in real-world machine-learning applications. Memorizing such noisy labels could affect the learning of the model, leading to sub-optimal performances. In this work, we propose a novel framework…

机器学习 · 计算机科学 2023-12-20 Yu Wang , Xin Xin , Zaiqiao Meng , Joemon Jose , Fuli Feng

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

机器学习 · 计算机科学 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Görkem Algan , İlkay Ulusoy

Because of the ambiguous and subjective property of the facial expression recognition (FER) task, the label noise is widely existing in the FER dataset. For this problem, in the training phase, current FER methods often directly predict…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Xiang Zhang , Yan Lu , Huan Yan , Jingyang Huang , Yusheng Ji , Yu Gu